Skip to main content
POST
https://serverless.tensormesh.ai
/
tokenize
Tokenize Text
curl --request POST \
  --url https://serverless.tensormesh.ai/tokenize \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "model": "openai/gpt-oss-20b",
  "prompt": "Hello!"
}
'
{
  "count": 123,
  "max_model_len": 123,
  "tokens": [
    123
  ],
  "token_strs": [
    "<string>"
  ]
}

Documentation Index

Fetch the complete documentation index at: https://docs.tensormesh.ai/llms.txt

Use this file to discover all available pages before exploring further.

Use this page when you want token ids for a specific serverless model.
  • Auth: Authorization: Bearer <API_KEY>
  • Host: https://serverless.tensormesh.ai
  • Model: pass a serverless model name in the JSON request body

Authorizations

​
Authorization
string
header
required

Bearer authentication using your serverless API key. Format: Bearer <API_KEY>

Body

application/json
​
model
string
required

Serverless model name to use.

Example:

"openai/gpt-oss-20b"

​
prompt
string
required
Example:

"Hello!"

​
messages
object[]

Response

Successful Response

​
count
integer
​
max_model_len
integer
​
tokens
integer[]
​
token_strs
string[]