Friendli

Data handling can vary by model and deployment. The privacy badge above shows the more conservative of the provider-wide fallback and the policies for routes on this page; each model page shows the policy for that specific route.

Models served by Friendli

Model name

Model	Context	Input /M	Output /M	Cache read /M	Cache hit	TTFT	Throughput
Gemma 4 31B google/gemma-4-31b-it:friendli	262k	$0.147/M	$0.42/M	N/A	N/A	2s	49 tps
Gemma 4 31B (Thinking) google/gemma-4-31b-it:thinking:friendli	262k	$0.147/M	$0.42/M	N/A	N/A	2s	49 tps
GLM 5 z-ai/glm-5:friendli	200k	$1.05/M	$3.36/M	N/A	N/A	N/A	N/A
GLM 5.2 z-ai/glm-5.2:friendli	1.0M	$1.47/M	$4.62/M	$0.273/M	N/A	0.6s	108 tps
GLM 5.2 (Thinking) z-ai/glm-5.2:thinking:friendli	1.0M	$1.47/M	$4.62/M	$0.273/M	N/A	0.6s	108 tps
GLM 5.3 z-ai/glm-5.3:friendli	1.0M	$1.32/M	$4.16/M	$0.246/M	0%	0.6s	87 tps
GLM 5.3 (Thinking) z-ai/glm-5.3:thinking:friendli	1.0M	$1.32/M	$4.16/M	$0.246/M	0%	0.6s	87 tps
GLM 5.3 Flash z-ai/glm-5.3-flash:friendli	1.0M	$0.157/M	$0.525/M	$0.0315/M	N/A	3.8s	56 tps

Gemma 4 31B

google/gemma-4-31b-it:friendli

Context

262k

Input /M

$0.147/M

Output /M

$0.42/M

Cache read /M

N/A

Cache hit

N/A

TTFT

2s

Throughput

49 tps

Gemma 4 31B (Thinking)

google/gemma-4-31b-it:thinking:friendli

Context

262k

Input /M

$0.147/M

Output /M

$0.42/M

Cache read /M

N/A

Cache hit

N/A

TTFT

2s

Throughput

49 tps

GLM 5

z-ai/glm-5:friendli

Context

200k

Input /M

$1.05/M

Output /M

$3.36/M

Cache read /M

N/A

Cache hit

N/A

TTFT

N/A

Throughput

N/A

GLM 5.2

z-ai/glm-5.2:friendli

Context

1.0M

Input /M

$1.47/M

Output /M

$4.62/M

Cache read /M

$0.273/M

Cache hit

N/A

TTFT

0.6s

Throughput

108 tps

GLM 5.2 (Thinking)

z-ai/glm-5.2:thinking:friendli

Context

1.0M

Input /M

$1.47/M

Output /M

$4.62/M

Cache read /M

$0.273/M

Cache hit

N/A

TTFT

0.6s

Throughput

108 tps

GLM 5.3

z-ai/glm-5.3:friendli

Context

1.0M

Input /M

$1.32/M

Output /M

$4.16/M

Cache read /M

$0.246/M

Cache hit

0%

TTFT

0.6s

Throughput

87 tps

GLM 5.3 (Thinking)

z-ai/glm-5.3:thinking:friendli

Context

1.0M

Input /M

$1.32/M

Output /M

$4.16/M

Cache read /M

$0.246/M

Cache hit

0%

TTFT

0.6s

Throughput

87 tps

GLM 5.3 Flash

z-ai/glm-5.3-flash:friendli

Context

1.0M

Input /M

$0.157/M

Output /M

$0.525/M

Cache read /M

$0.0315/M

Cache hit

N/A

TTFT

3.8s

Throughput

56 tps

Prices are per million tokens. TTFT is the observed time to first token. Selectable routes include the applicable provider-selection markup; fixed routes show the standard model price. Availability and pricing refresh continuously; each model page shows the live provider comparison.

Using Friendli via the API

Call a model served by Friendli using its displayed model ID, including the provider suffix when selection is supported.

curl https://nano-gpt.com/api/v1/chat/completions \
  -H "Authorization: Bearer $NANOGPT_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "google/gemma-4-31b-it:friendli",
    "messages": [{"role": "user", "content": "Hello"}]
  }'

For models with provider selection, append :friendli to the model ID, set "provider": "friendli" in the request body, or send an X-Provider: friendli header. Explicit provider selection adds a route-specific markup over that provider's base price; the prices in the table above already include it. Models without provider selection use the displayed model ID without a provider suffix or selection surcharge.

See the API documentation for provider preferences, price-aware routing, and error behavior.