Friendli

Models served by Friendli

Model	Context	Input /M	Output /M	Cache read /M	Latency	Throughput
DeepSeek V3.2 deepseek/deepseek-v3.2:friendli	163k	$0.53/M	$1.57/M	$0.26/M	0.5s	36 tps
Gemma 4 31B google/gemma-4-31b-it:friendli	262k	$0.15/M	$0.42/M	N/A	0.9s	59 tps
Gemma 4 31B (Thinking) google/gemma-4-31b-it:thinking:friendli	262k	$0.15/M	$0.42/M	N/A	0.9s	59 tps
GLM 5 zai-org/glm-5:friendli	200k	$1.05/M	$3.36/M	N/A	N/A	N/A
GLM 5.2 zai-org/glm-5.2:friendli	1.0M	$1.47/M	$4.62/M	$0.27/M	1.6s	72 tps
GLM 5.2 (Thinking) zai-org/glm-5.2:thinking:friendli	1.0M	$1.47/M	$4.62/M	$0.27/M	1.6s	72 tps
GLM 5.3 zai-org/glm-5.3:friendli	1.0M	$1.47/M	$4.62/M	$0.27/M	0.2s	152 tps
GLM 5.3 (Thinking) zai-org/glm-5.3:thinking:friendli	1.0M	$1.47/M	$4.62/M	$0.27/M	0.2s	152 tps
GLM 5.3 Flash z-ai/glm-5.3-flash:friendli	1.0M	$0.16/M	$0.53/M	$0.03/M	2.7s	54 tps
MiniMax M2.5 minimax/minimax-m2.5:friendli	205k	$0.31/M	$1.26/M	$0.06/M	0.3s	192 tps

Prices are per million tokens and include the 5% provider-selection markup. Availability and pricing refresh continuously; each model page shows the live provider comparison.

Using Friendli via the API

Append :friendli to the model ID, set "provider": "friendli" in the request body, or send an X-Provider: friendli header. Explicit provider selection adds a 5% markup over that provider's base price; the prices in the table above already include it.

curl https://nano-gpt.com/api/v1/chat/completions \
  -H "Authorization: Bearer $NANOGPT_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "deepseek/deepseek-v3.2:friendli",
    "messages": [{"role": "user", "content": "Hello"}]
  }'

See the API documentation for provider preferences, price-aware routing, and error behavior.