DeepInfra

65 models available

Models served by DeepInfra

Model	Context	Input /M	Output /M	Cache read /M	Cache hit	Latency	Throughput
DeepSeek R1-0528 FP4	128k	$0.53/M	$2.26/M	$0.37/M	59.9%	0.9s	26 tps
DeepSeek V3 0324 FP4	128k	$0.25/M	$0.94/M	$0.14/M	38.1%	0.5s	26 tps
DeepSeek V3.1 FP4	128k	$0.26/M	$1.00/M	$0.14/M	42.1%	0.9s	10 tps
DeepSeek V3.2 FP4	163k	$0.27/M	$0.40/M	$0.14/M	0%	0.8s	28 tps
DeepSeek V3.2 (Thinking) FP4	163k	$0.27/M	$0.40/M	$0.14/M	N/A	0.8s	28 tps
DeepSeek V4 Flash FP8	1.0M	$0.09/M	$0.19/M	$0.02/M	N/A	1.4s	19 tps
DeepSeek V4 Flash (Thinking) FP8	1.0M	$0.09/M	$0.19/M	$0.02/M	48.2%	1.4s	19 tps
DeepSeek V4 Flash 0731 FP8	1.0M	$0.08/M	$0.19/M	$0.02/M	49.6%	0.7s	34 tps
DeepSeek V4 Flash 0731 (Thinking) FP8	1.0M	$0.08/M	$0.19/M	$0.02/M	51.9%	0.7s	34 tps
DeepSeek V4 Pro FP8	1.0M	$1.36/M	$2.73/M	$0.10/M	43.1%	1s	18 tps
DeepSeek V4 Pro (Thinking) FP8	1.0M	$1.36/M	$2.73/M	$0.10/M	51.5%	1s	18 tps
DeepSeek V4 Pro 0813 FP8	1.0M	$1.36/M	$2.73/M	$0.10/M	50.8%	2.3s	22 tps
DeepSeek V4 Pro 0813 (Thinking) FP8	1.0M	$1.36/M	$2.73/M	$0.10/M	23%	2.3s	22 tps
Gemma 4 26B A4B FP8	262k	$0.07/M	$0.36/M	$0.01/M	0%	0.4s	26 tps
Gemma 4 31B FP8	262k	$0.14/M	$0.40/M	$0.02/M	13.5%	2.1s	19 tps
GLM 4.6 FP4	200k	$0.53/M	$2.10/M	$0.10/M	30.8%	0.6s	45 tps
GLM 4.6 (Thinking) FP4	200k	$0.53/M	$2.10/M	$0.10/M	23.9%	1.6s	38.1 tps
GLM 4.7 FP4	200k	$0.42/M	$1.84/M	$0.08/M	23.1%	1.1s	22 tps
GLM 4.7 (Thinking) FP4	200k	$0.42/M	$1.84/M	$0.08/M	20.7%	1.1s	22 tps
GLM 4.7 Flash (Thinking) BF16	200k	$0.06/M	$0.42/M	$0.01/M	N/A	0.7s	38 tps
GLM 4.7 Flash Original (Thinking) BF16	200k	$0.06/M	$0.42/M	$0.01/M	N/A	0.7s	38 tps
GLM 5 FP4	200k	$0.63/M	$2.18/M	$0.13/M	N/A	0.9s	22 tps
GLM 5 (Thinking) FP4	200k	$0.63/M	$2.18/M	$0.13/M	N/A	0.9s	22 tps
GLM 5.1 FP4	200k	$1.10/M	$3.68/M	$0.22/M	N/A	0.9s	13 tps
GLM 5.1 (Thinking) FP4	200k	$1.10/M	$3.68/M	$0.22/M	N/A	0.9s	13 tps
GLM 5.2 FP4	1.0M	$0.51/M	$1.64/M	$0.10/M	N/A	1.1s	40 tps
GLM 5.2 (Thinking) FP4	1.0M	$0.51/M	$1.64/M	$0.10/M	91.9%	1.1s	40 tps
GLM 5.3 FP8	1.0M	$1.26/M	$4.20/M	$0.25/M	4%	0.7s	38 tps
GLM 5.3 (Thinking) FP8	1.0M	$1.26/M	$4.20/M	$0.25/M	5.1%	0.7s	38 tps
GLM 5.3 Flash FP8	1.0M	$0.08/M	$0.26/M	$0.02/M	63.3%	1.7s	31 tps
GPT OSS 120B BF16	128k	$0.16/M	$0.63/M	N/A	0%	0.3s	136 tps
GPT OSS 20B BF16	128k	$0.03/M	$0.15/M	N/A	N/A	0.3s	102 tps
Hermes 3 70B FP8	66k	$0.73/M	$0.73/M	N/A	0%	0.5s	29 tps
Kimi K2.5 FP4	256k	$0.47/M	$2.36/M	$0.07/M	0%	0.6s	33 tps
Kimi K2.5 Thinking FP4	256k	$0.47/M	$2.36/M	$0.07/M	80.7%	0.6s	33 tps
Kimi K2.6 FP4	256k	$0.79/M	$3.68/M	$0.16/M	N/A	1s	28 tps
Kimi K2.7 Code FP4	262k	$0.71/M	$3.57/M	$0.14/M	0%	0.8s	53.5 tps
Kimi K3 BF16	1.0M	$2.99/M	$14.96/M	$0.30/M	5.3%	1.4s	41 tps
Llama 3.3 70B Instruct FP8	131k	$0.10/M	$0.34/M	N/A	0%	0.5s	9 tps
Llama 4 Maverick FP8	1.0M	$0.21/M	$0.84/M	N/A	N/A	0.3s	52 tps
MiMo V2.5 FP8	1.0M	$0.14/M	$0.68/M	$0.03/M	29.2%	2.6s	20 tps
MiMo V2.5 Pro FP8	1.0M	$1.05/M	$3.15/M	$0.21/M	17.7%	1.5s	32 tps
MiMo V2.5 Pro Thinking FP8	1.0M	$1.05/M	$3.15/M	$0.21/M	0%	1.5s	32 tps
MiMo V2.5 Thinking FP8	1.0M	$0.14/M	$0.68/M	$0.03/M	0%	2.6s	20 tps
MiniMax M2.7 FP8	205k	$0.26/M	$1.05/M	$0.05/M	12.8%	0.5s	32.5 tps
MiniMax M3 FP8	512k	$0.29/M	$1.16/M	$0.06/M	N/A	1.1s	20 tps
MiniMax M3 Thinking FP8	512k	$0.29/M	$1.16/M	$0.06/M	N/A	1.1s	20 tps
Nvidia Nemotron 3 Super 120B BF16	262k	$0.09/M	$0.42/M	N/A	0%	2.9s	50 tps
Nvidia Nemotron 3 Super 120B Thinking BF16	262k	$0.09/M	$0.42/M	N/A	0%	2.9s	50 tps
Nvidia Nemotron 3 Ultra 550B	256k	$0.53/M	$2.31/M	$0.11/M	46.6%	1.9s	68.2 tps
Nvidia Nemotron 3 Ultra 550B Thinking	256k	$0.53/M	$2.31/M	$0.11/M	0%	N/A	389.6 tps
Nvidia Nemotron 3.5 Lightning	29k	$0.08/M	$0.21/M	$0.04/M	24.2%	1.2s	106.2 tps
Nvidia Nemotron 3.5 Lightning Thinking	29k	$0.08/M	$0.21/M	$0.04/M	0%	1.6s	126.9 tps
Qwen 2.5 72B Instruct FP8	131k	$0.38/M	$0.42/M	N/A	0%	0.3s	22 tps
Qwen 3.6 27B FP8	260k	$0.34/M	$3.36/M	N/A	N/A	0.3s	55 tps
Qwen 3.6 27B Thinking FP8	260k	$0.34/M	$3.36/M	N/A	N/A	0.3s	55 tps
Qwen 3.6 35B A3B FP8	262k	$0.10/M	$1.00/M	N/A	N/A	0.8s	68 tps
Qwen 3.6 35B A3B Thinking FP8	262k	$0.10/M	$1.00/M	N/A	N/A	0.8s	68 tps
Qwen3 235B A22B FP8	41k	$0.09/M	$0.58/M	N/A	0%	0.5s	7 tps
Qwen3 32B FP8	41k	$0.08/M	$0.29/M	N/A	0%	0.5s	22 tps
Qwen3 Next 80B A3B Instruct FP8	256k	$0.09/M	$1.16/M	N/A	0%	0.4s	68 tps
Qwen3.5 397B FP8	258k	$0.47/M	$3.15/M	$0.23/M	N/A	0.3s	37 tps
Qwen3.5 397B Thinking FP8	258k	$0.47/M	$3.15/M	$0.23/M	N/A	0.3s	37 tps
Qwen3.8 Max FP4	262k	$2.10/M	$6.30/M	$0.21/M	N/A	1.9s	77 tps
Qwen3.8 Max Thinking FP4	262k	$2.10/M	$6.30/M	$0.21/M	7.1%	1.9s	77 tps

Prices are per million tokens and include the 5% provider-selection markup. Availability and pricing refresh continuously; each model page shows the live provider comparison.

Using DeepInfra via the API

Append :deepinfra to the model ID, set "provider": "deepinfra" in the request body, or send an X-Provider: deepinfra header. Explicit provider selection adds a 5% markup over that provider's base price; the prices in the table above already include it.

curl https://nano-gpt.com/api/v1/chat/completions \
  -H "Authorization: Bearer $NANOGPT_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "deepseek-ai/DeepSeek-R1-0528:deepinfra",
    "messages": [{"role": "user", "content": "Hello"}]
  }'

See the API documentation for provider preferences, price-aware routing, and error behavior.

DeepInfra terms of use DeepInfra privacy policy