Friendli

Friendli

US
10 models available

Data handling can vary by model and deployment. The privacy badge above shows the more conservative of the provider-wide fallback and the policies for routes on this page; each model page shows the policy for that specific route.

Models served by Friendli

ModelContextInput /MOutput /MCache read /MLatencyThroughput
163k$0.53/M$1.57/M$0.26/M0.3s67 tps
262k$0.15/M$0.42/MN/A0.7s110 tps
262k$0.15/M$0.42/MN/A0.7s110 tps
200k$1.05/M$3.36/MN/AN/AN/A
1.0M$1.47/M$4.62/M$0.27/M0.3s91 tps
1.0M$1.47/M$4.62/M$0.27/M0.3s91 tps
1.0M$1.32/M$4.16/M$0.25/M0.7s111 tps
1.0M$1.32/M$4.16/M$0.25/M0.7s111 tps
1.0M$0.16/M$0.53/M$0.03/M3.2s40 tps
205k$0.31/M$1.26/M$0.06/M0.2s117 tps

Prices are per million tokens. Selectable routes include the applicable provider-selection markup; fixed routes show the standard model price. Availability and pricing refresh continuously; each model page shows the live provider comparison.

Using Friendli via the API

For models with provider selection, append :friendli to the model ID, set "provider": "friendli" in the request body, or send an X-Provider: friendli header. Explicit provider selection adds a route-specific markup over that provider's base price; the prices in the table above already include it. Models without provider selection use the displayed model ID without a provider suffix or selection surcharge.

curl https://nano-gpt.com/api/v1/chat/completions \
  -H "Authorization: Bearer $NANOGPT_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "deepseek/deepseek-v3.2:friendli",
    "messages": [{"role": "user", "content": "Hello"}]
  }'

See the API documentation for provider preferences, price-aware routing, and error behavior.