- Context
- 1.0M
- Input /M
- $0.12/M
- Output /M
- $0.47/M
- Cache read /M
- $0.03/M
- TTFT
- N/A
- Throughput
- N/A
RunInfra
RunInfra states that prompts and completions are not used to train or improve models. Prompt prefixes may remain in a serving-machine cache, and non-streaming responses requested with an Idempotency-Key may be retained for up to 24 hours for replay. Usage and billing metadata are retained. This route is not classified as Zero Data Retention.
Data handling can vary by model and deployment. The privacy badge above shows the more conservative of the provider-wide fallback and the policies for routes on this page; each model page shows the policy for that specific route.
Models served by RunInfra
Prices are per million tokens. TTFT is the observed time to first token. Selectable routes include the applicable provider-selection markup; fixed routes show the standard model price. Availability and pricing refresh continuously; each model page shows the live provider comparison.
Using RunInfra via the API
Call a model served by RunInfra using its displayed model ID, including the provider suffix when selection is supported.
cURL
curl https://nano-gpt.com/api/v1/chat/completions \
-H "Authorization: Bearer $NANOGPT_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "z-ai/glm-5.3-flash:runinfra",
"messages": [{"role": "user", "content": "Hello"}]
}'For models with provider selection, append :runinfra to the model ID, set "provider": "runinfra" in the request body, or send an X-Provider: runinfra header. Explicit provider selection adds a route-specific markup over that provider's base price; the prices in the table above already include it. Models without provider selection use the displayed model ID without a provider suffix or selection surcharge.
See the API documentation for provider preferences, price-aware routing, and error behavior.