Bring Your Own Key (BYOK)
Save provider keys for supported BYOK requests. Keys are encrypted at rest; we only display the last 4 characters.
Provider credentials
OpenAI
OpenAI Responses
Anthropic
Chutes
AWS Bedrock
Paste JSON: {"accessKeyId":"...","secretAccessKey":"...","region":"us-east-1"}
Groq
SambaNova
Vercel
Novita
MegaNova
Xiaomi
SiliconFlow
Custom Inference
Akash
Google AI Studio
Google Vertex
Paste a Google service account JSON key with location or region.
Z.AI (GLM)
Gerra
GMICloud
Cerebras
DeepInfra
Hyperbolic
Morpheus
Fireworks
Together
Web Search Credentials
Tavily (Web Search)
For web search only. Used by /api/web and web-search enhancements.
Exa (Web Search)
For web search only. Supports neural/semantic search modes.
Kagi (Web Search)
For web search only. Used by /api/web and web-search enhancements.
Perplexity (Web Search)
For web search only. Used by /api/web and web-search enhancements.
Valyu (Web Search)
For web search only. Supports web, news, and proprietary indexes.
Example: Call v1/chat/completions with BYOK
Replace YOUR_NANOGPT_API_KEY and choose one of your saved model provider keys: openai | openai-responses | anthropic | chutes | aws | groq | sambanova | vercel | novita | meganova | xiaomi | siliconflow | wafer | akash | google | google-vertex | zai | gerra | gmicloud | cerebras | deepinfra. Web search keys are used only for web search endpoints and enhancements.
BYOK FAQ
What is the pricing?
We charge a 5% markup on the normal at-cost API rates. Your provider bills you directly; we only charge the markup.
What if I use a free model via BYOK?
If the model that you use is free via the original provider where you use it from we base our 5% markup on what the lowest rate would be if you used the paid version of it. If you for example use an API key that has free requests for gemini-2.5-pro, we will charge the 5% markup based on regular gemini-2.5-pro pricing.
Which endpoint supports BYOK?
BYOK is supported on the OpenAI-compatible endpoint /api/v1/chat/completions. Web chat can use saved provider keys for normal text chat when saved-key mode is enabled; the standard provider selector remains platform-billed.
Where are web search keys used?
Web search keys are used for web search only (e.g., /api/web and web-search enhancements). They are not chat model providers.
Do I have to set x-byok-provider?
No. It’s optional. We auto-map based on the model. Setting it is recommended if you want to force a specific provider.
How do I use Google Gemini AI Studio?
Add your Google AI Studio provider key above, then set the header x-byok-provider: google when calling /api/v1/chat/completions. This forces BYOK routing through Google AI Studio for Gemini models.
How do I use Google Vertex?
Add your Google Vertex service account JSON above with a location, then set x-byok-provider: google-vertex for Gemini BYOK chat requests.
What usage counts are used for billing?
We prefer provider-reported usage tokens when available (streaming or final usage). If unavailable, we estimate conservatively.
How are keys stored?
Saved provider keys are encrypted at rest. We only store the last 4 characters for display and never send keys back to the client.