d3 Mini (Decision Small)
vLLM Semantic Router’s d3 Mini is the current 4B decision model for fast first-pass classification and high-volume routing. Runs in an attested TEE (Trusted Execution Environment), with encrypted requests and attestation verified by NanoGPT. It evaluates text against predicate, choice and score questions and returns calibrated probabilities without generating text. Supports a 32,768-token context, up to 64 questions per request, and up to 26 choice options and 10 score levels. Text input only; reasoning, tools and streaming are unsupported. Use the native input and questions-array format through the Decisions API, or supported text questions through System One compatibility. The public ID decision-small is a mutable size alias, not an immutable checkpoint.
Added Oct 22, 2026
Pricing
Auto routing · per 1M tokens- Input
- $0.020
- Output
- Free
Specifications
- Context window
- 32.8K
- Image input
- No
- Questions per request
- 64
API request
Send your application state and typed questions to POST /api/v1/decisions. Each answer comes back with its probabilities.
{
"model": "decision-small",
"input": "Customer says they were charged three times for one $49 purchase and wants a refund.",
"questions": [
{
"type": "predicate",
"name": "escalate",
"instructions": "Should this be escalated to a human agent?"
}
]
}Decisions API docs Providers
Provider information for this model’s automatic routing. These routes cannot be selected individually.
Loading provider options…