Mistral Devstral Small 2505
OpenHands+Devstral is 100% local 100% open, and is SOTA for the category on SWE-Bench Verified: 46.8% accuracy.
Added Aug 2, 2025
Pricing
Auto routing · per 1M tokens- Input
- $0.060
- Output
- $0.060
Specifications
- Context window
- 32.8K
- Max output
- 8.2K
- Parameters
- 24B
Benchmarks
Benchmarks
Sourced from Artificial Analysis.
Intelligence Index
8.7
Agentic work
T²-Bench Telecom (legacy)
Legacy fallback · Conversational AI agents in dual-control scenarios
38.0%
Better than 46% of models compared
Document reasoning
AA-LCR v1.1
Long context reasoning with updated grading
32.0%
Better than 31% of models compared
Reasoning
HLE
Humanity's Last Exam
4.0%
Better than 12% of models compared
IFBench
Instruction-following benchmark
31.6%
Better than 18% of models compared
Coding
Terminal-Bench Hard (legacy)
Legacy fallback · Agentic coding and terminal use
6.1%
Better than 34% of models compared
LiveCodeBench
Contamination-free coding benchmark
25.8%
Better than 27% of models compared
Math
AIME
American Invitational Mathematics Examination
6.7%
Better than 24% of models compared
Math-500
Diverse mathematical problem solving benchmark
68.4%
Better than 25% of models compared
Knowledge
MMLU-Pro
Professional and academic subject knowledge
63.2%
Better than 24% of models compared
Legacy benchmarks
GPQA Diamond (legacy)
Graduate-level scientific reasoning
43.4%
Better than 19% of models compared
AA-LCR (unversioned / legacy)
Long context reasoning evaluation
32.0%
Better than 31% of models compared
Last updated Oct 1, 2026
Artificial AnalysisProviders
Auto routing is available for this model. Explicit provider selection is not available.
Loading provider options…