Mistral Devstral Small 2505

OpenHands+Devstral is 100% local 100% open, and is SOTA for the category on SWE-Bench Verified: 46.8% accuracy.

Added Aug 2, 2025

Pricing

Auto routing · per 1M tokens
Input
$0.060
Output
$0.060
Compare provider prices

Specifications

Context window
32.8K
Max output
8.2K
Parameters
24B

Benchmarks

Sourced from Artificial Analysis.

Intelligence Index

8.7

Better than 33% of models compared

Agentic work

T²-Bench Telecom (legacy)

Legacy fallback · Conversational AI agents in dual-control scenarios

38.0%

Better than 46% of models compared

Document reasoning

AA-LCR v1.1

Long context reasoning with updated grading

32.0%

Better than 31% of models compared

Reasoning

HLE

Humanity's Last Exam

4.0%

Better than 12% of models compared

IFBench

Instruction-following benchmark

31.6%

Better than 18% of models compared

Coding

Terminal-Bench Hard (legacy)

Legacy fallback · Agentic coding and terminal use

6.1%

Better than 34% of models compared

LiveCodeBench

Contamination-free coding benchmark

25.8%

Better than 27% of models compared

Math

AIME

American Invitational Mathematics Examination

6.7%

Better than 24% of models compared

Math-500

Diverse mathematical problem solving benchmark

68.4%

Better than 25% of models compared

Knowledge

MMLU-Pro

Professional and academic subject knowledge

63.2%

Better than 24% of models compared

Legacy benchmarks

GPQA Diamond (legacy)

Graduate-level scientific reasoning

43.4%

Better than 19% of models compared

AA-LCR (unversioned / legacy)

Long context reasoning evaluation

32.0%

Better than 31% of models compared

Last updated Oct 1, 2026

Artificial Analysis

Providers

Auto routing is available for this model. Explicit provider selection is not available.

Loading provider options…