Private AI
Meta's Llama 3.1 8B model on an open permissionless network
Context Window
128.0K
Max Output
16.4K
Input Price (Auto)
$0.020/1M
Output Price (Auto)
$0.030/1M
Performance metrics and benchmarks
Sourced from Artificial Analysis.
Intelligence Index
8.9
Auto routing is available for this model. Explicit provider selection is not available.
Loading provider options…
Coding Index
6.8
Agentic Index
5.5
GPQA Diamond
Graduate-level scientific reasoning
37.9%
Better than 16% of models compared
HLE
Humanity's Last Exam
4.4%
Better than 22% of models compared
IFBench
Instruction-following benchmark
37.1%
Better than 32% of models compared
T²-Bench Telecom
Conversational AI agents in dual-control scenarios
0.0%
Better than 3% of models compared
AA-LCR
Long context reasoning evaluation
0.0%
Better than 6% of models compared
GDPval-AA
Economically valuable tasks
0.0%
Better than 11% of models compared
CritPt
Research-level physics reasoning
0.0%
Better than 27% of models compared
SciCode
Python programming for scientific computing
18.9%
Better than 20% of models compared
Terminal-Bench Hard
Agentic coding and terminal use
0.8%
AIME
American Invitational Mathematics Examination
0.0%
Better than 3% of models compared
Math-500
Diverse mathematical problem solving benchmark
48.3%
Better than 12% of models compared
MMLU-Pro
Professional and academic subject knowledge
57.4%
Better than 20% of models compared
AA-Omniscience Accuracy
Proportion of correctly answered questions
8.1%
Better than 5% of models compared
Last updated Jun 4, 2026
Artificial AnalysisBetter than 11% of models compared
LiveCodeBench
Contamination-free coding benchmark
19.8%
Better than 21% of models compared
AA-Omniscience Hallucination Rate
Rate of incorrect answers among non-correct responses
41.8%
Better than 90% of models compared
