LIVE INTELLIGENCE · part of the Xentir AI Index

Llama 4 Maverick (FP8) vs Magistral Small 1.1

Llama 4 Maverick (FP8) OPEN WEIGHTS · Meta AI, released 2025-04-05
Magistral Small 1.1 OPEN WEIGHTS · Mistral AI, released 2025-06-10

“Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/benchmarks' [online resource].” · epoch.ai/benchmarks · Licensed CC BY 4.0 · data last verified 2026-07-26 · Methodology · Data Sources

Head-to-head

Measured on 3 of 9 tracked benchmarks for both models — Llama 4 Maverick (FP8) leads on 1, Magistral Small 1.1 leads on 2.

Benchmark	Llama 4 Maverick (FP8)	Magistral Small 1.1	Leads
Epoch Capabilities Index (ECI)	133.0	133.1	Magistral Small 1.1
SWE-bench Verified	Not measured	Not measured	Not measured on both
GPQA Diamond	0.670	0.484	Llama 4 Maverick (FP8)
MATH Level 5	0.730	Not measured	Not measured on both
OTIS Mock AIME 2024-2025	0.206	0.300	Magistral Small 1.1
FrontierMath	0.007	Not measured	Not measured on both
FrontierMath Tier 4	Not measured	Not measured	Not measured on both
SimpleQA Verified	Not measured	Not measured	Not measured on both
Chess Puzzles	Not measured	Not measured	Not measured on both

Benchmark results measure specific tasks and should not be treated as a universal measure of model quality. A model with no row here for a benchmark has not been measured on it — that is left blank, never estimated.

Full profiles

Llama 4 Maverick (FP8) → · Magistral Small 1.1 → · the full AI Model Rankings table