LIVE INTELLIGENCE · part of the Xentir AI Index

Mistral Large vs phi-3-medium 14B

Mistral Large · Mistral AI, released 2024-02-26
phi-3-medium 14B OPEN WEIGHTS · Microsoft, released 2024-04-23

“Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/benchmarks' [online resource].” · epoch.ai/benchmarks · Licensed CC BY 4.0 · data last verified 2026-07-26 · Methodology · Data Sources

Head-to-head

Measured on 3 of 9 tracked benchmarks for both models — Mistral Large leads on 2, phi-3-medium 14B leads on 1.

Benchmark	Mistral Large	phi-3-medium 14B	Leads
Epoch Capabilities Index (ECI)	121.0	121.0	phi-3-medium 14B
SWE-bench Verified	Not measured	Not measured	Not measured on both
GPQA Diamond	0.388	0.276	Mistral Large
MATH Level 5	0.245	0.176	Mistral Large
OTIS Mock AIME 2024-2025	0.019	Not measured	Not measured on both
FrontierMath	Not measured	Not measured	Not measured on both
FrontierMath Tier 4	Not measured	Not measured	Not measured on both
SimpleQA Verified	Not measured	Not measured	Not measured on both
Chess Puzzles	Not measured	Not measured	Not measured on both

Benchmark results measure specific tasks and should not be treated as a universal measure of model quality. A model with no row here for a benchmark has not been measured on it — that is left blank, never estimated.

Full profiles

Mistral Large → · phi-3-medium 14B → · the full AI Model Rankings table