Xentir Mistral Large vs phi-3-medium 14B
Mistral Large · Mistral AI, released 2024-02-26
phi-3-medium 14B OPEN WEIGHTS · Microsoft, released 2024-04-23
“Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/benchmarks' [online resource].” · epoch.ai/benchmarks · Licensed CC BY 4.0 · data last verified 2026-09-09 · Methodology · Data Sources
Mistral Large leads on more of the 3 benchmarks where both are measured — Mistral Large on 3. The remaining 6 of 9 tracked benchmarks cannot be compared: 1 has a result for only one of the two models, 5 for neither. Nothing on this page is estimated to fill those in.
Head-to-head
Measured on 3 of 9 tracked benchmarks for both models — Mistral Large leads on 3.
| Benchmark | Mistral Large | phi-3-medium 14B | Leads |
|---|---|---|---|
| Epoch Capabilities Index (ECI) | 122.0 | 121.2 | Mistral Large |
| SWE-bench Verified | Not measured | Not measured | Not measured on both |
| GPQA Diamond | 0.388 | 0.276 | Mistral Large |
| MATH Level 5 | 0.245 | 0.176 | Mistral Large |
| OTIS Mock AIME 2024-2025 | 0.019 | Not measured | Comparison unavailable — phi-3-medium 14B has no published result |
| FrontierMath | Not measured | Not measured | Not measured on both |
| FrontierMath Tier 4 | Not measured | Not measured | Not measured on both |
| SimpleQA Verified | Not measured | Not measured | Not measured on both |
| Chess Puzzles | Not measured | Not measured | Not measured on both |
What remains uncertain
- phi-3-medium 14B has no published result on OTIS Mock AIME 2024-2025.
- 5 tracked benchmarks have no published result for either model.
A missing result means Xentir has not found one published by the source it cites, not that the model performs badly. See Data Sources.
Full profiles
Mistral Large → · phi-3-medium 14B → · the full AI Model Rankings table