LIVE INTELLIGENCE · part of the Xentir AI Index

GPT-4o (Nov 2024, Chatgpt)

Name: GPT-4o (Nov 2024, Chatgpt) — benchmark results
Creator: Epoch AI
License: https://creativecommons.org/licenses/by/4.0/

OpenAI · Status: Active · Released 2024-11-20 · Accessibility: API access

“Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/benchmarks' [online resource].” · epoch.ai/benchmarks · Licensed CC BY 4.0 · data last verified 2026-10-21 · Methodology · Data Sources

Xentir Snapshot

Watch out forNot yet measured on 8 of the 9 benchmarks Xentir tracks — see the breakdown below.

Benchmark breakdown

Benchmark	Score	Source
Epoch Capabilities Index (ECI) A composite index published by Epoch AI, aggregating results across multiple benchmark categories into a single capability score.	128.7	Epoch AI Benchmarking Hub
SWE-bench Verified Real-world GitHub issue resolution tasks, restricted to the human-verified subset of SWE-bench.	Not measured	Epoch AI Benchmarking Hub
GPQA Diamond Graduate-level multiple-choice questions in biology, physics and chemistry, written to resist search-engine lookup.	Not measured	Epoch AI Benchmarking Hub
MATH Level 5 The hardest difficulty tier of competition mathematics problems in the MATH benchmark.	Not measured	Epoch AI Benchmarking Hub
OTIS Mock AIME 2024-2025 Mock American Invitational Mathematics Examination problems from the OTIS problem sets.	Not measured	Epoch AI Benchmarking Hub
FrontierMath Original, unpublished research-level mathematics problems.	Not measured	Epoch AI Benchmarking Hub
FrontierMath Tier 4 The hardest difficulty tier within FrontierMath.	Not measured	Epoch AI Benchmarking Hub
SimpleQA Verified Short factual questions, each with a single verifiable answer.	Not measured	Epoch AI Benchmarking Hub
Chess Puzzles Tactical chess puzzles requiring one correct sequence of moves.	Not measured	Epoch AI Benchmarking Hub

Benchmark results measure specific tasks and should not be treated as a universal measure of model quality.

Pricing

No licensed per-token pricing exists for this model yet. Not shown as an estimate — see Data Sources.

History

History begins 2026-09-06 — one data point so far. A trend needs at least two.

Compare

No head-to-head comparison has been generated for this model yet — see the full AI Model Rankings table for how it stacks up on each benchmark.

Ranked nearby

GPT-4o (Nov 2024, Chatgpt) is #192 of 334 on the overall index. The models ranked closest to it:

#189 Llama 3.1-405B · Meta AI
#190 Llama 3.1-405B (Instruct q4 K) · Meta AI
#191 GPT-4o (Nov 2024) · OpenAI
#193 Mistral Large 2 (Nov 2024) · Mistral AI
#194 Mistral Large 2 (Nov 2024, Instruct) · Mistral AI
#195 Mistral Large 2 (Jul 2024) · Mistral AI

Latest Xentir coverage

OpenAI Focuses on Question-Based Student Learning · 2026-10-17
OpenAI Reveals AI Agents Infiltrated Internal Chip Design Systems · 2026-10-16
OpenAI Reports EU AI Shift Toward Agentic Systems · 2026-10-15

Sources and methodology

Scores on this page come from Epoch AI Benchmarking Hub, licensed CC BY 4.0. See the full methodology and data sources pages for how rankings, variants and ties are computed, and the full AI Model Rankings table for how GPT-4o (Nov 2024, Chatgpt) compares to every other measured model.