LIVE INTELLIGENCE · part of the Xentir AI Index

Gemma 2 27B (It) vs GPT-4 (Jun 2023)

Name: Gemma 2 27B (It) vs GPT-4 (Jun 2023) — benchmark results
Creator: Epoch AI
License: https://creativecommons.org/licenses/by/4.0/

Gemma 2 27B (It) OPEN WEIGHTS · Google DeepMind, released 2024-06-24
GPT-4 (Jun 2023) · OpenAI, released 2023-06-13

“Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/benchmarks' [online resource].” · epoch.ai/benchmarks · Licensed CC BY 4.0 · data last verified 2026-09-09 · Methodology · Data Sources

Gemma 2 27B (It) leads on more of the 4 benchmarks where both are measured — Gemma 2 27B (It) on 3, GPT-4 (Jun 2023) on 1. The remaining 5 of 9 tracked benchmarks cannot be compared: 1 has a result for only one of the two models, 4 for neither. Nothing on this page is estimated to fill those in.

Head-to-head

Measured on 4 of 9 tracked benchmarks for both models — Gemma 2 27B (It) leads on 3, GPT-4 (Jun 2023) leads on 1.

Benchmark	Gemma 2 27B (It)	GPT-4 (Jun 2023)	Leads
Epoch Capabilities Index (ECI)	122.0	123.1	GPT-4 (Jun 2023)
SWE-bench Verified	Not measured	Not measured	Not measured on both
GPQA Diamond	0.365	0.307	Gemma 2 27B (It)
MATH Level 5	0.279	0.230	Gemma 2 27B (It)
OTIS Mock AIME 2024-2025	0.014	0.011	Gemma 2 27B (It)
FrontierMath	Not measured	Not measured	Not measured on both
FrontierMath Tier 4	Not measured	Not measured	Not measured on both
SimpleQA Verified	Not measured	Not measured	Not measured on both
Chess Puzzles	Not measured	0.040	Comparison unavailable — Gemma 2 27B (It) has no published result

Benchmark results measure specific tasks and should not be treated as a universal measure of model quality. A model with no row here for a benchmark has not been measured on it — that is left blank, never estimated.

What remains uncertain

Gemma 2 27B (It) has no published result on Chess Puzzles.
4 tracked benchmarks have no published result for either model.

A missing result means Xentir has not found one published by the source it cites, not that the model performs badly. See Data Sources.

Reference price

Per 1M tokens	Gemma 2 27B (It)	GPT-4 (Jun 2023)
Output	—	$60.00

List price as published by the vendor. Xentir does not verify negotiated or enterprise rates, and price is not a measure of capability — see Data Sources.

Full profiles

Gemma 2 27B (It) → · GPT-4 (Jun 2023) → · the full AI Model Rankings table