CorX Labs

Head to head

Grok 4 Fast vs Gemini 2.5 Flash

Grok 4 Fast from xAI against Gemini 2.5 Flash from Google DeepMind — specification, price and every benchmark both makers have published, in one table.

Benchmarks

Grok 4 Fast leads

Grok 4 Fast wins 2 of the 2 benchmarks both models report, Gemini 2.5 Flash wins 0, by a wide margin. The average gap across shared tests is 10.7 points.

Price

Grok 4 Fast is cheaper

On a 3:1 input-to-output mix, Grok 4 Fast costs $0.275 per million tokens against $0.85 for Gemini 2.5 Flash — about 3.1× less. Remember that a reasoning model bills its thinking as output, so cost per answer can diverge much further than cost per token.

What actually differs

  • Grok 4 Fast takes 2M tokens of context against 1M — 1.9× more room for long documents or a large codebase.

Scorecard

Which is better at what

Maths, coding, reasoning and the rest — one line each, averaged over the benchmarks both models actually report.

Which model scores higher in each capability category, averaged over the benchmarks all of them report.
CategoryGrok 4 FastGemini 2.5 FlashBetter at this
ReasoningGPQA Diamond85.7%78.3%Grok 4 Fast+7.4
MathsAIME 202592.0%78.0%Grok 4 Fast+14.0
CodingNeither model reports thisNot comparable
KnowledgeNeither model reports thisNot comparable
MultimodalOnly one model reports thisNot comparable
Instruction followingNeither model reports thisNot comparable
Human preferenceOnly one model reports thisNot comparable
Categories wonOut of 2 comparable20Grok 4 Fast

Each category averages only the benchmarks every model here reports, so no one is credited for a test the other did not run. A category with no shared test is marked Not comparable rather than guessed at.

Side by side

Grok 4 Fast and Gemini 2.5 Flash, row by row

AttributeGrok 4 FastxAIGemini 2.5 FlashGoogle DeepMind
Specification
MakerWho built itxAIGoogle DeepMind
Released2025-092025-04
Context windowHow much can go in at once2,000,000 tokens1,048,576 tokens
Max output30,000 tokens65,536 tokens
InputText, ImageText, Image, Audio, Video
ReasoningSpends extra tokens thinking before it answersYesYes
Tool callingYesYes
Knowledge cutoffNot reported2025-01
LicenceProprietaryProprietary
Open weightsCan you download and run it yourselfNoNo
Price
Input priceUSD per million tokens in$0.20$0.30
Output priceUSD per million tokens out$0.50$2.50
Cached inputNot reported$0.075
Blended 3:1A 3-in-to-1-out million-token mix — a fairer single number than input price alone$0.275Cheapest$0.85
Published benchmarks
GPQA Diamond198 graduate-level physics, chemistry and biology questions written to be Google-proof. PhD holders in the matching field score about 65%.85.7%Best78.3%
AIME 2025The American Invitational Mathematics Examination — 15 problems, integer answers, no partial credit. A standard test of multi-step maths reasoning.92%Best78%
MMMUCollege-level questions that require reading charts, diagrams, tables and photographs alongside the text.Not reported79.7%
LMArena EloElo rating from blind pairwise votes by the public on LMArena. Measures what people prefer, not what is correct.Not reported1393
LinksFull pageFull page
Row verified2026-082026-08

Where these numbers come from

Every score on this page is a published figure, taken from the model's own card, system card, technical report or release post, or from a public leaderboard. CorX Labs did not run these evaluations. Most are self-reported by the lab that built the model, which means they were produced under that lab's own choice of prompt, scaffold and number of attempts — so treat them as a starting point for a shortlist, not as a settled ranking.

A score someone other than the model's maker measured is marked Independent and names its measurer. Those are the stronger numbers on this page — an outside harness has no reason to flatter anyone — and there are not many of them.

Where a figure has not been published, the cell reads Not reported rather than an estimate. Nothing here is inferred, interpolated or guessed. Each model records the month its row was last checked. Full method and caveats.

Questions

Grok 4 Fast or Gemini 2.5 Flash?

Is Grok 4 Fast better than Gemini 2.5 Flash?

Grok 4 Fast wins 2 of the 2 benchmarks both models report, Gemini 2.5 Flash wins 0, by a wide margin. The average gap across shared tests is 10.7 points.

Which is cheaper, Grok 4 Fast or Gemini 2.5 Flash?

On a 3:1 input-to-output mix, Grok 4 Fast costs $0.275 per million tokens against $0.85 for Gemini 2.5 Flash — about 3.1× less. Remember that a reasoning model bills its thinking as output, so cost per answer can diverge much further than cost per token.

What is the difference between Grok 4 Fast and Gemini 2.5 Flash?

Grok 4 Fast takes 2M tokens of context against 1M — 1.9× more room for long documents or a large codebase.