Head to head
Claude Haiku 4.5 vs Gemini 2.5 Flash
Claude Haiku 4.5 from Anthropic against Gemini 2.5 Flash from Google DeepMind — specification, price and every benchmark both makers have published, in one table.
Benchmarks
Gemini 2.5 Flash leads
Gemini 2.5 Flash wins 2 of the 2 benchmarks both models report, Claude Haiku 4.5 wins 0, consistently. The average gap across shared tests is 3.1 points.
Price
Gemini 2.5 Flash is cheaper
On a 3:1 input-to-output mix, Gemini 2.5 Flash costs $0.85 per million tokens against $2.00 for Claude Haiku 4.5 — about 2.4× less. Remember that a reasoning model bills its thinking as output, so cost per answer can diverge much further than cost per token.
What actually differs
- Gemini 2.5 Flash takes 1M tokens of context against 200K — 5.2× more room for long documents or a large codebase.
Scorecard
Which is better at what
Maths, coding, reasoning and the rest — one line each, averaged over the benchmarks both models actually report.
| Category | Claude Haiku 4.5 | Gemini 2.5 Flash | Better at this |
|---|---|---|---|
| ReasoningGPQA Diamond | 73.0% | 78.3% | Gemini 2.5 Flash+5.3 |
| MathsAIME 2025 | 77.0% | 78.0% | Gemini 2.5 Flash+1.0 |
| CodingOnly one model reports this | — | — | Not comparable |
| KnowledgeNeither model reports this | — | — | Not comparable |
| MultimodalOnly one model reports this | — | — | Not comparable |
| Instruction followingNeither model reports this | — | — | Not comparable |
| Human preferenceOnly one model reports this | — | — | Not comparable |
| Categories wonOut of 2 comparable | 0 | 2 | Gemini 2.5 Flash |
Each category averages only the benchmarks every model here reports, so no one is credited for a test the other did not run. A category with no shared test is marked Not comparable rather than guessed at.
Side by side
Claude Haiku 4.5 and Gemini 2.5 Flash, row by row
| Attribute | Claude Haiku 4.5Anthropic | Gemini 2.5 FlashGoogle DeepMind |
|---|---|---|
| Specification | ||
| MakerWho built it | Anthropic | Google DeepMind |
| Released | 2025-10 | 2025-04 |
| Context windowHow much can go in at once | 200,000 tokens | 1,048,576 tokens |
| Max output | 64,000 tokens | 65,536 tokens |
| Input | Text, Image | Text, Image, Audio, Video |
| ReasoningSpends extra tokens thinking before it answers | Yes | Yes |
| Tool calling | Yes | Yes |
| Knowledge cutoff | 2025-02 | 2025-01 |
| Licence | Proprietary | Proprietary |
| Open weightsCan you download and run it yourself | No | No |
| Price | ||
| Input priceUSD per million tokens in | $1.00 | $0.30 |
| Output priceUSD per million tokens out | $5.00 | $2.50 |
| Cached input | $0.10 | $0.075 |
| Blended 3:1A 3-in-to-1-out million-token mix — a fairer single number than input price alone | $2.00 | $0.85Cheapest |
| Published benchmarks | ||
| GPQA Diamond198 graduate-level physics, chemistry and biology questions written to be Google-proof. PhD holders in the matching field score about 65%. | ||
| AIME 2025The American Invitational Mathematics Examination — 15 problems, integer answers, no partial credit. A standard test of multi-step maths reasoning. | ||
| SWE-bench Verified500 human-validated GitHub issues from real Python repositories. The model must produce a patch that makes the project's own tests pass. | Not reported | |
| MMMUCollege-level questions that require reading charts, diagrams, tables and photographs alongside the text. | Not reported | |
| LMArena EloElo rating from blind pairwise votes by the public on LMArena. Measures what people prefer, not what is correct. | Not reported | |
| Links | Full page | Full page |
| Row verified | 2026-08 | 2026-08 |
Where these numbers come from
Every score on this page is a published figure, taken from the model's own card, system card, technical report or release post, or from a public leaderboard. CorX Labs did not run these evaluations. Most are self-reported by the lab that built the model, which means they were produced under that lab's own choice of prompt, scaffold and number of attempts — so treat them as a starting point for a shortlist, not as a settled ranking.
A score someone other than the model's maker measured is marked Independent and names its measurer. Those are the stronger numbers on this page — an outside harness has no reason to flatter anyone — and there are not many of them.
Where a figure has not been published, the cell reads Not reported rather than an estimate. Nothing here is inferred, interpolated or guessed. Each model records the month its row was last checked. Full method and caveats.
Questions
Claude Haiku 4.5 or Gemini 2.5 Flash?
Is Claude Haiku 4.5 better than Gemini 2.5 Flash?
Gemini 2.5 Flash wins 2 of the 2 benchmarks both models report, Claude Haiku 4.5 wins 0, consistently. The average gap across shared tests is 3.1 points.
Which is cheaper, Claude Haiku 4.5 or Gemini 2.5 Flash?
On a 3:1 input-to-output mix, Gemini 2.5 Flash costs $0.85 per million tokens against $2.00 for Claude Haiku 4.5 — about 2.4× less. Remember that a reasoning model bills its thinking as output, so cost per answer can diverge much further than cost per token.
What is the difference between Claude Haiku 4.5 and Gemini 2.5 Flash?
Gemini 2.5 Flash takes 1M tokens of context against 200K — 5.2× more room for long documents or a large codebase.
