CorX Labs

Claude 3.5 Haiku

by Anthropic · United States
ProprietaryTool calling200K context

A fast, cheap Claude that matched the previous generation's flagship on code.


Specification

The numbers

Maker
Anthropic
Released
2024-11
Parameters
Not reported
Architecture
Not reported
Context window
200,000 tokens
Max output
8,192 tokens
Input
Text
Output
Text
Reasoning
No
Tool calling
Yes
Knowledge cutoff
2024-07
Licence
Proprietary
Availability
Not reported
Weights
Not released

Cost

Price per million tokens

Input
$0.80 / M tokens
Output
$4.00 / M tokens
Blended 3:1
$1.60

Standard first-party API rate, excluding batch discounts. Reasoning models bill thinking tokens as output, so cost per answer can far exceed the cost per token suggests.

Published scores

Benchmarks

Figures published by Anthropic or taken from a public leaderboard. Row last checked 2026-08.

Claude 3.5 Haiku by capability category, with its rank among models reporting the same tests.
CategoryScore Rank
ReasoningGPQA Diamond41.6%80 of 83 reporting the same tests
MathsCompetition mathematics, graded on the final answerNot reported
CodingSWE-bench Verified, HumanEval64.3%2 of 2 reporting the same tests
KnowledgeMMLU-Pro65.0%36 of 77 reporting the same tests
MultimodalReading charts, diagrams and photographsNot reported
Instruction followingObeying an exact, checkable formatNot reported
Human preferenceWhich answer people pick, blindNot reported

A category averages every benchmark in it that Claude 3.5 Haiku reports. The rank counts only models that report the same tests, so it never compares an average over three benchmarks against an average over one.

Every reported test

MMLU-ProKnowledge65%Rank 36 of 77 models reporting
GPQA DiamondReasoning41.6%Rank 80 of 83 models reporting
AIME 2025MathsNot reportedNo figure published
MATH-500MathsNot reportedNo figure published
SWE-bench VerifiedCoding40.6%Rank 32 of 33 models reporting
SWE-bench ProCodingNot reportedNo figure published
Terminal-Bench 2.1CodingNot reportedNo figure published
Frontier-Bench v0.1ReasoningNot reportedNo figure published
Terminal-Bench 4.0CodingNot reportedNo figure published
LiveCodeBenchCodingNot reportedNo figure published
HumanEvalCoding88.1%Rank 15 of 46 models reporting
MMMUMultimodalNot reportedNo figure published
IFEvalInstruction followingNot reportedNo figure published
LMArena EloHuman preferenceNot reportedNo figure published

Where these numbers come from

Every score on this page is a published figure, taken from the model's own card, system card, technical report or release post, or from a public leaderboard. CorX Labs did not run these evaluations. Most are self-reported by the lab that built the model, which means they were produced under that lab's own choice of prompt, scaffold and number of attempts — so treat them as a starting point for a shortlist, not as a settled ranking.

A score someone other than the model's maker measured is marked Independent and names its measurer. Those are the stronger numbers on this page — an outside harness has no reason to flatter anyone — and there are not many of them.

Where a figure has not been published, the cell reads Not reported rather than an estimate. Nothing here is inferred, interpolated or guessed. Each model records the month its row was last checked. Full method and caveats.

Same maker

Other models from Anthropic

AI models with context window, price per million tokens and published benchmark scores. Sortable by any column.
Claude Fable 5.1AnthropicAnthropic1M$10.00$50.00Proprietary
Claude Mythos 5.1AnthropicAnthropic1M$10.00$50.00Proprietary
Claude Opus 5AnthropicAnthropic1M$5.00$25.00Proprietary
Claude Sonnet 5AnthropicAnthropic1M$2.00$10.00Proprietary
Claude Fable 5AnthropicAnthropic1M$10.00$50.00Proprietary
Claude Mythos 5AnthropicAnthropic1M$10.00$50.00Proprietary
Claude Opus 4.5AnthropicAnthropic200K$5.00$25.0087%96%80.9%Proprietary
Claude Haiku 4.5AnthropicAnthropic200K$1.00$5.0073%77%73.3%Proprietary
Claude Sonnet 4.5AnthropicAnthropic1M$3.00$15.0083.4%87%77.2%Proprietary
Claude Opus 4.1AnthropicAnthropic200K$15.00$75.0080.9%78%74.5%Proprietary
Claude Sonnet 4AnthropicAnthropic200K$3.00$15.0075.4%70.5%72.7%Proprietary
Claude 3.7 SonnetAnthropicAnthropic200K$3.00$15.0068%61.3%62.3%Proprietary
Claude 3.5 SonnetAnthropicAnthropic200K$3.00$15.0078%65%49%Proprietary
Claude 3 OpusAnthropicAnthropic200K$15.00$75.0068.5%50.4%Proprietary