Compare models
Comparing 2models. Drop the URL into a doc — it's permalinked.
| Field | anthropic/claude-3-5-sonnet-20241022 | google/gemini-2.5-flash |
|---|---|---|
| Provider | anthropic | |
| Model ID | claude-3-5-sonnet-20241022 | gemini-2.5-flash |
| Context | 200K | 1.0M |
| Max output | 8K | 8K |
| Input / 1M | $3.00 | $0.30 |
| Output / 1M | $15.00 | $2.50 |
| Cached input / 1M | $0.30 | $0.07 |
| Avg cost / 1M | $9.00 | $1.40 |
| Speed | 80 t/s | 250 t/s |
| Quality index | 70.0 | 70.0 |
| MMLU | 88.7 | 85.3 |
| GPQA | 65.0 | 65.2 |
| HumanEval | 92.0 | 88.1 |
| MATH | 78.3 | 88.0 |
| SWE-bench | — | — |
| Arena Elo | — | — |
| Tools | ✓ | ✓ |
| Vision | ✓ | ✓ |
| Thinking | — | ✓ |
| Streaming | ✓ | ✓ |
| JSON mode | — | ✓ |
| Structured output | — | ✓ |
| Prompt cache | ✓ | — |
Same data, in your terminal: relay models compare anthropic/claude-3-5-sonnet-20241022 gemini-flash