Compare models
Comparing 2models. Drop the URL into a doc — it's permalinked.
| Field | google/gemma-3-27b-it | anthropic/claude-haiku-4-5 |
|---|---|---|
| Provider | anthropic | |
| Model ID | gemma-3-27b-it | claude-haiku-4-5 |
| Context | 131K | 200K |
| Max output | — | 8K |
| Input / 1M | $0.08 | $1.00 |
| Output / 1M | $0.16 | $5.00 |
| Cached input / 1M | — | $0.10 |
| Avg cost / 1M | $0.12 | $3.00 |
| Speed | — | 165 t/s |
| Quality index | — | 60.0 |
| MMLU | — | 81.2 |
| GPQA | — | 50.1 |
| HumanEval | — | 78.3 |
| MATH | — | 76.5 |
| SWE-bench | — | — |
| Arena Elo | — | — |
| Tools | ✓ | ✓ |
| Vision | ✓ | ✓ |
| Thinking | — | — |
| Streaming | — | ✓ |
| JSON mode | ✓ | — |
| Structured output | — | ✓ |
| Prompt cache | — | ✓ |
Same data, in your terminal: relay models compare google/gemma-3-27b-it haiku-4.5