Compare models
Comparing 2models. Drop the URL into a doc — it's permalinked.
| Field | anthropic/claude-3-5-haiku-20241022 | mistral/mistral-large-latest |
|---|---|---|
| Provider | anthropic | mistral |
| Model ID | claude-3-5-haiku-20241022 | mistral-large-latest |
| Context | 200K | 128K |
| Max output | 8K | 33K |
| Input / 1M | $0.80 | $2.00 |
| Output / 1M | $4.00 | $6.00 |
| Cached input / 1M | — | — |
| Avg cost / 1M | $2.40 | $4.00 |
| Speed | — | 50 t/s |
| Quality index | — | 60.0 |
| MMLU | — | 84.0 |
| GPQA | — | 48.0 |
| HumanEval | — | 84.0 |
| MATH | — | 71.5 |
| SWE-bench | — | — |
| Arena Elo | — | — |
| Tools | ✓ | ✓ |
| Vision | — | — |
| Thinking | — | — |
| Streaming | ✓ | ✓ |
| JSON mode | — | ✓ |
| Structured output | — | ✓ |
| Prompt cache | ✓ | — |
Same data, in your terminal: relay models compare anthropic/claude-3-5-haiku-20241022 mistral-large