Compare models
Comparing 2models. Drop the URL into a doc — it's permalinked.
| Field | mistral/mistral-large-latest | anthropic/claude-3-5-sonnet-20241022 |
|---|---|---|
| Provider | mistral | anthropic |
| Model ID | mistral-large-latest | claude-3-5-sonnet-20241022 |
| Context | 128K | 200K |
| Max output | 33K | 8K |
| Input / 1M | $2.00 | $3.00 |
| Output / 1M | $6.00 | $15.00 |
| Cached input / 1M | — | $0.30 |
| Avg cost / 1M | $4.00 | $9.00 |
| Speed | 50 t/s | 80 t/s |
| Quality index | 60.0 | 70.0 |
| MMLU | 84.0 | 88.7 |
| GPQA | 48.0 | 65.0 |
| HumanEval | 84.0 | 92.0 |
| MATH | 71.5 | 78.3 |
| SWE-bench | — | — |
| Arena Elo | — | — |
| Tools | ✓ | ✓ |
| Vision | — | ✓ |
| Thinking | — | — |
| Streaming | ✓ | ✓ |
| JSON mode | ✓ | — |
| Structured output | ✓ | — |
| Prompt cache | — | ✓ |
Same data, in your terminal: relay models compare mistral-large anthropic/claude-3-5-sonnet-20241022