Compare models
Comparing 2models. Drop the URL into a doc — it's permalinked.
| Field | together/meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo | openai/gpt-4o-mini |
|---|---|---|
| Provider | together | openai |
| Model ID | meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo | gpt-4o-mini |
| Context | 131K | 128K |
| Max output | — | 16K |
| Input / 1M | $3.50 | $0.15 |
| Output / 1M | $3.50 | $0.60 |
| Cached input / 1M | — | $0.07 |
| Avg cost / 1M | $3.50 | $0.38 |
| Speed | — | 145 t/s |
| Quality index | — | 60.0 |
| MMLU | — | 82.0 |
| GPQA | — | 40.2 |
| HumanEval | — | 87.2 |
| MATH | — | 70.2 |
| SWE-bench | — | — |
| Arena Elo | — | — |
| Tools | ✓ | ✓ |
| Vision | — | ✓ |
| Thinking | — | — |
| Streaming | ✓ | ✓ |
| JSON mode | — | ✓ |
| Structured output | — | ✓ |
| Prompt cache | — | — |
Same data, in your terminal: relay models compare together/meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo 4o-mini