meta-llama/llama-3-8b-instruct

$0.03

Input / 1M

$0.04

Output / 1M

Context

—

Speed

Capabilities

json_modetools

Use llama-3-8b-instruct via Relay

Configure the model alias in YAML, then call it from Python.

YAML

# models.yaml
version: 1
models:
  llama:
    target: meta-llama/llama-3-8b-instruct
    credential: $env.META-LLAMA_API_KEY

Python

from relay import Hub

async with Hub.from_yaml("models.yaml") as hub:
    resp = await hub.chat(
        "llama",
        messages=[{"role": "user", "content": "Hello"}],
    )
    print(resp.text, resp.cost_usd)

pip install ai5labs-relay · full docs on GitHub

Compare with

vs groq/llama-3.3-70b-versatile vs anthropic/claude-haiku-4-5 vs mistral/mistral-large-latest vs openai/gpt-4o-mini