R
Relayby Ai5labs
← Back to all models

alpindale/goliath-120b

$3.75
Input / 1M
$7.50
Output / 1M
6K
Context
Speed

Capabilities

json_mode

Use goliath-120b via Relay

Configure the model alias in YAML, then call it from Python.

YAML
# models.yaml
version: 1
models:
  goliath:
    target: alpindale/goliath-120b
    credential: $env.ALPINDALE_API_KEY
Python
from relay import Hub

async with Hub.from_yaml("models.yaml") as hub:
    resp = await hub.chat(
        "goliath",
        messages=[{"role": "user", "content": "Hello"}],
    )
    print(resp.text, resp.cost_usd)

pip install ai5labs-relay · full docs on GitHub

Compare with