mistral/mixtral-8x22b-instruct
$2.00
Input / 1M
$6.00
Output / 1M
66K
Context
—
Speed
Capabilities
json_modetools
Use mixtral-8x22b-instruct via Relay
Configure the model alias in YAML, then call it from Python.
YAML
# models.yaml
version: 1
models:
mixtral:
target: mistral/mixtral-8x22b-instruct
credential: $env.MISTRAL_API_KEYPython
from relay import Hub
async with Hub.from_yaml("models.yaml") as hub:
resp = await hub.chat(
"mixtral",
messages=[{"role": "user", "content": "Hello"}],
)
print(resp.text, resp.cost_usd)pip install ai5labs-relay · full docs on GitHub