Integrations

Fireworks AI

Trace Fireworks AI calls in Muster via the OpenAI-compatible API.

Fireworks AI hosts open-weights models behind an OpenAI-compatible endpoint. Trace them in Muster by pointing the Muster OpenAI wrapper at Fireworks' base URL.

Setup

%pip install langfuse openai --upgrade

import os

os.environ["LANGFUSE_PUBLIC_KEY"] = "pk-lf-..."
os.environ["LANGFUSE_SECRET_KEY"] = "sk-lf-..."
os.environ["LANGFUSE_BASE_URL"] = "https://app.getmuster.io"
os.environ["FIREWORKS_AI_API_KEY"] = "..."

from langfuse.openai import OpenAI

client = OpenAI(
    base_url="https://api.fireworks.ai/inference/v1",
    api_key=os.environ["FIREWORKS_AI_API_KEY"],
)

response = client.chat.completions.create(
    model="accounts/fireworks/models/llama-v3p1-8b-instruct",
    messages=[{"role": "user", "content": "Hello!"}],
)
print(response.choices[0].message.content)

Fireworks AI

Setup

See also

On this page