Anannas

Trace Anannas AI gateway (500+ models) calls in Muster via the OpenAI-compatible API.

Anannas is a unified inference gateway providing access to 500+ models through an OpenAI-compatible API. Trace its calls in Muster via the OpenAI wrapper.

Setup

pip install langfuse openai

import os

os.environ["LANGFUSE_PUBLIC_KEY"] = "pk-lf-..."
os.environ["LANGFUSE_SECRET_KEY"] = "sk-lf-..."
os.environ["LANGFUSE_BASE_URL"] = "https://app.getmuster.io"
os.environ["ANANNAS_API_KEY"] = "<YOUR_ANANNAS_API_KEY>"

from langfuse.openai import openai

client = openai.OpenAI(
    api_key=os.environ["ANANNAS_API_KEY"],
    base_url="https://api.anannas.ai/v1",
)

response = client.chat.completions.create(
    model="anthropic/claude-3-5-sonnet",
    messages=[
        {"role": "system", "content": "You are helpful."},
        {"role": "user", "content": "Tell me a fact."},
    ],
    name="fun-fact-request",
)

Anannas

Setup

See also

On this page