Musterby Elitery
Integrations

Vercel AI Gateway

Trace Vercel AI Gateway calls in Muster via the Muster OpenAI wrapper.

Vercel AI Gateway exposes a unified OpenAI-compatible API in front of multiple AI providers, with budgeting, monitoring, and load balancing. Trace its calls in Muster via the OpenAI wrapper.

Python setup

from langfuse.openai import openai

client = openai.OpenAI(
    base_url="https://ai-gateway.vercel.sh/v1",
)

response = client.chat.completions.create(
    model="anthropic/claude-4-sonnet",
    messages=[{"role": "user", "content": "Your prompt"}],
    name="generation-name",
)

TypeScript setup

import { observeOpenAI } from "@langfuse/openai";
import OpenAI from "openai";

const openaiClient = new OpenAI({
  baseURL: "https://ai-gateway.vercel.sh/v1",
});

const client = observeOpenAI(openaiClient);

const response = await client.chat.completions.create({
  model: "anthropic/claude-4-sonnet",
  messages: [{ role: "user", content: "Your prompt" }],
});

See also