Databricks

Databricks Mosaic AI Model Serving hosts foundation models behind a Databricks-managed endpoint. Connect it to Muster for tracing, evaluation, and prompt management.

Setup

1. Create a serving endpoint in Databricks for your model of choice.
2. Add the model in Muster — go to Project Settings → Models and add the Databricks endpoint URL plus the access token.
3. Use the model in the Muster Playground, prompt experiments, and LLM-as-a-judge evaluators.

For programmatic tracing of Databricks endpoints, use one of the framework integrations (LangChain, LlamaIndex, LiteLLM) or the OpenAI-compatible endpoint with the Muster OpenAI wrapper.

See also

• Upstream Langfuse Databricks docs
• Amazon Bedrock