LLM API / Gateway

Optionally, you can configure Langfuse to use an external LLM API or gateway for add-on features. Langfuse tracing does not need access to the LLM API as traces are captured client-side.

Supported LLM APIs

Langfuse supports:

• OpenAI
• Azure OpenAI
• Anthropic
• Google Vertex
• Amazon Bedrock

Via the OpenAI API, many other LLM services and proxies can be used.

Features powered by LLM API

• Playground
• LLM-as-a-Judge Evaluation
• Prompt Experiments

If you experience any issues when self-hosting Langfuse, please:

1. Check out Troubleshooting & FAQ page.
2. Use Ask AI to get instant answers to your questions.
3. Ask the maintainers on GitHub Discussions.
4. Create a bug report or feature request on GitHub.

---

---