LiteLLM

LiteLLM

LiteLLM is an open-source LLM Gateway designed to unify API calls for over 100 large language models into a single OpenAI-compatible format.

FreeWebPythonDockerOpen sourceMultimodal
Visit websitelitellm.ai
Compare with book-to-skillExplore LiteLLM alternatives

Overview

LiteLLM is an open-source LLM Gateway designed to unify API calls for over 100 large language models into a single OpenAI-compatible format. Key features include comprehensive spend tracking with budget controls, automated LLM fallbacks for reliability, and load balancing across providers. It enables platform teams to efficiently manage developer access and ensure observability. The solution offers a free open-source version, alongside an Enterprise tier with custom SLAs and advanced security features like SSO and audit logs.

Key features

  • Unified API for 100+ LLMs
  • Spend tracking and budgets
  • LLM fallbacks and load balancing

Pricing

FreeStarting price: Open source (free)
View pricing page

Verified on:

Use cases

  • Managing LLM access across providers
  • Tracking spend and setting budgets
  • Implementing LLM fallbacks

Who it is for

Platform teamsDevelopers

Integrations

OpenAIClaudeGoogle GeminiAWS BedrockAzure OpenAIHugging FaceOllamaVertex AICohereReplicate

Tags

API

How we verified this

Company, pricing, and feature details come from the primary sources below and our latest verification pass. When sources disagree, the official source and the most recent check win.

Last verified 07/28/2026Verified sources: 1

Alternatives

Tools you can use instead