About LiteLLM
LiteLLM is an open-source, self-hosted AI gateway rather than a hosted model subscription. Its proxy gives applications a unified interface for more than 100 model providers and supports virtual keys, budgets, rate limits, spend tracking, routing, fallbacks, logging, and metrics. The open-source gateway is free to self-host in production. Enterprise adds commercial governance, security, deployment, and support capabilities including SSO and SCIM, OIDC or JWT authentication, audit logs, secret-manager integration and key rotation, organization administration, multi-region control-plane capabilities, air-gapped deployment options, and support with SLAs. LiteLLM Enterprise is quoted annually according to gateway request capacity, deployment architecture, and support needs; LiteLLM states that this license is not priced per token. The model-provider API charges and the customer's own infrastructure costs remain separate from LiteLLM's $0 open-source license.
✅ Best For
Engineering teams unifying several LLM providers behind one APITeams that need keys, budgets, rate limits, routing, fallbacks, and model-spend visibilityOrganizations deploying an internal or self-hosted AI gatewayPlatform teams standardizing access across OpenAI, Anthropic, Bedrock, Vertex AI, Azure, local models, and compatible endpointsRegulated or large organizations needing enterprise identity, audit, air-gapped, or support requirements