BerriAI/litellm
#34 of 803 by Stars among GitHub repos
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
About
Open Source AI Gateway for 100+ LLMs. Self-hosted. Enterprise-ready. Call any LLM in OpenAI format.
LiteLLM is an open source AI Gateway that gives you a single, unified interface to call 100+ LLM providers — OpenAI, Anthropic, Gemini, Bedrock, Azure, and more — using the OpenAI format.
Use it as a Python SDK for direct library integration, or deploy the AI Gateway (Proxy Server) as a centralized service for your team or organization.
Jump to LiteLLM Proxy (LLM Gateway) Docs Jump to Supported LLM Providers
Managing LLM calls across providers gets complicated fast — different SDKs, auth patterns, request formats, and error types for every model. LiteLLM removes that friction:
LLMs -…
Excerpted from github.com/BerriAI/litellm
Latest metrics
| Stars | 58.5k | 2026-09-12 |
|---|---|---|
| Forks | 11.4k | 2026-09-12 |
| Commits | 48.6k | 2026-09-12 |
| Releases | 1.0k | 2026-09-12 |
| Watchers | 233 | 2026-09-12 |
| Open issues | 1.7k | 2026-09-12 |
| Open PRs | 3.3k | 2026-09-12 |