GitHub Trending · Platforms, Data & Apps · Updated
BerriAI/litellm
Open-source AI gateway for 100+ LLMs, Rust core with Python SDK
- Stars
- ★ 60.7k
- Language
- Python
- Chart appearances
- 2
- On-chart tracking
- 1 days tracked
What it does
LiteLLM is an open-source AI gateway that lets you call 100+ LLM APIs in OpenAI or native format. It ships with cost tracking, guardrails, load balancing, and logging, and is self-hostable and enterprise-ready.
What's inside
The repo provides both a Python SDK (the litellm package) and the LiteLLM Proxy Server (AI gateway), plus Terraform deployment examples for AWS, GCP, and other clouds.
Tech stack
Python is the primary language, with a Rust core for the gateway to stay fast and light; distributed via PyPI and deployable on Render, Railway, AWS, and GCP.
Use cases
- AI app developers who need unified access to multiple LLMs with cost control
- Platform teams wanting a self-hosted gateway with load balancing and logging
- Engineering leads rolling out guardrails, quotas, and cost governance in enterprises
Why it's trending
With 60,669 stars and 95 added today, it ranks 7th on GitHub Trending daily, reflecting surging demand for multi-model access and unified gateways.
Current chart placements
| Period | Language filter | Rank | Stars gained |
|---|---|---|---|
| Daily | All languages | #7 | +95 |
| Daily | Python | #2 | +95 |
Editorial summaries are based on the public repository and the dated GitHub Trending snapshot. Verify implementation details in the upstream repository.