Home / Tools / LiteLLM

LiteLLM

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM] open source

Visit LiteLLM ↗ GitHub ↗

Where it ranks

Pricing

Open source proxy/SDK; enterprise tier available.
Source: https://github.com/BerriAI/litellm, checked 2026-10-19

Public signals

GitHub stars61.6ksource
Forks12.5k
Last pushOct 19, 2026
7-day star changeunknown (needs 7 days of snapshots)
Latest stable releasev1.106.0 Oct 18, 2026
Hacker News, last 30 days2 stories, 3 points · top: How LiteLLM Lens finds repeated failures across 1,000s of agent tracesquery

Matched by story title “litellm”. Title matches can include unrelated stories.

Recent releases

Alternatives

OpenRouter