LiteLLM
Open sourceOne OpenAI-compatible gateway to 100+ LLM providers, with spend tracking you can self-host
Best for llm · gateway · proxy
Our own editorial score, not public reviews.
Strengths
- OpenAI-compatible proxy
- 100+ providers
Skip if
you need contracts, SSO, or a named vendor SLA
LiteLLM is an open-source AI gateway. Call 100+ LLM providers through one OpenAI-compatible API and cap spend — a pipeline, not a dashboard dump.
Key features
- OpenAI-compatible proxy
- 100+ providers
- Spend tracking
- Self-host or hosted
Why it is on Toolora
We list LiteLLM for people who need llm · gateway · proxy. Skip it if you need contracts, SSO, or a named vendor SLA.
Closest alternatives on Toolora: Helicone, Perplexity, Cerebras.
Try instead
CompareHelicone
AI gateway and observability to route, debug, and analyze LLM apps
AI ToolsAlso covers llm and gateway.
Also covers llm.
Cerebras
Wafer-scale chips for very fast LLM inference over an OpenAI-compatible API
AI ToolsAlso covers llm.
LiteLLM
Free / open source; Enterp…