LiteLLM

Unified AI Gateway for 100+ LLM providers — cost tracking, load balancing, unified API

Unified gateway/proxy for accessing 100+ LLM providers (39K+ ⭐). Call OpenAI, Anthropic, Google, Azure, AWS Bedrock, Ollama... through a single API format. Built-in cost tracking per request, load...