BerriAI/litellm

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

https://github.com/BerriAI/litellm ↗

Category: General

★ 53.8k · forks 9.8k · watchers 214 · open issues 4.0k

License: NOASSERTION · Default: litellm_internal_staging · Topics: ai-gateway, anthropic, azure-openai, bedrock, gateway, langchain, litellm, llm, llm-gateway, llmops, mcp-gateway, openai, openai-proxy, rust, rust-ai, vertex-ai

github · ai-gateway · 0 reviews · updated 19 days ago

Critics score

—

Audience score

—

Scores hidden until this repo has at least 5 reviews.

Wiki, Report & Thread

Wiki page · AI Report (premium) · Discussion thread

Your review

Recent reviews

No reviews yet. Sign in to be the first to review this repo.