litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails
⭐ 36,461
Stars
🍴 0
Forks
🐛 0
Issues
🕐 n/a
Last commit
💻 $ pip install litellmPython SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails
⭐ 36,461
Stars
🍴 0
Forks
🐛 0
Issues
🕐 n/a
Last commit
💻 $ pip install litellmPython SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
Language
Python
License
Unknown
Category
AI / LLM
Quality Score
9/10
Stars
36.5k
Last Active
Unknown
You might also like