Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
ai-gateway
anthropic
azure-openai
bedrock
cost-tracking
litellm
llm
llmops
openai
openai-compatible
proxy-server
python
sdk
self-hosted
vertex-ai
Updated 2026-07-15 04:36:34 +00:00