tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-21 02:23:59 +00:00
Code Issues Packages Projects Releases Wiki Activity
1 Commit 2,072 Branches 1,425 Tags
918a286e122ffef6dadbd4eafbc9aab765930c8f
T
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Ishaan JaffandGitHub 918a286e12 Initial commit
2023-07-26 17:09:52 -07:00
LICENSE
Initial commit
2023-07-26 17:09:52 -07:00
README.md
Initial commit
2023-07-26 17:09:52 -07:00

README.md

litellm

Reference in New Issue View Git Blame Copy Permalink
S
Description
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
ai-gatewayanthropicazure-openaibedrockcost-trackinglitellmllmllmopsopenaiopenai-compatibleproxy-serverpythonsdkself-hostedvertex-ai
Readme MIT
1.1 GiB
Languages
Python 81%
TypeScript 12.2%
JavaScript 5.9%
HTML 0.5%
HCL 0.2%