tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-29 00:20:55 +00:00
Code Issues Packages Projects Releases Wiki Activity
4,297 Commits 2,072 Branches 1,425 Tags
fa8ba9dd4ec8dcf2a8649beedb437afd524bc09f
Commit Graph
4297 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
ishaan-jaff fa8ba9dd4e (test) cache + streaming 2023-12-08 11:50:37 -08:00
ishaan-jaff 6e8ad10991 (feat) caching - streaming caching support 2023-12-08 11:50:37 -08:00
ishaan-jaff 9b0afbe2cb (fix) bug - caching: gen cache key in order 2023-12-08 11:50:37 -08:00
Krrish Dholakia 5a9b58b2bb bump: version 1.12.0 → 1.12.1 2023-12-08 11:41:14 -08:00
Krrish Dholakia 7aec95ed7c feat(proxy_server.py): add sentry logging for db read/writes 2023-12-08 11:40:19 -08:00
Krrish Dholakia 4e6a8d09d0 fix(proxy/utils.py): tracking db failed writes 2023-12-08 10:40:02 -08:00
Krrish Dholakia 1b35736797 fix(utils.py): fix cost calculation to handle tool input 2023-12-08 09:53:46 -08:00
Krrish Dholakia 9494c2cd9e fix(requirements.txt): add ollama async_generator in requirements.txt 2023-12-08 09:20:04 -08:00
Krrish Dholakia 2ede903f0b docs: fix imports 2023-12-08 07:39:13 -08:00
Krrish Dholakia d548836903 docs: add proxy req/s 2023-12-08 07:33:33 -08:00
Krrish Dholakia 0406e01c6d docs(deploy.md): add proxy perf to docs 2023-12-08 07:32:23 -08:00
Krrish Dholakia 2f1c5aa0c7 fix: setting cache responses on proxy 2023-12-07 20:39:40 -08:00
Krrish Dholakia f5afc429b3 fix(proxy_server.py): add call hooks pre+post completion and embedding calls 2023-12-07 20:35:32 -08:00
Krrish Dholakia dfba305508 test: test_router.py 
fix router testing

n
 2023-12-07 20:10:36 -08:00
Krrish Dholakia a350b80d28 bump: version 1.11.1 → 1.12.0 2023-12-07 19:40:23 -08:00
Krrish Dholakia 9cf3051ea2 feat(proxy_server.py): enable background health checks 2023-12-07 19:40:06 -08:00
ishaan-jaff b8b15435b7 (test) undo fd04b48 2023-12-07 18:38:51 -08:00
ishaan-jaff f99e3a3818 (fix) undo commit fd04b48 2023-12-07 18:37:06 -08:00
ishaan-jaff 3f4fe668a8 (ci/cd) vertex ai test 2023-12-07 18:20:58 -08:00
ishaan-jaff fd04b48764 (feat) async callbacks with litellm.completion() 2023-12-07 18:09:57 -08:00
ishaan-jaff 762f28e4d7 (fix) make print_verbose non blocking 2023-12-07 17:31:32 -08:00
ishaan-jaff 2da50087b0 (fix) logging - better prints for async logger 2023-12-07 17:31:32 -08:00
Krrish Dholakia 4c0e95aec9 test: fix proxy custom logger test 2023-12-07 15:19:11 -08:00
Krrish Dholakia 91ce50338a fix(_redis.py): check if string before checking os.environ 2023-12-07 15:08:11 -08:00
Krrish Dholakia b92f1af301 test: cleaning up local testing 2023-12-07 14:20:14 -08:00
Krrish Dholakia 3846ec6124 fix(utils.py): fix get_llm_provider to handle the ':' in anthropic/bedrock calls 2023-12-07 14:19:11 -08:00
Krrish Dholakia 2b04dc310a test: skip local proxy test in circle ci 2023-12-07 13:56:23 -08:00
ishaan-jaff f236dae79d (test) async logger + proxy 2023-12-07 13:54:27 -08:00
ishaan-jaff 5ddfaa33f3 (feat) proxy - async logger class + embeddings 2023-12-07 13:54:08 -08:00
Krrish Dholakia e5638e2c5d fix(router.py): fix default caching response value 2023-12-07 13:44:31 -08:00
ishaan-jaff 418099085c (test) proxy - async logger, strict check async_success 2023-12-07 13:44:17 -08:00
ishaan-jaff 2bc583c2a6 (test) proxy - async custom logger 2023-12-07 13:19:17 -08:00
ishaan-jaff 0354d6d48f (ci/cd) vertex test 2023-12-07 12:41:39 -08:00
Krrish Dholakia 7585b58d2d docs: sagemaker embedding model added to docs 2023-12-07 11:42:51 -08:00
ishaan-jaff 19f1035f5a (ci/cd) vertex ai testing 2023-12-07 11:36:20 -08:00
Krrish Dholakia db12ca4ecb docs(bedrock.md): add cohere embeddings to bedrock docs 2023-12-07 11:35:08 -08:00
Krrish Dholakia 2134285523 docs(quick_start.md): adding gunicorn worker script to docs 2023-12-07 11:31:54 -08:00
Krrish Dholakia d77e0cc716 docs(config.md): adding docs on parallel request rate limiting 2023-12-07 11:27:48 -08:00
ishaan-jaff 077f6b1298 (ci/cd) vertex ai 2023-12-07 11:19:29 -08:00
ishaan-jaff 90d474ff21 (ci/cd) vertex ai 2023-12-07 10:50:58 -08:00
ishaan-jaff 85668ff415 (ci/cd) vertex ai 2023-12-07 10:44:45 -08:00
ishaan-jaff 8dd6786123 (ci/cd) vertex ai 2023-12-07 10:39:24 -08:00
ishaan-jaff 0f8225c3eb (ci/cd) use relative path for vertex 2023-12-07 10:38:06 -08:00
ishaan-jaff 378f211a29 (ci/cd) debugging 2023-12-07 10:36:58 -08:00
ishaan-jaff 01c7dc197a (ci/cd) vertex ai 2023-12-07 10:31:32 -08:00
ishaan-jaff a2b89b212c (ci/cd) pip install google-cloud-aiplatform 2023-12-07 10:30:29 -08:00
ishaan-jaff f32e55780a (ci/cd) add google-cloud-aiplatform v1.11.1 2023-12-07 10:21:09 -08:00
ishaan-jaff e823e8d99e (test) add vertex ai to ci/cd 2023-12-07 10:20:21 -08:00
ishaan-jaff d2eee342fb (feat) vertex ai - better debugging 2023-12-07 09:38:37 -08:00
ishaan-jaff e9d93c624c (fix) vertex ai - streaming chunks 2023-12-07 09:38:37 -08:00