Commit Graph
4817 Commits
Author SHA1 Message Date
Krrish Dholakia abcd7cf54f build(auth.py): adding email / magic link based login for proxy ui 2023-12-23 15:30:05 +05:30
Krrish Dholakia 39a722bc9b fix(test_azure_perf.py): fix linting 2023-12-23 13:25:00 +05:30
Krrish Dholakia 05f8d11346 test(test_azure_perf.py): add perf testing for azure router streaming 2023-12-23 13:20:19 +05:30
Krrish Dholakia b4b4a7d43a Revert "test(test_azure_perf.py): add perf testing for router streaming"
This reverts commit 4fa7f19888.
2023-12-23 13:19:07 +05:30
Krrish Dholakia 4fa7f19888 test(test_azure_perf.py): add perf testing for router streaming 2023-12-23 13:16:49 +05:30
Krrish Dholakia 49932ac90a test: skip flaky tests 2023-12-23 12:37:38 +05:30
Krrish Dholakia e620d2f219 fix(utils.py): log user_id to langfuse 2023-12-23 12:14:09 +05:30
Krish DholakiaandGitHub 2df5ce4b7c Merge pull request #1182 from sumanth13131/usage-based-routing-fix
usage_based_routing_fix
2023-12-23 11:50:34 +05:30
Krish DholakiaandGitHub d195787db7 Merge pull request #1183 from maxdeichmann/improve-langchain-integration
Improve langfuse integration
2023-12-23 11:47:36 +05:30
Krish DholakiaandGitHub 710c809478 Merge pull request #1195 from AllentDan/fix-routing
fix least_busy router by updating min_traffic
2023-12-23 11:45:35 +05:30
Krish DholakiaandGitHub 03fd5da5ae Merge pull request #1203 from Manouchehri/bedrock-cloudflare-ai-gateway-1
Add aws_bedrock_runtime_endpoint support
2023-12-23 11:44:04 +05:30
Krish DholakiaandGitHub 8afdc12918 Merge pull request #1211 from sihyeonn/fix/sh-success-callback
fix: success_callback logic for cost_tracking
2023-12-23 11:41:30 +05:30
Krish DholakiaandGitHub 81617534b6 Merge pull request #1213 from neubig/vertex_chat_generate_content
Make vertex ai work with generate_content
2023-12-23 11:40:43 +05:30
Krrish Dholakia 79a79b16e1 bump: version 1.15.6 → 1.15.7 2023-12-23 10:03:49 +05:30
Krrish Dholakia 43f4096014 fix(langsmith.py): fix langsmith streaming logging 2023-12-23 10:02:35 +05:30
Krrish Dholakia c568bb6cac docs(virtual_keys.md): add budget manager docs to proxy 2023-12-23 09:48:53 +05:30
Krrish Dholakia 89ee9fe400 fix(proxy_server.py): manage budget at user-level not key-level
https://github.com/BerriAI/litellm/issues/1220
2023-12-22 15:10:38 +05:30
Krrish Dholakia 979575a2a6 fix(proxy_server.py): handle misformatted json body in chat completion request 2023-12-22 12:30:36 +05:30
Krrish Dholakia 1e526c7e06 bump: version 1.15.5 → 1.15.6 2023-12-22 12:24:20 +05:30
Krrish Dholakia f1270a7c78 fix(utils.py): handle ollama yielding a dict 2023-12-22 12:23:42 +05:30
Krrish Dholakia eb2d13e2fb test(test_completion.py-+-test_streaming.py): add ollama endpoint to ci/cd pipeline 2023-12-22 12:21:33 +05:30
Krrish Dholakia 57607f111a fix(ollama.py): use litellm.request timeout for async call timeout 2023-12-22 11:22:24 +05:30
Krrish Dholakia 6ade2c74b5 bump: version 1.15.4 → 1.15.5 2023-12-22 11:08:54 +05:30
Krrish Dholakia 278f61f3ed fix(utils.py): handle 'os.environ/' being passed in as kwargs 2023-12-22 11:08:44 +05:30
Max DeichmannandGitHub 1c68f5557d Merge branch 'main' into improve-langchain-integration 2023-12-21 23:50:01 +01:00
Max Deichmann 61cf9b1f19 first commit 2023-12-21 23:49:33 +01:00
Krrish Dholakia d87e59db25 bump: version 1.15.3 → 1.15.4 2023-12-21 21:20:23 +05:30
Graham NeubigandGitHub 2362544344 Update the request_str 2023-12-21 09:58:06 -05:00
Krrish Dholakia 1a32228da5 feat(proxy_server.py): support max budget on proxy 2023-12-21 16:07:20 +05:30
Krrish Dholakia 14115d0d60 feat(proxy_server.py): add new images/generation endpoint 2023-12-21 15:39:09 +05:30
Krrish Dholakia 8101ad6801 bump: version 1.15.2 → 1.15.3 2023-12-21 14:39:29 +05:30
Krrish Dholakia be68796eba fix(router.py): add support for async image generation endpoints 2023-12-21 14:38:44 +05:30
Krrish Dholakia a4aa645cf6 bump: version 1.15.1 → 1.15.2 2023-12-21 13:23:00 +05:30
Krrish Dholakia 81078c4004 fix(proxy/utils.py): jsonify object before db writes 2023-12-21 13:03:14 +05:30
Sihyeon Jang 4f41c3c513 fix: success_callback logic for cost_tracking
Signed-off-by: Sihyeon Jang <uneedsihyeon@gmail.com>
2023-12-21 16:09:59 +09:00
Krrish Dholakia 812f9ca1b3 fix(azure.py): correctly raise async exceptions 2023-12-21 12:23:07 +05:30
Krrish Dholakia 87fca1808a test(test_amazing_vertex_completion.py): fix project name 2023-12-21 12:14:34 +05:30
Krish DholakiaandGitHub 5edc987209 Merge pull request #1199 from neubig/add_safety_settings_default
Add a default for safety settings in vertex AI
2023-12-21 09:07:23 +05:30
Krrish Dholakia 97f6475035 docs(health.md): add docs on health checks for embedding models 2023-12-21 07:54:04 +05:30
ishaan-jaff f6407aaf74 (docs) add metadata keys/generate 2023-12-21 07:43:53 +05:30
ishaan-jaff fbab7371dc (docs) proxy - virtual keys 2023-12-21 07:36:32 +05:30
Ishaan JaffandGitHub d54de58e31 Merge pull request #1197 from Rested/main
docker build and push on release
2023-12-21 07:28:17 +05:30
ishaan-jaff 3e5cfee1f4 (ci/cd) run again 2023-12-21 07:25:22 +05:30
ishaan-jaff b701a356cc (fix) vertex ai auth file 2023-12-21 07:22:25 +05:30
Krrish Dholakia 6795f0447a fix(utils.py): fix non_default_param pop error for ollama 2023-12-21 06:59:13 +05:30
David Manouchehri 93c4556eb0 Add aws_bedrock_runtime_endpoint support. 2023-12-20 19:31:43 -05:00
Graham Neubig 6e9267ca66 Make vertex_chat work with generate_content 2023-12-20 15:32:44 -05:00
Graham Neubig 482b3b5bc3 Add a default for safety settings in vertex AI 2023-12-20 13:12:50 -05:00
Krrish Dholakia 04bbd0649f fix(router.py): only do sync image gen fallbacks for now
The customhttptransport we use for dall-e-2 only works for sync httpx calls, not async. Will need to spend some time writing the async version

n
2023-12-20 19:10:59 +05:30
Reuben Thomas-Davis fe4427907d 🗑️ remove unused docker workflow for clarity 2023-12-20 12:41:23 +00:00