Commit Graph
11302 Commits
Author SHA1 Message Date
Ishaan Jaff eaccafd42b bump: version 1.34.7 → 1.34.8 v1.34.8 2024-03-27 21:30:16 -07:00
Ishaan JaffandGitHub c3f78af2c6 Merge pull request #2728 from BerriAI/litellm_reduce_deep_copies
[FEAT] Proxy - reduce deep copies
2024-03-27 21:26:09 -07:00
Ishaan Jaff 29fb7e126f Revert "(fix) remove deep copy for all requests"
This reverts commit 0737fdb348.
2024-03-27 21:15:12 -07:00
Krrish Dholakia 526aa9230f docs(call_hooks.md): show result in docs 2024-03-27 21:04:51 -07:00
Krrish Dholakia e6b929fff3 docs(call_hooks.md): show admin how to enforce user param 2024-03-27 20:58:26 -07:00
Ishaan Jaff 37f189935a (fix) show user their role when rejecting /team/new requests 2024-03-27 20:54:07 -07:00
Ishaan JaffandGitHub 4777921a31 Merge pull request #2723 from BerriAI/litellm_proxy_perf_imp
[FEAT] Improve Proxy Perf - access router model names in constant time
2024-03-27 20:48:31 -07:00
Ishaan Jaff f2e1d938f3 (fix) remove deep copy from all responses 2024-03-27 20:36:53 -07:00
Ishaan Jaff 0737fdb348 (fix) remove deep copy for all requests 2024-03-27 20:35:45 -07:00
Krrish Dholakia 9ef7afd2b4 test(test_completion.py): skip unresponsive endpoint 2024-03-27 20:12:22 -07:00
Krrish Dholakia 2926d5a8eb fix(proxy/utils.py): check cache before alerting user 2024-03-27 20:09:15 -07:00
Krrish Dholakia 34790c7e12 fix(proxy_server.py): fix linting error 2024-03-27 19:54:25 -07:00
Krrish Dholakia ad43138f28 fix(proxy_server.py): fix budget add logic to accurately log who created it 2024-03-27 19:43:15 -07:00
Krish DholakiaandGitHub 75f2b9dd73 Merge pull request #2725 from BerriAI/litellm_calculate_spend
feat(proxy_server.py): new `/spend/calculate` endpoint
2024-03-27 19:39:07 -07:00
Krish DholakiaandGitHub ef51544741 Merge pull request #2726 from BerriAI/litellm_enforce_user_param
feat(auth_checks.py): enable admin to enforce 'user' param for all openai endpoints
2024-03-27 19:38:52 -07:00
Ishaan JaffandGitHub e81eb1bd11 Merge pull request #2721 from BerriAI/litellm_remove_background_tasks
(fix) Proxy - remove background tasks
2024-03-27 19:32:56 -07:00
Krish Dholakia 848b0ba67f Updated config.yml 2024-03-27 19:23:33 -07:00
Krish Dholakia 5bd136e650 Updated config.yml 2024-03-27 19:23:08 -07:00
Ishaan Jaff 31383b18cb (fix) cost tracking 2024-03-27 19:18:39 -07:00
Ishaan Jaff 0c69c05c54 (fix) google pip install pyarrow dep 2024-03-27 19:14:25 -07:00
Ishaan Jaff 73db5b45f8 (ci/cd) run again 2024-03-27 19:04:07 -07:00
Ishaan Jaff d1fa22f9ed (fix) ci/cd google deps 2024-03-27 19:00:52 -07:00
Krrish Dholakia 4eb93832e4 feat(auth_checks.py): enable admin to enforce 'user' param for all openai endpoints 2024-03-27 17:36:27 -07:00
Krrish Dholakia 9d0ce1aefd feat(proxy_server.py): new /spend/calculate endpoint
Allows user to calculate spend before making the call
2024-03-27 17:08:55 -07:00
Krrish Dholakia a408c46a67 fix(proxy_server.py): don't auto-create user when creating key 2024-03-27 16:48:57 -07:00
Ishaan Jaff e4e4dd01cd (fix) access router model names in constant time 2024-03-27 16:18:08 -07:00
Krrish Dholakia 1e856443e1 feat(proxy/utils.py): enable updating db in a separate server 2024-03-27 16:02:36 -07:00
Ishaan Jaff c97724df7d (fix) remove background tasks 2024-03-27 15:51:00 -07:00
Ishaan JaffandGitHub 93597b7ba0 Merge pull request #2719 from BerriAI/litellm_bump_uvicorn
(fix) bump uvicorn on proxy docker builds
2024-03-27 15:49:58 -07:00
onukura f86472518d Add a feature to ollama aembedding to accept batch input 2024-03-27 21:39:19 +00:00
Ishaan Jaff da835ad10a (fix) bump uvicorn on proxy docker builds 2024-03-27 14:35:17 -07:00
Krrish Dholakia 9b7383ac67 fix(utils.py): don't run post-call rules on a coroutine function 2024-03-27 13:16:27 -07:00
Krrish Dholakia d08da5b05a docs(instructor.md): improve default example 2024-03-27 12:51:05 -07:00
Krrish Dholakia 62a591f90c bump: version 1.34.6 → 1.34.7 2024-03-27 10:15:28 -07:00
Krrish Dholakia 6c34e48180 feat(index.ts): initial commit for proxy edge worker
testing to see if a js worker improves proxy perf (and by how much)
2024-03-27 10:15:20 -07:00
Krish DholakiaandGitHub d259c754ef Merge pull request #2701 from rmann-nflx/main
Updating the default Claude3 max tokens
2024-03-27 10:14:20 -07:00
Krish DholakiaandGitHub b6be1ecb37 Merge pull request #2714 from readevalprint/patch-1
Fix #2713 Remove duplicated "blocked" field on LiteLLM_TeamTable
2024-03-27 10:13:56 -07:00
TimandGitHub d939755a73 Remove duplicated "blocked" field on LiteLLM_TeamTable 2024-03-27 17:02:18 +01:00
Andrea Ponti 25bacfacdc Add trace_name in langfuse logging v2 2024-03-27 16:58:08 +01:00
Krrish Dholakia 90b859ebcb docs(token_auth.md): cleanup docs v1.34.6 2024-03-26 21:42:07 -07:00
Krrish Dholakia 282176c502 docs(token_auth.md): update docs 2024-03-26 21:41:08 -07:00
Krrish Dholakia ca84e7a8e8 docs(token_auth.md): update jwt auth docs with new info 2024-03-26 21:33:03 -07:00
Krrish Dholakia 1d054c3e71 bump: version 1.34.5 → 1.34.6 2024-03-26 21:19:07 -07:00
Krrish Dholakia 9375b131ee refactor(main.py): trigger new build 2024-03-26 21:18:51 -07:00
Krrish Dholakia b204f0c01c fix(proxy_cli.py): fix circular import issue 2024-03-26 21:16:41 -07:00
Krish DholakiaandGitHub c1f8d346b8 Merge pull request #2706 from BerriAI/litellm_key_llm_guardrails
feat(llm_guard.py): enable key-specific llm guard check
v1.34.5
2024-03-26 19:02:11 -07:00
Krish DholakiaandGitHub e266142d2b Merge pull request #2705 from BerriAI/litellm_permissions_table
enable new `/team/disable` endpoint
2024-03-26 18:47:34 -07:00
Krrish Dholakia 4488480188 test(test_llm_guard.py): fix test 2024-03-26 18:37:27 -07:00
Krrish Dholakia f62f642393 test(test_llm_guard.py): fix test 2024-03-26 18:13:15 -07:00
Krrish Dholakia 5b66cb3864 test(test_exceptions.py): handle api instability 2024-03-26 18:06:49 -07:00