Commit Graph
13586 Commits
Author SHA1 Message Date
Krrish Dholakia 5e893ed13e fix(utils.py): Fix anthropic tool calling exception mapping
Fixes https://github.com/BerriAI/litellm/issues/4348
2024-06-21 21:20:49 -07:00
Krrish Dholakia 44bd9548d9 docs(anthropic.md): update with correct model string 2024-06-21 21:16:07 -07:00
Krrish Dholakia 000d678445 fix(utils.py): improve coverage for anthropic exception mapping 2024-06-21 21:15:10 -07:00
Ishaan Jaff 24addd8a4f fix test test_router_completion_streaming 2024-06-21 21:02:34 -07:00
Ishaan Jaff b4d95e740e fix get_logging_payload v1.40.22 2024-06-21 20:42:28 -07:00
Ishaan JaffandGitHub 4cd1171abb Merge pull request #4350 from CaseMark/print-content-fallback
Print content window fallbacks on startup to help verify configuration
2024-06-21 20:01:22 -07:00
Steven Osborn 0ab6a18516 Print content window fallbacks on startup to help verify configuration 2024-06-21 19:43:26 -07:00
Ishaan Jaff 98c131e1e9 bump: version 1.40.21 → 1.40.22 2024-06-21 18:12:12 -07:00
Ishaan Jaff 662cb5a5ec ui - new build 2024-06-21 18:12:12 -07:00
Ishaan JaffandGitHub 6b63b663b9 Merge pull request #4345 from BerriAI/litellm_fix_cost_tracking_tags
[Fix + Test] -  Spend tags not getting stored on 1.40.9
2024-06-21 17:34:27 -07:00
Krrish Dholakia 06b297a6e8 fix(router.py): fix set_client init to check if custom_llm_provider is azure not if in model name
fixes issue where 'azure_ai/' was being init as azureopenai client
2024-06-21 17:09:20 -07:00
Ishaan Jaff fff928b10b fix testing spend_tracking 2024-06-21 16:52:42 -07:00
Ishaan Jaff 29c2155796 fix cost tracking by tags 2024-06-21 16:49:57 -07:00
Ishaan JaffandGitHub c0540e764d Merge pull request #4342 from BerriAI/litellm_fix_moderations
fix - liteLLM proxy /moderations endpoint returns 500 error when model is not specified
2024-06-21 16:19:22 -07:00
Ishaan Jaff 4e795dad81 fix ContentPolicyViolationError mapping 2024-06-21 16:11:42 -07:00
Ishaan Jaff 8fcd61825b test - /moderations 2024-06-21 16:08:52 -07:00
Ishaan Jaff eb8a9b2654 fix - /moderation don't require a model 2024-06-21 16:00:43 -07:00
Ishaan JaffandGitHub cc11cedf02 Merge pull request #4340 from BerriAI/litellm_show_cache_hit_stats
[Feat] Admin UI - Show Cache hit stats
2024-06-21 15:34:11 -07:00
Ishaan Jaff 07f34ac256 ui - show cache hits 2024-06-21 15:26:30 -07:00
Ishaan Jaff 097474502a ui - fix linting errors 2024-06-21 15:00:26 -07:00
Krrish Dholakia 941574a921 fix(proxy/utils.py): fix add langfuse trace id to alert
Fixing the import after refactor
2024-06-21 14:55:09 -07:00
Ishaan Jaff 35c07306df show correct key aliases on ui 2024-06-21 14:36:38 -07:00
Ishaan Jaff e0a2717a19 ui - filter by selected date time 2024-06-21 14:36:28 -07:00
Krrish Dholakia 5912decd19 fix(proxy/utils.py): fix bool on check 2024-06-21 14:29:38 -07:00
Ishaan Jaff d30cdd82cc move caching up on left nav 2024-06-21 14:28:15 -07:00
Ishaan Jaff b91854bdbb ui - show leading cache indicators 2024-06-21 13:43:47 -07:00
Ishaan Jaff 829ac3a0d0 ui - add new cache hits page 2024-06-21 13:10:40 -07:00
Ishaan Jaff 10e88a939d backend - new endpoint to show cache hit stats 2024-06-21 13:08:54 -07:00
Krish DholakiaandGitHub 88c550e3b7 Merge pull request #4337 from spdustin/main
fix: use per-token costs for claude via vertex_ai
2024-06-21 11:45:19 -07:00
spdustin@gmail.com 4acc2d50ad fix: use per-token costs for claude via vertex_ai 2024-06-21 11:21:36 -05:00
Krrish Dholakia 04fed2171c fix(vertex_httpx.py): cleanup docstring v1.40.21 2024-06-21 09:11:11 -07:00
Krrish Dholakia 16941eee43 fix(utils.py): re-integrate separate gemini optional param mapping (google ai studio)
Fixes https://github.com/BerriAI/litellm/issues/4333
2024-06-21 09:01:32 -07:00
Krrish Dholakia d2b4d1f7ed bump: version 1.40.20 → 1.40.21 2024-06-21 08:28:43 -07:00
Krrish Dholakia fdb7101aaf fix(utils.py): add extra body params for text completion calls 2024-06-21 08:28:38 -07:00
Ishaan Jaff 12f4fb3a42 fix refactor - add batches endpoints proxy server.py 2024-06-21 07:55:53 -07:00
Krish DholakiaandGitHub 361e47882b Merge pull request #4121 from friendliai/feat/friendliai
feat: friendli ai support
2024-06-20 22:17:41 -07:00
Ishaan Jaff e23b56fe16 ci/cd run again 2024-06-20 21:58:17 -07:00
Ishaan Jaff 0efd94cfca ci/cd run again 2024-06-20 21:47:48 -07:00
Krrish Dholakia 97d33324df test: trigger new build v1.40.20 2024-06-20 21:42:42 -07:00
Krrish Dholakia 086d3b2877 ci(config.yml): fix testing 2024-06-20 21:39:28 -07:00
Krrish Dholakia dfd5882c31 fix(vertex_httpx.py): allow passing extra headers
Closes https://github.com/BerriAI/litellm/pull/4327
2024-06-20 21:14:44 -07:00
Ishaan Jaff 3a510582c2 fix test_litellm_proxy_server_config_no_general_settings 2024-06-20 21:11:30 -07:00
Ishaan JaffandGitHub 558c00931e Merge pull request #4322 from BerriAI/litellm_bug_fix_spend_tracking
[Fix]  user field and user_api_key_* is sometimes omitted randomly
2024-06-20 21:10:13 -07:00
Ishaan Jaff f2677620fd test_call_with_end_user_over_budget 2024-06-20 21:08:06 -07:00
Krrish Dholakia cd73ea245a test(test_lowest_latency_routing.py): use mock responses 2024-06-20 21:05:23 -07:00
Krrish Dholakia e96326a211 docs(input.md): update docs with parallel_tool_calls 2024-06-20 21:01:49 -07:00
Krrish Dholakia 5ff74f90ad bump: version 1.40.19 → 1.40.20 2024-06-20 20:54:29 -07:00
Krish DholakiaandGitHub e7e7b0e265 Merge pull request #4328 from BerriAI/litellm_proxy_testing
test(test_python_38.py): add coverage for non-gen settings config.yaml flow
2024-06-20 20:46:46 -07:00
Krrish Dholakia 46da517cdf test(test_python_38.py): add longer delay 2024-06-20 20:42:32 -07:00
Krrish Dholakia 9b5aa90bb7 test(test_python_38.py): add relevant installs 2024-06-20 20:39:59 -07:00