Commit Graph

20406 Commits

Author SHA1 Message Date
Krrish Dholakia b341b788a5 test: update testing 2025-03-17 22:34:08 -07:00
Krish Dholakia bcbb88d802 Merge pull request #9326 from andjsmi/main
Modify completion handler for SageMaker to use payload from `prepared_request`
2025-03-17 22:16:43 -07:00
Ishaan Jaff d42f84dd4e Merge pull request #9328 from BerriAI/litellm_control_internal_user_settings_ui
[UI] - Allow controlling default internal user settings on ui
2025-03-17 22:07:47 -07:00
Ishaan Jaff 7577146fe5 fix linting error 2025-03-17 22:07:36 -07:00
Ishaan Jaff e35aa444c3 show sso settings on ui 2025-03-17 22:00:33 -07:00
Ishaan Jaff 7a29c08f7b ui polish order of settings 2025-03-17 21:59:25 -07:00
Krish Dholakia cd5024f3b1 Merge pull request #9333 from BerriAI/litellm_dev_03_17_2025_p2
fix(ollama/completions/transformation.py): pass prompt, untemplated o…
2025-03-17 21:48:30 -07:00
Ishaan Jaff 5400615ce8 Merge pull request #9329 from BerriAI/litellm_fix_reset_budget_job
[Bug fix] Reset Budget Job
2025-03-17 21:46:08 -07:00
Ishaan Jaff e78adcdc8c fix settings endpoints code qa 2025-03-17 21:32:05 -07:00
Ishaan Jaff 39fc8bdcaf fix is_internal_user_role 2025-03-17 20:50:16 -07:00
Ishaan Jaff caf3050fa0 fix linting error 2025-03-17 20:37:20 -07:00
Krish Dholakia 27768a4866 Merge pull request #9330 from BerriAI/litellm_dev_03_17_2025_p1
Litellm dev 03 17 2025 p1
2025-03-17 19:57:25 -07:00
Ishaan Jaff fbace8d041 unit test reset budget job 2025-03-17 19:54:51 -07:00
Ishaan Jaff 09403e2097 use jsonify_team_object for updating teams 2025-03-17 19:42:04 -07:00
Ishaan Jaff 63a32ff02c test_reset_budget_job 2025-03-17 19:37:09 -07:00
Ishaan Jaff a9123d961d fix _reset_budget_for_team 2025-03-17 19:34:44 -07:00
Ishaan Jaff 91f4d4d865 fix _reset_budget_for_key/team/user 2025-03-17 18:56:24 -07:00
Krrish Dholakia 22faf7d232 fix(ollama/completions/transformation.py): pass prompt, untemplated on /completions request
Fixes https://github.com/BerriAI/litellm/issues/6900
2025-03-17 18:35:44 -07:00
Ishaan Jaff b4568762d2 update_internal_user_settings 2025-03-17 18:26:42 -07:00
Krrish Dholakia 359b8298f8 test(test_assemble_streaming_responses.py): update test to use correct type 2025-03-17 18:17:01 -07:00
Ishaan Jaff 8441f2f55c fix DefaultInternalUserParams 2025-03-17 18:13:15 -07:00
Ishaan Jaff 93e4a36300 DefaultInternalUserParams 2025-03-17 18:11:19 -07:00
Krrish Dholakia c4b2e0ae3d fix(streaming_handler.py): support logging complete streaming response on cache hit 2025-03-17 18:10:39 -07:00
Ishaan Jaff 5d8b288570 fix get_sso_settings 2025-03-17 18:06:09 -07:00
Ishaan Jaff 5e1e25d98d is_internal_user_role 2025-03-17 17:55:35 -07:00
Ishaan Jaff 8ff8ad82c9 DefaultInternalUserParams 2025-03-17 17:34:05 -07:00
Ishaan Jaff c2db7fb28b fix internal user sso settings 2025-03-17 17:31:31 -07:00
Ishaan Jaff ba7891d332 ui fix rendering budget duration settings on ui 2025-03-17 17:26:51 -07:00
Krrish Dholakia dd9e79adbd fix(streaming_handler.py): emit deep copy of completed chunk 2025-03-17 17:26:21 -07:00
Ishaan Jaff 30add0e64c update internal user settings on ui 2025-03-17 17:11:16 -07:00
Andrew Smith 1b2439cb82 Merge branch 'BerriAI:main' into main 2025-03-18 11:10:02 +11:00
Andrew Smith d5274efe62 Update test_sagemaker.py to match changed parameters 2025-03-18 11:09:52 +11:00
Andrew Smith 81a7cf0f44 Update handler.py to use prepared_request.body for input 2025-03-18 11:07:38 +11:00
Ishaan Jaff 508b474a1f update_internal_user_settings 2025-03-17 17:03:06 -07:00
Ishaan Jaff 02db6f9d86 fix display of settings 2025-03-17 16:56:49 -07:00
Krrish Dholakia 594d2ad433 docs(config_settings.md): document new env var 2025-03-17 16:55:32 -07:00
Krrish Dholakia 057c774c14 fix(http_handler.py): fix typing error 2025-03-17 16:42:32 -07:00
Krish Dholakia cf86ce3908 Merge pull request #9322 from BerriAI/litellm_dev_redis_ttl
fix(redis_cache.py): add 5s default timeout
2025-03-17 16:39:36 -07:00
Ishaan Jaff 2607676e3f UISSOSettings 2025-03-17 16:29:32 -07:00
Andrew Smith a92e99e946 Update handler.py to use prepared_request.body 2025-03-18 10:23:32 +11:00
Ishaan Jaff 0f44b33e0f ui sso settings 2025-03-17 15:54:41 -07:00
Ishaan Jaff 0771d49ea7 ui networking getSSOSettingsCall 2025-03-17 15:54:20 -07:00
Ishaan Jaff 0af0de8a96 model_dump() 2025-03-17 15:53:36 -07:00
Ishaan Jaff 401630833f add types for internal user settings 2025-03-17 15:52:01 -07:00
Krrish Dholakia 8e27b2026a fix(http_handler.py): support reading ssl security level from env var
Allows user to specify lower security settings
2025-03-17 15:48:31 -07:00
Krrish Dholakia 078e2d341b feat(cost_calculator.py): support reading litellm response cost header in client sdk
allows consistent cost tracking when sdk is calling proxy
2025-03-17 15:12:01 -07:00
Ishaan Jaff ce9ab69be2 add UISSOSettings 2025-03-17 15:09:54 -07:00
Krish Dholakia ce9b6f49bb Merge pull request #9317 from afspies/patch-1
Update prompt_caching.md to fix typo
2025-03-17 14:47:16 -07:00
Krrish Dholakia db92956ae3 fix(redis_cache.py): add 5s default timeout 2025-03-17 14:27:36 -07:00
Alex Spies c52514598f Update prompt_caching.md to fix typo
openai endpoint is presumably supposed to read `openai/` not `deepseek/` here. not yet at least :)
2025-03-17 17:16:51 +00:00