Commit Graph
11811 Commits
Author SHA1 Message Date
Krrish Dholakia bc3c06bc74 docs(call_hooks.md): update docs 2024-05-20 12:45:03 -07:00
Krrish Dholakia b41f30ca60 fix(proxy_server.py): fixes for making rejected responses work with streaming 2024-05-20 12:32:19 -07:00
Krrish Dholakia f11f207ae6 feat(proxy_server.py): refactor returning rejected message, to work with error logging
log the rejected request as a failed call to langfuse/slack alerting
2024-05-20 11:14:36 -07:00
Krrish Dholakia 372323c38a feat(proxy_server.py): allow admin to return rejected response as string to user
Closes https://github.com/BerriAI/litellm/issues/3671
2024-05-20 10:30:23 -07:00
Krrish Dholakia dbaeb8ff53 bump: version 1.37.16 → 1.37.17 v1.37.17 2024-05-20 09:47:03 -07:00
Krish DholakiaandGitHub 626e556e70 Merge pull request #3737 from BerriAI/litellm_json_logs
feat(proxy_cli.py): support json logs on proxy
2024-05-20 09:46:37 -07:00
Krrish Dholakia 89ad1ce9b5 docs(debugging.md): add json logs to proxy docs 2024-05-20 09:29:30 -07:00
Krrish Dholakia 52acd3955d fix(_logging.py): support all logs being in json mode, if enabled 2024-05-20 09:22:59 -07:00
Krrish Dholakia 058bfb101d feat(proxy_cli.py): support json logs on proxy
allow user to enable 'json logs' for proxy server
2024-05-20 09:18:12 -07:00
Krrish Dholakia 25df95ab10 feat(proxy_server.py): new 'supported_openai_params' endpoint
get supported openai params for a given model
2024-05-20 08:39:50 -07:00
Krish DholakiaandGitHub bb85a5e6b2 Merge pull request #3729 from BerriAI/litellm_vertex_history
fix(vertex_ai.py): support passing in result of tool call to vertex
2024-05-20 07:33:05 -07:00
Krrish Dholakia 49b71c8118 fix(vertex_ai.py): revert system instructions - unable to find supported vertex version 2024-05-20 06:30:11 -07:00
Krrish Dholakia 45c46a84d0 fix(vertex_ai.py): support passing system instructions to vertex ai 2024-05-20 06:18:19 -07:00
Krrish Dholakia 6216c3639f fix(types/vertex_ai.py): fix typing 2024-05-19 12:36:05 -07:00
Krish DholakiaandGitHub c94ce069f7 Merge pull request #3724 from BerriAI/litellm_gpt_4_response_format_drop_params
fix(utils.py): drop response_format if 'drop_params=True' for gpt-4
2024-05-19 12:35:13 -07:00
Krrish Dholakia 65aacc0c1a fix(vertex_ai.py): use chat_messages_with_history for async + streaming calls 2024-05-19 12:30:24 -07:00
Krrish Dholakia f9ab72841a fix(vertex_ai.py): passing all tests on 'test_amazing_vertex_completion.py 2024-05-19 12:22:21 -07:00
Krrish Dholakia a2c66ed4fb fix(vertex_ai.py): support passing in result of tool call to vertex
Fixes https://github.com/BerriAI/litellm/issues/3709
2024-05-19 11:34:07 -07:00
Krish DholakiaandGitHub 35c48c7c24 Update README.md 2024-05-18 19:06:09 -07:00
Krrish Dholakia 12942c39db fix(utils.py): drop response_format if 'drop_params=True' for gpt-4 2024-05-18 13:02:48 -07:00
Krish DholakiaandGitHub a43cfa1770 Update README.md 2024-05-18 12:58:22 -07:00
Krish DholakiaandGitHub 8d25a7b9dc Merge pull request #3715 from BerriAI/litellm_model_id_fix
fix(proxy_server.py): fix setting model id for db models
v1.37.16-stable v1.37.16
2024-05-17 22:36:23 -07:00
Krish DholakiaandGitHub 5e5179e476 Merge branch 'main' into litellm_model_id_fix 2024-05-17 22:36:17 -07:00
Krrish Dholakia 5d3fe52a08 test: fix test 2024-05-17 22:35:34 -07:00
Krrish Dholakia 1cecdc4690 fix(utils.py): fix replicate completion cost calculation 2024-05-17 22:18:57 -07:00
Ishaan Jaff c8a1cf6ce2 (ci/cd) run again 2024-05-17 22:07:21 -07:00
Ishaan Jaff 7af7610929 fix - test num callbacks 2024-05-17 22:06:51 -07:00
Krrish Dholakia a75b865ebc test(test_config.py): fix test 2024-05-17 22:00:44 -07:00
Ishaan Jaff 25920a7396 bump: version 1.37.15 → 1.37.16 2024-05-17 21:58:30 -07:00
Ishaan Jaff 6708a1adaa ui - new build 2024-05-17 21:58:10 -07:00
Ishaan JaffandGitHub 60b9bc2764 Merge pull request #3714 from BerriAI/litellm_show_max_input_tokens_ui
[Admin UI] show max input tokens on  UI
2024-05-17 21:55:35 -07:00
Ishaan JaffandGitHub 8281c150f0 Merge pull request #3713 from BerriAI/litellm_ui_infer_azure_prefix
[Feat] Admin UI - use `base_model` for Slack Alerts
2024-05-17 21:55:23 -07:00
Krrish Dholakia 4b3551abfc fix(slack_alerting.py): show langfuse traces on error messages 2024-05-17 18:42:30 -07:00
Krish DholakiaandGitHub 2695989e49 Merge pull request #3708 from BerriAI/litellm_bedrock_anthropic_fix
fix(bedrock_httpx.py): move anthropic bedrock calls to httpx
2024-05-17 17:47:44 -07:00
Krish DholakiaandGitHub 3a06fe2818 Merge branch 'main' into litellm_bedrock_anthropic_fix 2024-05-17 17:47:32 -07:00
Krrish Dholakia b137cea230 fix(proxy_server.py): fix setting model id for db models
get model_id and use that as it's id in router, this enables `/model/delete` to work with the given id from `/model/info`
2024-05-17 17:45:05 -07:00
Ishaan Jaff 7add1ef42e ui - show max input tokens 2024-05-17 17:18:20 -07:00
Krrish Dholakia 4682802444 fix(bedrock_httpx.py): raise better timeout exception 2024-05-17 17:16:36 -07:00
Ishaan Jaff 04648ee368 fix - enter base_model on azure 2024-05-17 17:02:01 -07:00
Krrish Dholakia b486bb1f8b fix(utils.py): exception map bedrock error 2024-05-17 16:18:25 -07:00
Krrish Dholakia 5d24a72b7e fix(bedrock_httpx.py): support mapping for bedrock cohere command r text 2024-05-17 16:13:49 -07:00
Ishaan Jaff be273b3c3b fix - show correct base_model in slack alerts 2024-05-17 16:07:02 -07:00
Krrish Dholakia afd2d73b33 bump: version 1.37.14 → 1.37.15 2024-05-17 15:49:55 -07:00
Krrish Dholakia 29a26af298 fix(litellm_license.py): fix json handling 2024-05-17 15:48:39 -07:00
Krrish Dholakia a8d7ce3657 docs(enterprise.md): cleanup docs 2024-05-17 15:34:50 -07:00
Krrish Dholakia 604a867f90 docs(proxy/enterprise.md): update enterprise docs 2024-05-17 15:34:00 -07:00
Krrish Dholakia b723e608f6 docs(enterprise.md): add swagger - custom routes + branding to docs 2024-05-17 15:31:02 -07:00
Krrish Dholakia c0d62e94ae feat(proxy_server.py): enable custom branding + routes on openapi docs
Allows user to add their branding + show only openai routes on docs
2024-05-17 15:21:29 -07:00
Ishaan JaffandGitHub f1a482f358 Merge pull request #3710 from BerriAI/litellm_fix_llm_utils_auth
fix - allow non master key to access llm_utils_routes
2024-05-17 13:52:22 -07:00
Ishaan Jaff cae5ecea8e fix llm utils routes 2024-05-17 08:41:46 -07:00