Commit Graph
16256 Commits
Author SHA1 Message Date
Ishaan Jaff d1eedb04bd prometheus log_success_fallback_event 2024-08-10 14:05:18 -07:00
Ishaan Jaff 2a54be4a43 feat - log fallbacks events on prometheus 2024-08-10 13:57:25 -07:00
Ishaan Jaff 0238ab077d v0 track fallback events 2024-08-10 13:31:00 -07:00
Ishaan Jaff 45186718aa v0 add event handlers for logging fallback events 2024-08-10 13:28:08 -07:00
Ishaan Jaff dc0559226a v0 add helper for loging success/fail fallback events 2024-08-10 13:26:39 -07:00
Ishaan Jaff 51ce8ba301 test for prom metrics 2024-08-10 12:56:23 -07:00
Ishaan Jaff 01f5456e3d feat - track latency per llm deployment 2024-08-10 12:53:56 -07:00
Ishaan Jaff 83446926af track llm_deployment_success_responses 2024-08-10 10:05:33 -07:00
Ishaan Jaff 2174801cb0 prometheus add basic testing for success 2024-08-10 09:45:12 -07:00
Ishaan Jaff ce9af1e1df refactor prometheus to be a customLogger class 2024-08-10 09:28:46 -07:00
Ishaan Jaff 20ef72194c use customLogger for prometheus logger 2024-08-10 09:15:23 -07:00
Ishaan Jaff 05fba48cec feat - refactor prometheus metrics 2024-08-10 09:14:38 -07:00
Krrish Dholakia f4355d3e88 bump: version 1.43.5 → 1.43.6 v1.43.6 v1.43.6-stable 2024-08-09 20:41:48 -07:00
Krish DholakiaandGitHub e1a8e6c394 Merge pull request #5145 from BerriAI/litellm_fix_stream_options_logging
fix(litellm_logging.py): fix calling success callback w/ stream_options true
2024-08-09 20:30:19 -07:00
Krish DholakiaandGitHub a42164fa79 Merge pull request #5143 from BerriAI/litellm_use_max_retries
fix(utils.py): set max_retries = num_retries, if given
2024-08-09 20:29:49 -07:00
Ishaan Jaff 4c4ccaff66 fix _hidden_params is None case v1.43.5 v1.43.5-stable 2024-08-09 19:17:11 -07:00
Ishaan Jaff 3320d76dd4 ci/cd run again 2024-08-09 19:13:52 -07:00
Ishaan Jaff a1fe1d2042 fix linting error 2024-08-09 18:47:23 -07:00
Krrish Dholakia a26b23a3f4 fix(litellm_logging.py): fix calling success callback w/ stream_options true
Fixes https://github.com/BerriAI/litellm/issues/5118
2024-08-09 18:20:42 -07:00
Ishaan Jaff 0acc6efa8f docs clean sidebar 2024-08-09 18:09:11 -07:00
Ishaan Jaff 4c08d1a21d docs migration policy 2024-08-09 18:06:37 -07:00
Ishaan JaffandGitHub 4ec1df799c Merge pull request #5144 from BerriAI/litellm_bedrock_put_modified_tool_Call_name_in_output
[Fix] Place bedrock modified tool call name in output
2024-08-09 18:04:30 -07:00
Ishaan Jaff 09000d4b66 docs add migration policy 2024-08-09 18:03:37 -07:00
Ishaan Jaff d445f3967d correctly add modified tool names to cache 2024-08-09 17:39:49 -07:00
Ishaan Jaff 42617c207a test bedrock tool call names 2024-08-09 17:14:56 -07:00
Ishaan Jaff 43ff70348d init bedrock_tool_name_mappings 2024-08-09 17:09:19 -07:00
Krrish Dholakia dd3d97ace6 test(test_optional_params.py): use num_retries instead of 'max_retries' if given 2024-08-09 17:02:29 -07:00
Krrish Dholakia a858cc4d0c docs(main.py): clarify 'num_retries' usage 2024-08-09 16:57:06 -07:00
Krrish Dholakia ba7b070883 fix(utils.py): set max_retries = num_retries, if given 2024-08-09 16:54:54 -07:00
Krrish Dholakia 9f0a05d406 fix(utils.py): only return non-null default values 2024-08-09 16:34:59 -07:00
Ishaan JaffandGitHub 3548a55277 Merge pull request #5139 from BerriAI/litellm_log_vertex_metadata_as_spans
[Feat-Langfuse] log VertexAI Grounding Metadata as Spans
2024-08-09 14:52:59 -07:00
Ishaan JaffandGitHub 2fa73acf32 Merge pull request #5138 from BerriAI/litellm_bedrock_tool_calling
Feat - Translate openai function names to bedrock converse schema
2024-08-09 14:52:40 -07:00
Ishaan Jaff 3e2a1fe0aa log provider specific metadata as a span 2024-08-09 14:32:02 -07:00
Ishaan Jaff 6dc9b39095 test invalid tool namehandling 2024-08-09 13:26:21 -07:00
Ishaan Jaff 8b98193a51 bedrock make_valid_bedrock_tool_name 2024-08-09 13:16:38 -07:00
Krrish Dholakia 177f670c7d build(test_completion.py): ci/cd run again v1.43.4.dev5 2024-08-09 12:28:26 -07:00
Ishaan Jaff 2f8db40cab ui new build 2024-08-09 12:26:24 -07:00
Krrish Dholakia 6180c52cfe fix(router.py): fix types 2024-08-09 12:24:48 -07:00
Ishaan JaffandGitHub db7897dcc0 Merge pull request #5136 from BerriAI/litellm_add_cohere_embedding_models
ui allow adding cohere models
2024-08-09 12:19:19 -07:00
Ishaan JaffandGitHub f260c1a043 Merge pull request #5134 from BerriAI/litellm_refactor_promt
[Feat] v2 prometheus deployment outage, healthy, partial outage alerting
2024-08-09 12:18:40 -07:00
Krrish Dholakia 7b6db63d30 fix(router.py): fallback on 400-status code requests 2024-08-09 12:16:49 -07:00
Ishaan Jaff 05a4555fe7 ui add cohere embedding models 2024-08-09 12:11:02 -07:00
Ishaan Jaff e734568b5a fix cohere / cohere_chat when timeout is None 2024-08-09 12:10:02 -07:00
Ishaan Jaff df024fbbbc add testing for cohere embeddings 2024-08-09 12:08:25 -07:00
Ishaan JaffandGitHub f8b0118ecd Merge pull request #5137 from BerriAI/litellm_add_cohere_embedding_model_pricing
[Feat] Add pricing for cohere embedding models
2024-08-09 11:32:40 -07:00
Ishaan Jaff 9b5693a5a2 ui allow adding cohere models 2024-08-09 11:30:34 -07:00
Ishaan Jaff c8997e3986 add cohere embed-multilingual-v2.0 2024-08-09 11:30:07 -07:00
Krrish Dholakia 0cf81eba62 fix(huggingface_restapi.py): support passing 'wait_for_model' param on completion calls 2024-08-09 09:25:19 -07:00
Krrish Dholakia 466dc9f32a fix(huggingface_restapi.py): fix hf embeddings optional param processing 2024-08-09 09:10:56 -07:00
Ishaan Jaff fc9086759d docs prometheus metrics 2024-08-09 09:07:31 -07:00