 Ishaan Jaff
|
ffb7f9f280
|
add fallback_reports as slack alert
|
2024-08-10 15:26:32 -07:00 |
|
|
Ishaan Jaff
|
e861d97bf2
|
bump: version 1.43.6 → 1.43.7
v1.43.7-stable
v1.43.7
v1.43.6.dev1
|
2024-08-10 14:11:14 -07:00 |
|
|
Ishaan Jaff
|
3bc39af1b9
|
Merge pull request #5153 from BerriAI/litellm_track_fallback_prometheus
Feat - Proxy track fallback metrics on prometheus
|
2024-08-10 14:10:42 -07:00 |
|
|
Ishaan Jaff
|
d1eedb04bd
|
prometheus log_success_fallback_event
|
2024-08-10 14:05:18 -07:00 |
|
|
Ishaan Jaff
|
2a54be4a43
|
feat - log fallbacks events on prometheus
|
2024-08-10 13:57:25 -07:00 |
|
|
Krrish Dholakia
|
0ea056971c
|
docs(prefix.md): add prefix support to docs
|
2024-08-10 13:55:47 -07:00 |
|
|
Ishaan Jaff
|
0238ab077d
|
v0 track fallback events
|
2024-08-10 13:31:00 -07:00 |
|
|
Ishaan Jaff
|
45186718aa
|
v0 add event handlers for logging fallback events
|
2024-08-10 13:28:08 -07:00 |
|
|
Ishaan Jaff
|
dc0559226a
|
v0 add helper for loging success/fail fallback events
|
2024-08-10 13:26:39 -07:00 |
|
|
Ishaan Jaff
|
d5abcb0945
|
Merge pull request #5152 from BerriAI/litellm_track_latency_prometheus
Feat - track response latency on prometheus
|
2024-08-10 13:02:10 -07:00 |
|
|
Krish Dholakia
|
b7e0620039
|
Merge pull request #5151 from BerriAI/litellm_streaming_chunks_safe_fail
fix(main.py): safely fail stream_chunk_builder calls
|
2024-08-10 13:02:02 -07:00 |
|
|
Ishaan Jaff
|
234b4a5fbf
|
Merge pull request #5149 from BerriAI/litellm_add_testing_for_prometheus_metrics
[Refactor+Testing] Refactor Prometheus metrics to use CustomLogger class + add testing for prometheus
|
2024-08-10 13:01:52 -07:00 |
|
|
Krrish Dholakia
|
f10970f1b1
|
docs(custom_llm_server.md): clarify what to use for modifying incoming/outgoing calls
|
2024-08-10 12:58:43 -07:00 |
|
|
Ishaan Jaff
|
51ce8ba301
|
test for prom metrics
|
2024-08-10 12:56:23 -07:00 |
|
|
Ishaan Jaff
|
01f5456e3d
|
feat - track latency per llm deployment
|
2024-08-10 12:53:56 -07:00 |
|
|
Krrish Dholakia
|
068ee12c30
|
fix(main.py): safely fail stream_chunk_builder calls
|
2024-08-10 10:22:26 -07:00 |
|
|
Ishaan Jaff
|
83446926af
|
track llm_deployment_success_responses
|
2024-08-10 10:05:33 -07:00 |
|
|
Krrish Dholakia
|
dd2ea72cb4
|
fix(openai.py): fix position of invalid_params param
|
2024-08-10 09:52:27 -07:00 |
|
|
Ishaan Jaff
|
2174801cb0
|
prometheus add basic testing for success
|
2024-08-10 09:45:12 -07:00 |
|
|
Ishaan Jaff
|
ce9af1e1df
|
refactor prometheus to be a customLogger class
|
2024-08-10 09:28:46 -07:00 |
|
|
Krrish Dholakia
|
1553f7fa48
|
fix(types/utils.py): handle null completion tokens
Fixes https://github.com/BerriAI/litellm/issues/5096
|
2024-08-10 09:23:03 -07:00 |
|
|
Ishaan Jaff
|
20ef72194c
|
use customLogger for prometheus logger
|
2024-08-10 09:15:23 -07:00 |
|
|
Ishaan Jaff
|
05fba48cec
|
feat - refactor prometheus metrics
|
2024-08-10 09:14:38 -07:00 |
|
|
Krrish Dholakia
|
f4355d3e88
|
bump: version 1.43.5 → 1.43.6
v1.43.6
v1.43.6-stable
|
2024-08-09 20:41:48 -07:00 |
|
|
Krish Dholakia
|
e1a8e6c394
|
Merge pull request #5145 from BerriAI/litellm_fix_stream_options_logging
fix(litellm_logging.py): fix calling success callback w/ stream_options true
|
2024-08-09 20:30:19 -07:00 |
|
|
Krish Dholakia
|
a42164fa79
|
Merge pull request #5143 from BerriAI/litellm_use_max_retries
fix(utils.py): set max_retries = num_retries, if given
|
2024-08-09 20:29:49 -07:00 |
|
|
Ishaan Jaff
|
4c4ccaff66
|
fix _hidden_params is None case
v1.43.5
v1.43.5-stable
|
2024-08-09 19:17:11 -07:00 |
|
|
Ishaan Jaff
|
3320d76dd4
|
ci/cd run again
|
2024-08-09 19:13:52 -07:00 |
|
|
Ishaan Jaff
|
a1fe1d2042
|
fix linting error
|
2024-08-09 18:47:23 -07:00 |
|
|
Krrish Dholakia
|
a26b23a3f4
|
fix(litellm_logging.py): fix calling success callback w/ stream_options true
Fixes https://github.com/BerriAI/litellm/issues/5118
|
2024-08-09 18:20:42 -07:00 |
|
|
Ishaan Jaff
|
0acc6efa8f
|
docs clean sidebar
|
2024-08-09 18:09:11 -07:00 |
|
|
Ishaan Jaff
|
4c08d1a21d
|
docs migration policy
|
2024-08-09 18:06:37 -07:00 |
|
|
Ishaan Jaff
|
4ec1df799c
|
Merge pull request #5144 from BerriAI/litellm_bedrock_put_modified_tool_Call_name_in_output
[Fix] Place bedrock modified tool call name in output
|
2024-08-09 18:04:30 -07:00 |
|
|
Ishaan Jaff
|
09000d4b66
|
docs add migration policy
|
2024-08-09 18:03:37 -07:00 |
|
|
Ishaan Jaff
|
d445f3967d
|
correctly add modified tool names to cache
|
2024-08-09 17:39:49 -07:00 |
|
|
Ishaan Jaff
|
42617c207a
|
test bedrock tool call names
|
2024-08-09 17:14:56 -07:00 |
|
|
Ishaan Jaff
|
43ff70348d
|
init bedrock_tool_name_mappings
|
2024-08-09 17:09:19 -07:00 |
|
|
Krrish Dholakia
|
dd3d97ace6
|
test(test_optional_params.py): use num_retries instead of 'max_retries' if given
|
2024-08-09 17:02:29 -07:00 |
|
|
Krrish Dholakia
|
a858cc4d0c
|
docs(main.py): clarify 'num_retries' usage
|
2024-08-09 16:57:06 -07:00 |
|
|
Krrish Dholakia
|
ba7b070883
|
fix(utils.py): set max_retries = num_retries, if given
|
2024-08-09 16:54:54 -07:00 |
|
|
Krrish Dholakia
|
9f0a05d406
|
fix(utils.py): only return non-null default values
|
2024-08-09 16:34:59 -07:00 |
|
|
Ishaan Jaff
|
3548a55277
|
Merge pull request #5139 from BerriAI/litellm_log_vertex_metadata_as_spans
[Feat-Langfuse] log VertexAI Grounding Metadata as Spans
|
2024-08-09 14:52:59 -07:00 |
|
|
Ishaan Jaff
|
2fa73acf32
|
Merge pull request #5138 from BerriAI/litellm_bedrock_tool_calling
Feat - Translate openai function names to bedrock converse schema
|
2024-08-09 14:52:40 -07:00 |
|
|
Ishaan Jaff
|
3e2a1fe0aa
|
log provider specific metadata as a span
|
2024-08-09 14:32:02 -07:00 |
|
|
Ishaan Jaff
|
6dc9b39095
|
test invalid tool namehandling
|
2024-08-09 13:26:21 -07:00 |
|
|
Ishaan Jaff
|
8b98193a51
|
bedrock make_valid_bedrock_tool_name
|
2024-08-09 13:16:38 -07:00 |
|
|
Krrish Dholakia
|
177f670c7d
|
build(test_completion.py): ci/cd run again
v1.43.4.dev5
|
2024-08-09 12:28:26 -07:00 |
|
|
Ishaan Jaff
|
2f8db40cab
|
ui new build
|
2024-08-09 12:26:24 -07:00 |
|
|
Krrish Dholakia
|
6180c52cfe
|
fix(router.py): fix types
|
2024-08-09 12:24:48 -07:00 |
|
|
Ishaan Jaff
|
db7897dcc0
|
Merge pull request #5136 from BerriAI/litellm_add_cohere_embedding_models
ui allow adding cohere models
|
2024-08-09 12:19:19 -07:00 |
|