tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-12 05:04:51 +00:00
Code Issues Packages Projects Releases Wiki Activity
16,282 Commits 2,072 Branches 1,425 Tags
2ed2ae96afd75e8a070766ce893fa85802dc4ccc
Commit Graph

16282 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Krrish Dholakia 2ed2ae96af fix(user_api_key_auth.py): move warning to debug log 2024-08-12 10:35:44 -07:00
Ishaan Jaff dc8f9e7241 docs mark oidc as beta 2024-08-12 09:01:36 -07:00
Krrish Dholakia 8cbf8d5671 docs(perplexity.md): show how to get 'return_citations' 2024-08-12 09:01:14 -07:00
Ishaan Jaff dd9be6f160 allow setting PROMETHEUS_SELECTED_INSTANCE 2024-08-10 17:31:05 -07:00
Ishaan Jaff e46009f3d2 Merge pull request #5154 from BerriAI/litellm_send_prometheus_fallbacks_from_slack 
[Feat-Proxy] send prometheus fallbacks stats to slack
 2024-08-10 17:14:01 -07:00
Ishaan Jaff cc3316104f doc new prometheus metrics 2024-08-10 17:13:36 -07:00
Krrish Dholakia a0a1feb7da fix(management/utils.py): fix add_member to team when adding user_email 
Fixes https://github.com/BerriAI/litellm/issues/5112
 2024-08-10 17:12:09 -07:00
Ishaan Jaff aef13a37f4 feat add cron job for sending stats from prometheus 2024-08-10 16:56:03 -07:00
Ishaan Jaff 017ba7a0fe add slack alerting on proxy_config.yaml 2024-08-10 16:37:59 -07:00
Krrish Dholakia 575afa8029 fix(internal_user_endpoints.py): return all teams if user is admin 2024-08-10 16:36:43 -07:00
Ishaan Jaff 28b930c0b7 feat - use api to get prometheus api metrics 2024-08-10 16:36:06 -07:00
Ishaan Jaff 35de40e6eb add fallback_reports in slack alert types 2024-08-10 16:08:36 -07:00
Ishaan Jaff 4cdc5c2e25 feat add prometheus api to get data from endpoint 2024-08-10 16:07:08 -07:00
Ishaan Jaff ffb7f9f280 add fallback_reports as slack alert 2024-08-10 15:26:32 -07:00
Krrish Dholakia e67a239520 fix(teams.tsx): reduce network calls to /team/info 2024-08-10 15:24:23 -07:00
Krrish Dholakia 19bb95f781 build(model_prices_and_context_window.json): add 'supports_assistant_prefill' to model info map 
Closes https://github.com/BerriAI/litellm/issues/4881
 2024-08-10 14:15:12 -07:00
Ishaan Jaff e861d97bf2 bump: version 1.43.6 → 1.43.7 v1.43.7-stable v1.43.7 v1.43.6.dev1 2024-08-10 14:11:14 -07:00
Ishaan Jaff 3bc39af1b9 Merge pull request #5153 from BerriAI/litellm_track_fallback_prometheus 
Feat - Proxy track fallback metrics on prometheus
 2024-08-10 14:10:42 -07:00
Ishaan Jaff d1eedb04bd prometheus log_success_fallback_event 2024-08-10 14:05:18 -07:00
Ishaan Jaff 2a54be4a43 feat - log fallbacks events on prometheus 2024-08-10 13:57:25 -07:00
Krrish Dholakia 0ea056971c docs(prefix.md): add prefix support to docs 2024-08-10 13:55:47 -07:00
Ishaan Jaff 0238ab077d v0 track fallback events 2024-08-10 13:31:00 -07:00
Ishaan Jaff 45186718aa v0 add event handlers for logging fallback events 2024-08-10 13:28:08 -07:00
Ishaan Jaff dc0559226a v0 add helper for loging success/fail fallback events 2024-08-10 13:26:39 -07:00
Ishaan Jaff d5abcb0945 Merge pull request #5152 from BerriAI/litellm_track_latency_prometheus 
Feat - track response latency on prometheus
 2024-08-10 13:02:10 -07:00
Krish Dholakia b7e0620039 Merge pull request #5151 from BerriAI/litellm_streaming_chunks_safe_fail 
fix(main.py): safely fail stream_chunk_builder calls
 2024-08-10 13:02:02 -07:00
Ishaan Jaff 234b4a5fbf Merge pull request #5149 from BerriAI/litellm_add_testing_for_prometheus_metrics 
[Refactor+Testing] Refactor Prometheus metrics to use CustomLogger class + add testing for prometheus
 2024-08-10 13:01:52 -07:00
Krrish Dholakia f10970f1b1 docs(custom_llm_server.md): clarify what to use for modifying incoming/outgoing calls 2024-08-10 12:58:43 -07:00
Ishaan Jaff 51ce8ba301 test for prom metrics 2024-08-10 12:56:23 -07:00
Ishaan Jaff 01f5456e3d feat - track latency per llm deployment 2024-08-10 12:53:56 -07:00
Krrish Dholakia 068ee12c30 fix(main.py): safely fail stream_chunk_builder calls 2024-08-10 10:22:26 -07:00
Ishaan Jaff 83446926af track llm_deployment_success_responses 2024-08-10 10:05:33 -07:00
Krrish Dholakia dd2ea72cb4 fix(openai.py): fix position of invalid_params param 2024-08-10 09:52:27 -07:00
Ishaan Jaff 2174801cb0 prometheus add basic testing for success 2024-08-10 09:45:12 -07:00
Ishaan Jaff ce9af1e1df refactor prometheus to be a customLogger class 2024-08-10 09:28:46 -07:00
Krrish Dholakia 1553f7fa48 fix(types/utils.py): handle null completion tokens 
Fixes https://github.com/BerriAI/litellm/issues/5096
 2024-08-10 09:23:03 -07:00
Ishaan Jaff 20ef72194c use customLogger for prometheus logger 2024-08-10 09:15:23 -07:00
Ishaan Jaff 05fba48cec feat - refactor prometheus metrics 2024-08-10 09:14:38 -07:00
Krrish Dholakia f4355d3e88 bump: version 1.43.5 → 1.43.6 v1.43.6 v1.43.6-stable 2024-08-09 20:41:48 -07:00
Krish Dholakia e1a8e6c394 Merge pull request #5145 from BerriAI/litellm_fix_stream_options_logging 
fix(litellm_logging.py): fix calling success callback w/ stream_options true
 2024-08-09 20:30:19 -07:00
Krish Dholakia a42164fa79 Merge pull request #5143 from BerriAI/litellm_use_max_retries 
fix(utils.py): set max_retries = num_retries, if given
 2024-08-09 20:29:49 -07:00
Ishaan Jaff 4c4ccaff66 fix _hidden_params is None case v1.43.5 v1.43.5-stable 2024-08-09 19:17:11 -07:00
Ishaan Jaff 3320d76dd4 ci/cd run again 2024-08-09 19:13:52 -07:00
Ishaan Jaff a1fe1d2042 fix linting error 2024-08-09 18:47:23 -07:00
Krrish Dholakia a26b23a3f4 fix(litellm_logging.py): fix calling success callback w/ stream_options true 
Fixes https://github.com/BerriAI/litellm/issues/5118
 2024-08-09 18:20:42 -07:00
Ishaan Jaff 0acc6efa8f docs clean sidebar 2024-08-09 18:09:11 -07:00
Ishaan Jaff 4c08d1a21d docs migration policy 2024-08-09 18:06:37 -07:00
Ishaan Jaff 4ec1df799c Merge pull request #5144 from BerriAI/litellm_bedrock_put_modified_tool_Call_name_in_output 
[Fix] Place bedrock modified tool call name in output
 2024-08-09 18:04:30 -07:00
Ishaan Jaff 09000d4b66 docs add migration policy 2024-08-09 18:03:37 -07:00
Ishaan Jaff d445f3967d correctly add modified tool names to cache 2024-08-09 17:39:49 -07:00