litellm

tiennm99/litellm

Fork 0

mirror of https://github.com/tiennm99/litellm.git synced 2026-08-02 06:22:48 +00:00

Files

T

History

Ishaan JaffandGitHub 4caf4c0277 (Feat - prometheus) - emit litellm_overhead_latency_metric (#7913 )

* add track_llm_api_timing

* add track_llm_api_timing

* test_litellm_overhead

* use ResponseMetadata class for setting hidden params and response overhead

* instrument http handler

* fix track_llm_api_timing

* track_llm_api_timing

* emit response overhead on hidden params

* fix resp metadata

* fix make_sync_openai_embedding_request

* test_aaaaatext_completion_endpoint fixes

* _get_value_from_hidden_params

* set_hidden_params

* test_litellm_overhead

* test_litellm_overhead

* test_litellm_overhead

* fix import

* test_litellm_overhead_stream

* add LiteLLMLoggingObject

* use diff folder for testing

* use diff folder for overhead testing

* test litellm overhead

* use typing

* clear typing

* test_litellm_overhead

* fix async_streaming

* update_response_metadata

* move test file

* emit litellm_overhead_latency_metric on prometheus

* add prometheus callback

* litellm_overhead_latency_metric_bucket

* fix apply hidden params

* fix StandardLoggingHiddenParams

2025-01-21 20:36:30 -08:00

test_e2e_budgeting.py

(Bug fix) - Allow setting null for max_budget, rpm_limit, tpm_limit when updating values on a team (#7912 )

2025-01-21 19:19:36 -08:00

test_guardrails.py

LiteLLM Minor Fixes & Improvements (11/29/2024) (#6965 )

2024-12-01 05:24:11 -08:00

test_key_logging_callbacks.py

(feat) add /key/health endpoint to test key based logging (#6073 )

2024-10-05 11:56:55 +05:30

test_model_info.py

[Feat] Allow setting supports_vision for Custom OpenAI endpoints + Added testing (#5821 )