Krish DholakiaandGitHub dcc8f04ca0 Remove stream options from streaming + fix guardrail start time on log duration (#12346) ...

* fix(streaming_handler.py): don't return stream options in clientside response

* test: add unit test

* fix(custom_guardrail.py): fix start time

don't start until function actually called

leading to incorrect high latency numbers

* fix(custom_guardrail.py): fix start time

2025-07-05 15:54:47 -07:00

..

llm_cost_calc

Fix allow strings in calculate cost (#12200)

2025-07-01 11:37:15 -07:00

prompt_templates

Fix Azure-OpenAI Vision API Compliance (#12075)

2025-06-26 22:54:15 -07:00

specialty_caches

[Bug]: Performance Fix Max langfuse clients reached: 20 is greater than 20 (#11285)

2025-05-30 22:34:39 -07:00

__init__.py

[Feat] Add github co-pilot as a new LLM API provider (#12325)

2025-07-04 13:12:16 -07:00

messages_with_counts.py

…

test_audio_utils.py

[Feat] Add Eleven Labs - Speech To Text Support on LiteLLM (#12119)

2025-06-27 17:50:49 -07:00

test_core_helpers.py

…

test_dd_tracing.py

[Feat]: Performance add DD profiler to monitor python profile of LiteLLM CPU% (#11375)

2025-06-03 12:03:08 -07:00

test_duration_parser.py

…

test_exception_mapping_utils.py

[Bug Fix] Exception mapping for context window exceeded - should catch anthropic exceptions (#12113)

2025-06-27 15:49:07 -07:00

test_litellm_logging.py

UI - Azure Content Guardrails (#12341)

2025-07-05 10:19:29 -07:00

test_realtime_streaming.py

…

test_safe_json_dumps.py

…

test_streaming_chunk_builder_utils.py

VertexAI Anthropic - streaming cost tracking w/ prompt caching fixes (#12188)

2025-06-30 22:00:10 -07:00

test_streaming_handler.py

Remove stream options from streaming + fix guardrail start time on log duration (#12346)

2025-07-05 15:54:47 -07:00

test_token_counter_tool_data.py

…

test_token_counter_tool.py

…

test_token_counter.py

…