Ishaan Jaff e9a07347dc fix: reduce proxy overhead for large base64 payloads (#21594) ...

* fix aviation safety topic filter: remove overly broad exceptions, add cockpit access block words

* fix airline brand protection filter: add identifier words, competitor/ops block words, tighten exceptions

* add constants for large payload handling and detailed timing

* add base64 truncation for logging payloads

* use shallow copy for messages, track copy and callback timing

* add callback duration and detailed timing to response metadata

* add callback duration header, size-gate debug logging, detailed timing headers

* add tests for callback timing, base64 truncation, and detailed timing

* fix code quality: extract helpers, fix regex, clean up imports

* rewrite _truncate_base64_in_value iteratively to satisfy recursive detector

2026-02-19 12:10:52 -08:00

..

llm_cost_calc

perf: add early-exit guards in completion_cost for unused features (#20020)

2026-02-07 10:10:00 -08:00

llm_response_utils

fix: reduce proxy overhead for large base64 payloads (#21594)

2026-02-19 12:10:52 -08:00

prompt_templates

fix(bedrock): handle concatenated JSON in tool call arguments (#20742)

2026-02-10 16:00:36 +05:30

specialty_caches

[Performance] Reduce complexity of InMemoryCache.evict_cache from O(n*log(n)) to O(log(n)) (#15000)

2025-09-30 16:49:35 -07:00

__init__.py

[Feat] Add github co-pilot as a new LLM API provider (#12325)

2025-07-04 13:12:16 -07:00

messages_with_counts.py

Litellm fix GitHub action testing (#11163)

2025-05-26 14:41:42 -07:00

test_audio_utils.py

Use audio content for caching

2025-12-08 19:31:22 +05:30

test_cli_token_utils.py

[Feat] Proxy CLI: Create a python method to login using litellm proxy (#14782)

2025-09-22 21:28:38 -07:00

test_codestral_provider_routing.py

fix: correctly route codestral chat and FIM endpoints (#18467)

2026-01-04 00:45:45 +05:30

test_core_helpers.py

fix: unify model names to provider-defined names

2026-01-02 08:36:58 +09:00

test_coroutine_checker.py

fix: iscoroutine removed from hot path +50 RPS (#14649)

2025-09-17 19:01:43 -07:00

test_dd_tracing.py

[Feat]: Performance add DD profiler to monitor python profile of LiteLLM CPU% (#11375)

2025-06-03 12:03:08 -07:00

test_dot_notation_indexing.py

Add Kubernetes ServiceAccount JWT authentication support (#18055)

2026-01-02 14:02:31 +05:30

test_duration_parser.py

feat: add Asia/Bangkok timezone support for budget resets

2025-09-18 14:56:12 +07:00

test_exception_mapping_utils.py

fix openai tests

2026-02-12 17:53:47 -08:00

test_extract_base64_image.py

fix: extract pure base64 data from data URLs for Ollama (#18465)

2026-01-04 00:47:38 +05:30

test_get_litellm_params.py

perf: Optimize get_litellm_params with sparse kwargs extraction (#19884)

2026-02-07 10:38:43 -08:00

test_health_check_helpers.py

Fix: Prevent LiteLLM API key leakage on /health endpoint failures (#18133)

2025-12-17 08:08:05 -08:00

test_image_handling.py

Fix: Stream the download in chunks

2026-01-27 14:35:54 +05:30

test_litellm_logging.py

Revert "perf: skip enterprise callback check when no dynamic disabling config…" (#20659)

2026-02-07 11:52:07 -08:00

test_logging_utils.py

fix: reduce proxy overhead for large base64 payloads (#21594)

2026-02-19 12:10:52 -08:00

test_logging_worker.py

fix(logging_worker): handle event loop changes in multiprocessing by checking bound_loop (#18423)

2026-01-03 00:19:14 +05:30

test_model_response_utils.py

[Fix] Streaming - consistent 'finish_reason' chunk index (#13560)

2025-08-12 23:21:57 -07:00

test_provider_specific_headers.py

[Fix] Forward anthropic-beta headers to Bedrock, VertexAI (#15700)

2025-10-18 16:26:32 -07:00

test_realtime_streaming.py

Litellm fix GitHub action testing (#11163)

2025-05-26 14:41:42 -07:00

test_redact_messages.py

fix: redaction headers ignored when sent via proxy (#20740)

2026-02-11 15:44:37 +05:30

test_retry_after_headers.py

Add retry-after header support for errors 502, 503, 504 (#16288)

2025-11-06 19:33:29 -08:00

test_safe_divide_seconds.py

fix(lowest_latency.py): Handle ZeroDivisionError with zero completion tokens (#12734)

2025-07-18 15:19:47 -07:00

test_safe_json_dumps.py

fix: shared health check serialization (#21119)

2026-02-13 09:15:43 -08:00

test_sensitive_data_masker.py

test_lists_with_sensitive_keys_are_masked

2026-01-10 13:55:11 -08:00

test_streaming_chunk_builder_utils.py

test(streaming): build thinking chunks with typed Delta/StreamingChoices

2026-02-08 05:08:50 -06:00

test_streaming_handler.py

Revert "feat: Add built-in migration lock to prevent concurrent Prisma migrat…" (#18719)

2026-01-06 23:56:02 +05:30

test_token_counter_tool_data.py

Litellm fix GitHub action testing (#11163)

2025-05-26 14:41:42 -07:00

test_token_counter_tool.py

Litellm fix GitHub action testing (#11163)

2025-05-26 14:41:42 -07:00

test_token_counter.py

fix(token-counter): fix test isolation and encode() return type normalization

2026-02-17 20:07:52 -03:00