malagsandGitHub 68189d1c04 [Performance] Reduce complexity of InMemoryCache.evict_cache from O(n*log(n)) to O(log(n)) (#15000) ...

* Improved performance by reducing complexity

* Improved logic to prevent memory from increasing too much, added test

* Restore indent

* Restore indent

* Added type annotation

* Updated test to correctly initialize the expiration_heap

2025-09-30 16:49:35 -07:00

..

llm_cost_calc

Add service_tier based pricing support for openai

2025-09-23 10:48:27 +05:30

prompt_templates

[Bug]: Fix Mimetype Resolution Error in Bedrock Document Understanding (#13309)

2025-08-05 17:07:10 -07:00

specialty_caches

[Performance] Reduce complexity of InMemoryCache.evict_cache from O(n*log(n)) to O(log(n)) (#15000)

2025-09-30 16:49:35 -07:00

__init__.py

[Feat] Add github co-pilot as a new LLM API provider (#12325)

2025-07-04 13:12:16 -07:00

messages_with_counts.py

Litellm fix GitHub action testing (#11163)

2025-05-26 14:41:42 -07:00

test_audio_utils.py

[Feat] Add Eleven Labs - Speech To Text Support on LiteLLM (#12119)

2025-06-27 17:50:49 -07:00

test_cli_token_utils.py

[Feat] Proxy CLI: Create a python method to login using litellm proxy (#14782)

2025-09-22 21:28:38 -07:00

test_core_helpers.py

fix: avoid deepcopy crash with non-pickleables in Gemini/Vertex

2025-09-10 12:59:03 -07:00

test_coroutine_checker.py

fix: iscoroutine removed from hot path +50 RPS (#14649)

2025-09-17 19:01:43 -07:00

test_dd_tracing.py

[Feat]: Performance add DD profiler to monitor python profile of LiteLLM CPU% (#11375)

2025-06-03 12:03:08 -07:00

test_duration_parser.py

feat: add Asia/Bangkok timezone support for budget resets

2025-09-18 14:56:12 +07:00

test_exception_mapping_utils.py

[Bug Fix] Exception mapping for context window exceeded - should catch anthropic exceptions (#12113)

2025-06-27 15:49:07 -07:00

test_health_check_helpers.py

[Feat] - Track cost + add tags for health checks done by LiteLLM Proxy (#12880)

2025-07-22 18:45:57 -07:00

test_image_handling.py

[Bug fix] Misclassified 500 error on invalid image_url in /chat/completions request (#14149)

2025-09-01 15:26:27 -07:00

test_litellm_logging.py

Merge pull request #14534 from hula-la/fix/response-api-bugfixes

2025-09-16 22:46:03 -07:00

test_logging_worker.py

fix: fix race conditions

2025-09-14 09:41:04 -07:00

test_model_response_utils.py

[Fix] Streaming - consistent 'finish_reason' chunk index (#13560)

2025-08-12 23:21:57 -07:00

test_provider_specific_headers.py

[Bug fix] - Fix /messages fallback from Anthropic API -> Bedrock API (#13946)

2025-08-25 13:44:54 -07:00

test_realtime_streaming.py

Litellm fix GitHub action testing (#11163)

2025-05-26 14:41:42 -07:00

test_safe_divide_seconds.py

fix(lowest_latency.py): Handle ZeroDivisionError with zero completion tokens (#12734)

2025-07-18 15:19:47 -07:00

test_safe_json_dumps.py

Litellm fix GitHub action testing (#11163)

2025-05-26 14:41:42 -07:00

test_streaming_chunk_builder_utils.py

test_stream_chunk_builder_litellm_usage_chunks

2025-08-07 15:22:52 -07:00

test_streaming_handler.py

test: update tests

2025-09-06 19:02:03 -07:00

test_token_counter_tool_data.py

Litellm fix GitHub action testing (#11163)

2025-05-26 14:41:42 -07:00

test_token_counter_tool.py

Litellm fix GitHub action testing (#11163)

2025-05-26 14:41:42 -07:00

test_token_counter.py

Fix token_counter with special token input

2025-08-07 22:58:07 +08:00