Alexsander Hamir 8d96626044 fix: iscoroutine removed from hot path +50 RPS (#14649) ...

* fix: iscoroutine removed from hot path

* fix: replace all instances & separate concerns

1. Replaced all instances of iscoroutine with is_async_callable
2. Place the coroutine checker in its own file

* fix: PR comment changes

* fix: missing config setting declaration

* fix: revert non-performance related changes

* fix: revert to initial implementation

* fix: remove dead const

2025-09-17 19:01:43 -07:00

..

llm_cost_calc

fix(utils.py): log cache_creation_tokens in prompt token details

2025-09-16 18:24:10 -07:00

prompt_templates

[Bug]: Fix Mimetype Resolution Error in Bedrock Document Understanding (#13309)

2025-08-05 17:07:10 -07:00

specialty_caches

[Bug]: Performance Fix Max langfuse clients reached: 20 is greater than 20 (#11285)

2025-05-30 22:34:39 -07:00

__init__.py

[Feat] Add github co-pilot as a new LLM API provider (#12325)

2025-07-04 13:12:16 -07:00

messages_with_counts.py

…

test_audio_utils.py

[Feat] Add Eleven Labs - Speech To Text Support on LiteLLM (#12119)

2025-06-27 17:50:49 -07:00

test_core_helpers.py

fix: avoid deepcopy crash with non-pickleables in Gemini/Vertex

2025-09-10 12:59:03 -07:00

test_coroutine_checker.py

fix: iscoroutine removed from hot path +50 RPS (#14649)

2025-09-17 19:01:43 -07:00

test_dd_tracing.py

[Feat]: Performance add DD profiler to monitor python profile of LiteLLM CPU% (#11375)

2025-06-03 12:03:08 -07:00

test_duration_parser.py

…

test_exception_mapping_utils.py

[Bug Fix] Exception mapping for context window exceeded - should catch anthropic exceptions (#12113)

2025-06-27 15:49:07 -07:00

test_health_check_helpers.py

[Feat] - Track cost + add tags for health checks done by LiteLLM Proxy (#12880)

2025-07-22 18:45:57 -07:00

test_image_handling.py

[Bug fix] Misclassified 500 error on invalid image_url in /chat/completions request (#14149)

2025-09-01 15:26:27 -07:00

test_litellm_logging.py

Merge pull request #14534 from hula-la/fix/response-api-bugfixes

2025-09-16 22:46:03 -07:00

test_logging_worker.py

fix: fix race conditions

2025-09-14 09:41:04 -07:00

test_model_response_utils.py

[Fix] Streaming - consistent 'finish_reason' chunk index (#13560)

2025-08-12 23:21:57 -07:00

test_provider_specific_headers.py

[Bug fix] - Fix /messages fallback from Anthropic API -> Bedrock API (#13946)

2025-08-25 13:44:54 -07:00

test_realtime_streaming.py

…

test_safe_divide_seconds.py

fix(lowest_latency.py): Handle ZeroDivisionError with zero completion tokens (#12734)

2025-07-18 15:19:47 -07:00

test_safe_json_dumps.py

…

test_streaming_chunk_builder_utils.py

test_stream_chunk_builder_litellm_usage_chunks

2025-08-07 15:22:52 -07:00

test_streaming_handler.py

test: update tests

2025-09-06 19:02:03 -07:00

test_token_counter_tool_data.py

…

test_token_counter_tool.py

…

test_token_counter.py

Fix token_counter with special token input

2025-08-07 22:58:07 +08:00