Nicholas CoutureandGitHub 4be372eb48 fix: support Anthropic tool_use and tool_result in token counter (#16351) ...

* fix: support Anthropic tool_use and tool_result in token counter

* refactor(token_counter): add dynamic field inference for Anthropic content blocks

* test: Add additional tests

* make format

* Fix lint error

* Fix mypy narrow type lint errors

2025-11-13 14:30:46 -08:00

..

llm_cost_calc

Add E2E Container API Support (#16136)

2025-11-01 14:03:51 -07:00

prompt_templates

[LiteLLM-16250] Proxy to Bedrock will add name to file content, breaks when cache_control in use (#16275)

2025-11-05 18:39:38 -08:00

specialty_caches

[Performance] Reduce complexity of InMemoryCache.evict_cache from O(n*log(n)) to O(log(n)) (#15000)

2025-09-30 16:49:35 -07:00

__init__.py

[Feat] Add github co-pilot as a new LLM API provider (#12325)

2025-07-04 13:12:16 -07:00

messages_with_counts.py

…

test_audio_utils.py

feat(audio_transcriptions/): calculate duration of audio file for cost calculation + feat (image_generations): cost tracking accuracy improved with output_format, quality, size values fixed per openai model

2025-11-08 16:24:31 -08:00

test_cli_token_utils.py

[Feat] Proxy CLI: Create a python method to login using litellm proxy (#14782)

2025-09-22 21:28:38 -07:00

test_core_helpers.py

fix: avoid deepcopy crash with non-pickleables in Gemini/Vertex

2025-09-10 12:59:03 -07:00

test_coroutine_checker.py

fix: iscoroutine removed from hot path +50 RPS (#14649)

2025-09-17 19:01:43 -07:00

test_dd_tracing.py

[Feat]: Performance add DD profiler to monitor python profile of LiteLLM CPU% (#11375)

2025-06-03 12:03:08 -07:00

test_duration_parser.py

feat: add Asia/Bangkok timezone support for budget resets

2025-09-18 14:56:12 +07:00

test_exception_mapping_utils.py

Fix raising wrong 429 error on wrong exception (#16482)

2025-11-12 18:41:12 -08:00

test_health_check_helpers.py

[Feat] - Track cost + add tags for health checks done by LiteLLM Proxy (#12880)

2025-07-22 18:45:57 -07:00

test_image_handling.py

[Bug fix] Misclassified 500 error on invalid image_url in /chat/completions request (#14149)

2025-09-01 15:26:27 -07:00

test_litellm_logging.py

fix _get_spend_logs_metadata

2025-11-06 17:08:53 -08:00

test_logging_worker.py

fix: fix race conditions

2025-09-14 09:41:04 -07:00

test_model_response_utils.py

[Fix] Streaming - consistent 'finish_reason' chunk index (#13560)

2025-08-12 23:21:57 -07:00

test_provider_specific_headers.py

[Fix] Forward anthropic-beta headers to Bedrock, VertexAI (#15700)

2025-10-18 16:26:32 -07:00

test_realtime_streaming.py

…

test_retry_after_headers.py

Add retry-after header support for errors 502, 503, 504 (#16288)

2025-11-06 19:33:29 -08:00

test_safe_divide_seconds.py

fix(lowest_latency.py): Handle ZeroDivisionError with zero completion tokens (#12734)

2025-07-18 15:19:47 -07:00

test_safe_json_dumps.py

fixes

2025-11-08 11:11:22 -08:00

test_sensitive_data_masker.py

[Fix] - SensitiveDataMasker converts lists to string (#15420)

2025-10-10 17:50:51 -07:00

test_streaming_chunk_builder_utils.py

test_stream_chunk_builder_litellm_usage_chunks

2025-08-07 15:22:52 -07:00

test_streaming_handler.py

test: update tests

2025-09-06 19:02:03 -07:00

test_token_counter_tool_data.py

…

test_token_counter_tool.py

…

test_token_counter.py

fix: support Anthropic tool_use and tool_result in token counter (#16351)

2025-11-13 14:30:46 -08:00