tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-15 00:22:34 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
ce0dc0c8b91f50ce6ec08e829604abe87f1cebdf
litellm/litellm/litellm_core_utils
T
History
Sameer Kankute 71f41352fa Merge pull request #17202 from BerriAI/litellm_azure_ai_anthropic_support 
(Bug)Migrate Anthropic provider to azure ai
2025-11-28 08:14:14 +05:30
..
audio_utils
feat(audio_transcriptions/): calculate duration of audio file for cost calculation + feat (image_generations): cost tracking accuracy improved with output_format, quality, size values fixed per openai model
2025-11-08 16:24:31 -08:00
llm_cost_calc
Gemini models: capture image_tokens and support cost_per_output_image_token in costs calculations (#16912)
2025-11-21 19:59:24 -08:00
llm_response_utils
fix: prompt injection not working (#16701)
2025-11-17 20:04:57 -08:00
prompt_templates
Litellm sameer nov 3 stable branch (#16963)
2025-11-22 09:35:05 -08:00
specialty_caches
[Bug]: Performance Fix Max langfuse clients reached: 20 is greater than 20 (#11285)
2025-05-30 22:34:39 -07:00
tokenizers
…
app_crypto.py
[Fix] SQS Logger - Add Base64 handling (#16028)
2025-10-28 16:41:32 -07:00
asyncify.py
…
cached_imports.py
fix: reduced __inits__ overhead in 7% (#14689)
2025-09-18 17:18:05 -07:00
cli_token_utils.py
[Feat] Proxy CLI: Create a python method to login using litellm proxy (#14782)
2025-09-22 21:28:38 -07:00
core_helpers.py
fix: resolve memory leak caused by Pydantic 2.11+ deprecation warnings (#16110)
2025-11-01 13:16:32 -07:00
coroutine_checker.py
fix: iscoroutine removed from hot path +50 RPS (#14649)
2025-09-17 19:01:43 -07:00
credential_accessor.py
fix(router.py): support reusable credentials via passthrough router (#9758)
2025-04-04 18:40:14 -07:00
custom_logger_registry.py
make generic api OSS + support multiple generic API's (#17152)
2025-11-26 18:38:38 -08:00
dd_tracing.py
[Feat]: Performance add DD profiler to monitor python profile of LiteLLM CPU% (#11375)
2025-06-03 12:03:08 -07:00
default_encoding.py
…
dot_notation_indexing.py
…
duration_parser.py
feat: add Asia/Bangkok timezone support for budget resets
2025-09-18 14:56:12 +07:00
exception_mapping_utils.py
Fix raising wrong 429 error on wrong exception (#16482)
2025-11-12 18:41:12 -08:00
fallback_utils.py
fix: use fastuuid helper (#14903)
2025-09-25 15:47:01 -07:00
get_litellm_params.py
fix get litellm params
2025-11-26 13:20:05 -08:00
get_llm_provider_logic.py
Merge pull request #17202 from BerriAI/litellm_azure_ai_anthropic_support
2025-11-28 08:14:14 +05:30
get_model_cost_map.py
Litellm UI qa 04 12 2025 p1 (#9955)
2025-04-12 19:30:48 -07:00
get_provider_specific_headers.py
[Fix] Forward anthropic-beta headers to Bedrock, VertexAI (#15700)
2025-10-18 16:26:32 -07:00
get_supported_openai_params.py
Merge branch 'main' into wandb-inference
2025-09-23 00:14:11 +05:30
health_check_helpers.py
Add Vertex and Gemini Videos API with Cost Tracking + UI support (#16323)
2025-11-08 16:03:51 -08:00
health_check_utils.py
…
initialize_dynamic_callback_params.py
Litellm dev 07 03 2025 p2 (#12301)
2025-07-03 22:40:21 -07:00
json_validation_rule.py
[Feat] Add Bridge from generateContent <> /chat/completions (#12081)
2025-06-27 11:08:55 -07:00
litellm_logging.py
[Feat] Add guardrails for pass through endpoints (#17221)
2025-11-27 12:06:53 -08:00
llm_request_utils.py
[Feat] Enterprise - Allow dynamically disabling callbacks in request headers (#11985)
2025-06-23 14:32:05 -07:00
logging_callback_manager.py
make generic api OSS + support multiple generic API's (#17152)
2025-11-26 18:38:38 -08:00
logging_utils.py
feat(llm_http_handler.py): add OTEL tracing for actual llm api call
2025-08-16 15:42:30 -07:00
logging_worker.py
Fix: prevent memory blowout in LoggingWorker (#16559)
2025-11-22 13:58:29 -08:00
mock_functions.py
Support returning virtual key in custom auth + Handle provider-specific optional params for embedding calls (#11346)
2025-06-03 07:24:13 -07:00
model_param_helper.py
[Bug Fix] caching does not account for thinking or reasoning_effort config (#10140)
2025-04-21 22:39:40 -07:00
model_response_utils.py
fix: resolve memory leak caused by Pydantic 2.11+ deprecation warnings (#16110)
2025-11-01 13:16:32 -07:00
README.md
…
realtime_streaming.py
build: merge in https://github.com/BerriAI/litellm/pull/10909
2025-05-17 07:36:56 -07:00
redact_messages.py
revert changes to redaction
2025-11-08 13:43:01 -08:00
response_header_helpers.py
…
rules.py
fix: remove slow string operation (#14955)
2025-09-26 13:25:59 -07:00
safe_json_dumps.py
add safe_dumps
2025-11-08 10:19:38 -08:00
safe_json_loads.py
add support to parse metadata (#10832)
2025-05-14 12:03:49 -07:00
sensitive_data_masker.py
[Fix] Exclude litellm_credential_name from Sensitive Data Masker (Updated) (#16958)
2025-11-21 19:09:48 -08:00
streaming_chunk_builder_utils.py
include server_tool_use in streaming usage (#16826)
2025-11-25 14:50:17 -08:00
streaming_handler.py
fix typo of orginal (#16255)
2025-11-04 18:55:44 -08:00
thread_pool_executor.py
…
token_counter.py
fix: support Anthropic tool_use and tool_result in token counter (#16351)
2025-11-13 14:30:46 -08:00

README.md

Folder Contents

This folder contains general-purpose utilities that are used in multiple places in the codebase.

Core files:

  • streaming_handler.py: The core streaming logic + streaming related helper utils
  • core_helpers.py: code used in types/ - e.g. map_finish_reason.
  • exception_mapping_utils.py: utils for mapping exceptions to openai-compatible error types.
  • default_encoding.py: code for loading the default encoding (tiktoken)
  • get_llm_provider_logic.py: code for inferring the LLM provider from a given model name.
  • duration_parser.py: code for parsing durations - e.g. "1d", "1mo", "10s"
Reference in New Issue View Git Blame Copy Permalink