litellm

anthropic_interface

…

assistants

…

batch_completion

…

batches

[Feat] Add support for Batch API Rate limiting - PR1 adds support for input based rate limits (#16075 )

2025-10-29 18:28:52 -07:00

caching

fix: Resolve MyPy type checking errors and CI linting (#16277 )

2025-11-05 18:36:06 -08:00

completion_extras

fix: Resolve MyPy type checking errors and CI linting (#16277 )

2025-11-05 18:36:06 -08:00

containers

Add E2E Container API Support (#16136 )

2025-11-01 14:03:51 -07:00

endpoints/speech/speech_to_completion_bridge

fix: fix import errors

2025-09-14 09:32:21 -07:00

experimental_mcp_client

fix(client.py): fix rest api tool call

2025-10-09 14:42:04 -07:00

files

fix: Convert object to a correct type (#15634 )

2025-10-16 21:47:32 -07:00

fine_tuning

…

google_genai

fix test /generateContent route

2025-10-04 10:49:46 -07:00

images

[Feat] Add FAL AI Image Generations on LiteLLM (#16067 )

2025-10-29 13:10:51 -07:00

integrations

[Feat] Add DD Agent Host support for datadog callback (#16379 )

2025-11-07 15:18:23 -08:00

litellm_core_utils

add safe_dumps

2025-11-08 10:19:38 -08:00

llms

fix remove unused var

2025-11-08 09:29:50 -08:00

ocr

[Feat] /ocr - Add VertexAI OCR provider support + cost tracking (#16216 )

2025-11-03 15:56:49 -08:00

passthrough

working - errors from bedrock through pass throughs

2025-10-16 15:40:42 -07:00

proxy

[Feature] UI - Cache Settings Redis Add Semantic Cache Settings (#16398 )

2025-11-08 10:09:49 -08:00

realtime_api

[Fix] OpenAI Realtime API integration fails due to websockets.exceptions.PayloadTooBig error (#15751 )

2025-10-20 15:54:14 -07:00

rerank_api

[Feat] Add Nvidia NIM Rerank Support (#15152 )

2025-10-02 18:58:52 -07:00

responses

fix _handle_logging_completed_response

2025-11-07 18:37:34 -08:00

router_strategy

fix: remove router inefficiencies (from O(M*N) to O(1)) - 62.5% faster P99 latency (#15046 )

2025-09-29 15:49:46 -07:00

router_utils

parse_jsonl_with_embedded_newlines

2025-11-06 16:05:12 -08:00

search

[Bug Fix] Exa Search API - ensure request params are sent to Exa AI (#15855 )

2025-10-23 11:56:30 -07:00

secret_managers

[Feat] Secret Manager - Hashicorp, add auth via approle (#16374 )

2025-11-07 14:39:33 -08:00

types

[Feature] UI - Cache Settings Redis Add Semantic Cache Settings (#16398 )

2025-11-08 10:09:49 -08:00

vector_stores

(feat) Azure AI Vector Stores - support "virtual" indexes + create vector store on passthrough API (#16160 )

2025-11-01 12:01:32 -07:00

videos

Add custom_llm_provider support for video endpoints (non-generation) (#16121 )

2025-11-01 12:09:11 -07:00

__init__.py

Fix HostedVLLMRerankConfig will not be used (#16352 )

2025-11-07 19:11:59 -08:00

_logging.py

[Feat] Add support for returning images with gemini/gemini-2.5-flash-image-preview with /chat/completions (#13983 )

2025-08-27 16:16:19 -07:00

_redis.py

fix: Apply max_connections configuration to Redis async client (#15797 )

2025-10-22 09:19:08 -07:00

_service_logger.py

…

_uuid.py

Fix: revert fastuuid optional dependency, always use fastuuid in .__uid helper (#14941 )

2025-09-26 09:14:20 -07:00

_version.py

…

budget_manager.py

…

constants.py

Fix Azure DALL-E-3 health check content policy violation by using safe default prompt (#16329 )

2025-11-07 15:30:56 -08:00

cost_calculator.py

fix: resolve memory leak caused by Pydantic 2.11+ deprecation warnings (#16110 )

2025-11-01 13:16:32 -07:00

cost.json

…

exceptions.py

Add retry-after header support for errors 502, 503, 504 (#16288 )

2025-11-06 19:33:29 -08:00

main.py

Revert "Update perplexity cost tracking (#15743 )" (#16345 )

2025-11-06 19:00:45 -08:00

model_prices_and_context_window_backup.json

test_patch_guardrail_endpoint

2025-11-07 22:09:52 -08:00

mypy.ini

fix mypy

2025-09-27 12:21:32 -07:00

py.typed

…

router.py

refactor

2025-11-03 17:31:55 -08:00

scheduler.py

…

timeout.py

…

utils.py

Fix HostedVLLMRerankConfig will not be used (#16352 )

2025-11-07 19:11:59 -08:00