mirror of https://github.com/tiennm99/litellm.git synced 2026-08-02 22:22:39 +00:00

Files

T

Krish DholakiaandGitHub 346e036399 fix(opentelemetry.py): fix issue where headers were not being split correctly + feat(bedrock): add titan image generations w/ cost tracking (#15916 )

* fix(opentelemetry.py): fix issue where headers were not being split correctly

* feat(bedrock/image): Support bedrock titan image generation

Closes https://github.com/BerriAI/litellm/issues/361

* build(model_prices_and_context_window.json): track titan image gen pricing

enables cost tracking per request

* feat(amazon_titan_transformation.py): support titan image generation cost tracking

* docs: document new model

* docs: update docs to indicate cost tracking + refactor rerank into separate doc

* fix: fix mypy linting error

* fix: fix type ignore

2025-10-25 13:45:13 -07:00

caching

[Performance] Reduce complexity of InMemoryCache.evict_cache from O(n*log(n)) to O(log(n)) (#15000 )

2025-09-30 16:49:35 -07:00

completion_extras/litellm_responses_transformation

feat(openai/): convert chat completion tool calls to responses api

2025-10-10 19:41:11 -07:00

enterprise/enterprise_callbacks

[Feat] Backend - Add support for disabling callbacks in request body (#12762 )

2025-07-19 10:10:30 -07:00

experimental_mcp_client

fix(mcp/): add ssl certificate settings for mcp clients

2025-10-06 18:36:05 -07:00

google_genai

[Oct Staging Branch] (#15460 )

2025-10-17 17:52:25 -07:00

integrations

fix(opentelemetry.py): fix issue where headers were not being split correctly + feat(bedrock): add titan image generations w/ cost tracking (#15916 )

2025-10-25 13:45:13 -07:00

litellm_core_utils

Responses API - support tags in metadata

2025-10-25 12:07:54 -07:00

llms

Guardrails - Responses API, Image Gen, Text completions, Audio transcriptions, Audio Speech, Rerank, Anthropic Messages API support via the unified apply_guardrails function (#15706 )

2025-10-25 13:38:57 -07:00

passthrough

test: add unit tests

2025-10-06 13:53:36 -07:00

proxy

Org level tpm/rpm limits + Team tpm/rpm validation when assigned to org (#15549 )

2025-10-25 13:40:29 -07:00

responses

test fix

2025-10-22 09:29:04 -07:00

router_strategy

fix: Prevent AttributeError for _get_tags_from_request_kwargs (#14735 )

2025-09-19 15:21:02 -07:00

router_utils

test

2025-09-06 16:38:43 -07:00

secret_managers

test(test_get_azure_ad_token_provider.py): add unit test to ensure default azure credentials used in the right context

2025-09-11 16:07:32 -07:00

types

[LLM Translation] Fix Model Usage not having text tokens (#13234 )

2025-08-04 21:06:49 +05:30

vector_stores

[Bug Fix] Bedrock KB - Using LiteLLM Managed Credentials for Query (#13787 )

2025-08-19 15:39:36 -07:00

__init__.py

[Feat] Add github co-pilot as a new LLM API provider (#12325 )

2025-07-04 13:12:16 -07:00

conftest.py

[Feat] Add support for returning images with gemini/gemini-2.5-flash-image-preview with /chat/completions (#13983 )

2025-08-27 16:16:19 -07:00

log.txt

fix: fix linting errors

2025-09-27 14:25:05 -07:00

readme.md

…

test_acompletion_session_reuse_e2e.py

[Fix] - Sessions not being shared (#15388 )

2025-10-09 16:57:40 -07:00

test_aembedding_session_reuse_e2e.py

[Fix] - shared session parsing and usage issue (#15440 )

2025-10-10 19:26:53 -07:00

test_azure_video_router.py

Litellm sameer oct staging (#15806 )

2025-10-24 12:17:22 -07:00

test_constants.py

…

test_cost_calculation_log_level.py

Enhance logging in cost calculation tests to ensure DEBUG level captures are accurate. Updated tests to set logger level before assertions and restored original logger level after execution. This improves reliability of log level checks in both cost and batch cost calculation tests.

2025-08-14 14:21:22 -07:00

test_cost_calculator.py

[Feat] Cost Tracking - specify a global vendor discount for costs. (#15546 )

2025-10-14 20:07:04 -07:00

test_exception_mapping_request_attribute.py

Added test

2025-09-29 21:43:31 +05:30

test_filter_out_litellm_params.py

[Bug Fix] Exa Search API - ensure request params are sent to Exa AI (#15855 )

2025-10-23 11:56:30 -07:00

test_groq_streaming_encoding.py

[Bug] Fix: Vertex Mistral not working for streaming (#13952 )

2025-08-25 17:39:40 -07:00

test_logging.py

[Bug Fix] StandardLoggingPayload on cache_hits should track custom llm provider + DD LLM Obs span type (#12652 )

2025-07-16 15:43:15 -07:00

test_lowest_latency_zero_tokens.py

fix: remove router inefficiencies (from O(M*N) to O(1)) - 62.5% faster P99 latency (#15046 )

2025-09-29 15:49:46 -07:00

test_main.py

build: squash merge litellm_dev_10_10_2025_p1

2025-10-25 12:21:12 -07:00

test_redis.py

fix: Apply max_connections configuration to Redis async client (#15797 )

2025-10-22 09:19:08 -07:00

test_responses_id_security.py

(security) Responses API - prevent User A from retrieving User B's response, if response.id is leaked (#15757 )

2025-10-25 13:41:59 -07:00

test_router_google_genai.py

test(gemini): Add unit tests for Google GenAI adapter

2025-09-29 18:51:35 +08:00

test_router.py

fix tests

2025-10-25 10:19:24 -07:00

test_shared_session_integration.py

feat: Add shared_session parameter for aiohttp ClientSession reuse

2025-09-19 01:46:53 -07:00

test_system_message_format_bug.py

Ensure that function_call_prompt extends system messages following its current schema

2025-08-03 17:47:13 +02:00

test_utils.py

Litellm sameer oct staging (#15806 )

2025-10-24 12:17:22 -07:00

test_uuid_helper.py

Fix: revert fastuuid optional dependency, always use fastuuid in .__uid helper (#14941 )

2025-09-26 09:14:20 -07:00

test_video_generation.py

Litellm sameer oct staging (#15806 )

2025-10-24 12:17:22 -07:00

readme.md

Testing for `litellm/`

This directory 1:1 maps the the litellm/ directory, and can only contain mocked tests.

The point of this is to:

Increase test coverage of litellm/
Make it easy for contributors to add tests for the litellm/ package and easily run tests without needing LLM API keys.

File name conventions

litellm/proxy/test_caching_routes.py maps to litellm/proxy/caching_routes.py
test_<filename>.py maps to litellm/<filename>.py

readme.md

Testing for litellm/

File name conventions

Testing for `litellm/`