mirror of https://github.com/tiennm99/litellm.git synced 2026-07-20 00:18:51 +00:00

Files

T

Krish DholakiaandGitHub 4e141df03a (feat) Team level model-specific tpm/rpm limits + working key-level validation of tpm/rpm limit when assigned to team (#15513 )

* fix(support-model-specific-tpm/rpm-limits): Allows setting rate limits by tpm/rpm for models by team

* fix(key_management_endpoints.py): enforce guaranteed throughput with key-level model tpm/rpm limits, when team-level tpm/rpm limits are set

* test: add unit testing

* fix: fix minor linting errors

* fix: refactor

2025-10-18 13:14:04 -07:00

caching

[Performance] Reduce complexity of InMemoryCache.evict_cache from O(n*log(n)) to O(log(n)) (#15000 )

2025-09-30 16:49:35 -07:00

completion_extras/litellm_responses_transformation

feat(openai/): convert chat completion tool calls to responses api

2025-10-10 19:41:11 -07:00

enterprise/enterprise_callbacks

…

experimental_mcp_client

fix(mcp/): add ssl certificate settings for mcp clients

2025-10-06 18:36:05 -07:00

google_genai

[Oct Staging Branch] (#15460 )

2025-10-17 17:52:25 -07:00

integrations

UI - add arize on ui, LLMs - clarifai refactor to openai compatible route, added azure ai/grok-4 model family

2025-10-16 20:39:15 -07:00

litellm_core_utils

Bedrock + MCP - working MCP calls to bedrock via Responses API + Log hidden params for OTEL calls (#15677 )

2025-10-18 10:39:28 -07:00

llms

[Oct Staging Branch] (#15460 )

2025-10-17 17:52:25 -07:00

passthrough

test: add unit tests

2025-10-06 13:53:36 -07:00

proxy

(feat) Team level model-specific tpm/rpm limits + working key-level validation of tpm/rpm limit when assigned to team (#15513 )

2025-10-18 13:14:04 -07:00

responses

test: update test

2025-10-12 21:58:06 -07:00

router_strategy

…

router_utils

…

secret_managers

…

types

…

vector_stores

…

__init__.py

…

conftest.py

…

log.txt

fix: fix linting errors

2025-09-27 14:25:05 -07:00

readme.md

…

test_acompletion_session_reuse_e2e.py

[Fix] - Sessions not being shared (#15388 )

2025-10-09 16:57:40 -07:00

test_aembedding_session_reuse_e2e.py

[Fix] - shared session parsing and usage issue (#15440 )

2025-10-10 19:26:53 -07:00

test_constants.py

…

test_cost_calculation_log_level.py

…

test_cost_calculator.py

[Feat] Cost Tracking - specify a global vendor discount for costs. (#15546 )

2025-10-14 20:07:04 -07:00

test_exception_mapping_request_attribute.py

Added test

2025-09-29 21:43:31 +05:30

test_groq_streaming_encoding.py

…

test_logging.py

…

test_lowest_latency_zero_tokens.py

fix: remove router inefficiencies (from O(M*N) to O(1)) - 62.5% faster P99 latency (#15046 )

2025-09-29 15:49:46 -07:00

test_main.py

…

test_redis.py

fix mapped tests 1 (#15445 )

2025-10-11 08:33:08 -07:00

test_router_google_genai.py

test(gemini): Add unit tests for Google GenAI adapter

2025-09-29 18:51:35 +08:00

test_router.py

fix _add_deployment_model_to_endpoint_for_llm_passthrough_route

2025-10-16 15:10:54 -07:00

test_shared_session_integration.py

…

test_system_message_format_bug.py

…

test_utils.py

test fix

2025-10-17 18:55:05 -07:00

test_uuid_helper.py

Fix: revert fastuuid optional dependency, always use fastuuid in .__uid helper (#14941 )

2025-09-26 09:14:20 -07:00

readme.md

Testing for `litellm/`

This directory 1:1 maps the the litellm/ directory, and can only contain mocked tests.

The point of this is to:

Increase test coverage of litellm/
Make it easy for contributors to add tests for the litellm/ package and easily run tests without needing LLM API keys.

File name conventions

litellm/proxy/test_caching_routes.py maps to litellm/proxy/caching_routes.py
test_<filename>.py maps to litellm/<filename>.py

readme.md

Testing for litellm/

File name conventions

Testing for `litellm/`