mirror of https://github.com/tiennm99/litellm.git synced 2026-08-03 14:23:28 +00:00

Files

T

Sameer KankuteandYuneng Jiang 5cea68f3ae fix(proxy): authorize batch files using upload target_model_names (LIT-3593) (#30009 )

* fix(proxy): authorize batch files using upload target_model_names (LIT-3593)

After replace_model_in_jsonl, body.model is a stripped provider id. Reverse-mapping it via resolve_model_name_from_model_id is first-match on model_list and caused false 403s when multiple deployments share the same stripped name. Use target_model_names from the unified file id instead.

Co-authored-by: Cursor <cursoragent@cursor.com>

* fix(proxy): restore resolve_model_name_from_model_id for JSONL fallback path (LIT-3593)

Restores the reverse-lookup for the JSONL body.model fallback path so that
legacy/pre-target_model_names managed files still map stripped provider IDs
back to proxy aliases before auth. Also cleans up redundant `or None`.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* Revert "fix(proxy): restore resolve_model_name_from_model_id for JSONL fallback path (LIT-3593)"

This reverts commit 30d2e96f77ef521ccaaf2193fe554980380eb669.

---------

Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
(cherry picked from commit 2cd7e87485)

2026-06-10 19:04:21 -07:00

a2a_protocol

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

anthropic_interface/exceptions

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

caching

chore(caching): remove allow_legacy_unscoped_cache_hits opt-in

2026-05-04 22:16:30 +00:00

completion_extras

fix(responses): normalize chat tool_choice for completions→responses bridge (#27634 )

2026-05-11 10:24:34 -07:00

containers

chore(container): use delete_cache, json-encode scope key, clean test

2026-05-05 00:43:47 +00:00

enterprise

fix(managed_batches): convert raw output_file_id to managed ID in CheckBatchCost poller (#27984 )

2026-05-15 04:41:38 -07:00

expected_fine_tuning_api

…

expected_responses_api_request

…

experimental_mcp_client

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

google_genai

fix(gemini): normalize response_schema on native generateContent (#27775 )

2026-05-12 23:26:34 -07:00

images

fix(image_edit): read vertex_project/location from litellm_params in Imagen get_complete_url

2026-04-21 15:03:40 +05:30

integrations

feat(otel): set http.response.status_code on the success SERVER span (#28090 )

2026-05-16 15:29:56 -07:00

interactions

test(interactions): validate response fields against Interaction schema

2026-05-15 21:13:36 -07:00

litellm_core_utils

[internal copy of #29089 ] fix: duplicate claude code traces (#29311 )

2026-06-02 16:34:11 -07:00

llms

Add Claude Fable 5 across Anthropic, Bedrock, Vertex AI, and Azure AI (#30064 )

2026-06-10 18:24:00 +00:00

ocr

chore: reject bare str at file-input sinks to prevent local-file read (#27762 )

2026-05-12 16:40:07 -07:00

passthrough

refactor: trim explanatory comments from streaming-flush fix

2026-04-30 02:39:28 +00:00

proxy

fix(proxy): authorize batch files using upload target_model_names (LIT-3593) (#30009 )

2026-06-10 19:04:21 -07:00

responses

fix(responses): preserve cache_control in Responses API -> Chat Completion transformation (#27727 )

2026-05-13 12:17:06 -07:00

router_strategy

feat: selectively apply routing strategy according to model name

2026-05-04 13:27:32 -07:00

router_utils

fix(responses): register cooldowns on failure + fail fast on stale encrypted_content (#27820 )

2026-05-13 09:03:13 -07:00

secret_managers

Implement normalize_nonempty_secret_str function to trim whitespace from secrets and treat empty values as unset. Update proxy_server to use this function for Grafana credentials. Enhance tests to validate the new normalization behavior.

2026-05-04 18:17:31 +00:00

test_router

…

types

Merge pull request #25256 from BerriAI/litellm_ishaan_april6

2026-04-17 16:26:45 -07:00

vector_stores

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

__init__.py

…

conftest.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

log.txt

…

readme.md

…

test_a2a_registry_lookup.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_acompletion_session_reuse_e2e.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_add_deployment_no_master_key.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_aembedding_session_reuse_e2e.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_anthropic_beta_headers_filtering.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_anthropic_skills_transformation.py

fix: encode upstream URL path identifiers

2026-04-29 22:02:39 -07:00

test_azure_video_router.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_bedrock_anthropic_1hr_cache_pricing.py

fix(bedrock): add 1-hour cache write tier for Claude 4.5/4.6/4.7 (Global, US)

2026-04-29 19:21:57 +00:00

test_chat_ui_responses_session.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_claude_fable_5_config.py

Add Claude Fable 5 across Anthropic, Bedrock, Vertex AI, and Azure AI (#30064 )

2026-06-10 18:24:00 +00:00

test_claude_haiku_4_5_config.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_claude_opus_4_6_config.py

Revert "Merge pull request #24164 from dongyu-turo/feat/update-bedrock-claude-price-above-200k"

2026-04-25 15:04:05 -03:00

test_claude_sonnet_4_6_config.py

fix(bedrock-mantle): use /anthropic/v1/messages path for Mantle endpo… (#27976 )

2026-05-15 13:31:59 -07:00

test_completion_timeout_resolution.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_compression.py

Prompt Compression - add it to the proxy (#25729 )

2026-04-20 15:08:00 -07:00

test_constants.py

…

test_container_router.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_cost_calculation_log_level.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_cost_calculator.py

fix(pricing): GPT-4o-Transcribe Pricing (#27875 )

2026-05-13 17:42:05 -07:00

test_count_tokens_public_api.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_dashscope_image_generation.py

fix(dashscope): fail fast on image generation API errors

2026-04-23 18:41:01 +05:30

test_deepseek_model_metadata.py

Revert "Merge pull request #16590 from Chesars/refactor/remove-backup-file-dry-principle"

2026-04-25 17:10:41 -03:00

test_dockerfile_non_root.py

fix(docker.non_root): use numeric UID 65534 for K8s runAsNonRoot (#26268 )

2026-04-22 18:00:04 -07:00

test_eager_tiktoken_load.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_exception_exports.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_exception_header_preservation.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_exception_mapping_request_attribute.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_filter_out_litellm_params.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_get_blog_posts.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_gpt_image_cost_calculator.py

Add gpt-image-2 support (#26644 ) (#26705 )

2026-04-28 20:10:42 -07:00

test_groq_streaming_encoding.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_lazy_imports.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_litellm_params_reserved_keys.py

…

test_logging.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_lowest_latency_zero_tokens.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_main_module_header.py

Add main module header comment

2026-05-06 00:26:17 +00:00

test_main.py

Match litellm.completion supported model parameters with proxy model info (#27720 )

2026-05-12 08:25:01 -07:00

test_model_cost_aliases.py

…

test_model_param_helper.py

style: black format test_model_param_helper.py

2026-04-15 18:18:52 -07:00

test_model_response_normalization.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_nested_drop_params.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_openai_embedding_encoding_format_default.py

fix(embeddings): allow omitting encoding_format via env sentinel none

2026-05-01 23:03:13 +05:30

test_project_alias_tracking.py

…

test_project_tags_pydantic.py

…

test_redact_string_in_error_paths.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_redis.py

fix: Fix Redis Sentinel client handling to solve authentication error… (#26302 )

2026-05-13 14:06:58 -07:00

test_register_model_custom_pricing.py

…

test_responses_api_bridge_non_stream.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_responses_id_security.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_retrieve_batch_bedrock_dispatch.py

feat(batch-job): bedrock batch model invocation job retrieval (#26834 )

2026-05-11 13:22:26 -07:00

test_router_google_genai.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_router_model_cost_isolation.py

fix(router): register model info under responses/-stripped variant (#27531 )

2026-05-09 20:30:18 +00:00

test_router_order_fallback.py

…

test_router_per_deployment_num_retries.py

…

test_router_redis_init.py

…

test_router_retry_non_retryable_errors.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_router_silent_experiment.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_router_weighted_failover.py

feat: add weighted-routing failover (#27980 )

2026-05-15 17:28:54 +00:00

test_router.py

test(router): cover _try_early_resolve_deployments_for_model_not_in_names

2026-05-02 00:18:45 +00:00

test_secret_redaction.py

Unify secret redaction patterns

2026-05-01 17:24:21 +00:00

test_service_logger.py

…

test_setup_wizard.py

…

test_shared_session_integration.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_ssl_verify_unit.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_stream_chunk_builder_annotations.py

…

test_streaming_connection_cleanup.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_system_message_format_bug.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_utils_module_docstring.py

Add utils module docstring

2026-05-06 00:42:49 +00:00

test_utils.py

Add Claude Fable 5 across Anthropic, Bedrock, Vertex AI, and Azure AI (#30064 )

2026-06-10 18:24:00 +00:00

test_uuid_helper.py

…

test_vcr_safe_body_matcher.py

test: add 24hr Redis-backed VCR cache to additional test suites (#27159 )

2026-05-05 15:13:31 -07:00

test_video_generation.py

…

test_xai_grok_4_3_model_metadata.py

feat(xai): add grok-4.3 and grok-4.3-latest to model_prices_and_conte… (#27154 )

2026-05-07 09:06:56 -07:00

test_xai_responses_auto_routing.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

readme.md

Testing for `litellm/`

This directory 1:1 maps the the litellm/ directory, and can only contain mocked tests.

The point of this is to:

Increase test coverage of litellm/
Make it easy for contributors to add tests for the litellm/ package and easily run tests without needing LLM API keys.

File name conventions

litellm/proxy/test_caching_routes.py maps to litellm/proxy/caching_routes.py
test_<filename>.py maps to litellm/<filename>.py

readme.md

Testing for litellm/

File name conventions

Testing for `litellm/`