tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-28 06:20:05 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
b1a0a3fc17d616ad2993a4c73f4eecbf31ef005c
litellm/tests/test_litellm
T
History
Ryan Crabbe dc46467235 fix(tests): replace deprecated Bedrock Claude 3.7 Sonnet model ID 
AWS Bedrock has reached end-of-life for `claude-3-7-sonnet-20250219-v1:0`,
returning 404s with "This model version has reached the end of its life."
Update test references to `claude-sonnet-4-5-20250929-v1:0` (same capability
surface: thinking, tools, prompt caching, PDF input, vision, computer use).

The bedrock/invoke pass-through tests stay on Sonnet 3.5 since Sonnet 4.5
is converse-only on Bedrock.
2026-04-28 14:24:19 -07:00
..
a2a_protocol
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
anthropic_interface/exceptions
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
caching
fix(caching): preserve prompt_tokens_details through embedding cache round-trip (#26653)
2026-04-28 08:25:11 -07:00
completion_extras
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
containers
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
enterprise
feat: add configurable multi-threshold budget alerts for virtual keys
2026-04-17 17:12:35 -07:00
expected_fine_tuning_api
refactor: refactor testing
2026-03-28 18:39:32 -07:00
expected_responses_api_request
…
experimental_mcp_client
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
google_genai
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
images
fix(image_edit): read vertex_project/location from litellm_params in Imagen get_complete_url
2026-04-21 15:03:40 +05:30
integrations
fix(tests): replace deprecated Bedrock Claude 3.7 Sonnet model ID
2026-04-28 14:24:19 -07:00
interactions
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
litellm_core_utils
fix(tests): replace deprecated Bedrock Claude 3.7 Sonnet model ID
2026-04-28 14:24:19 -07:00
llms
fix(tests): replace deprecated Bedrock Claude 3.7 Sonnet model ID
2026-04-28 14:24:19 -07:00
ocr
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
passthrough
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
proxy
Merge pull request #26460 from BerriAI/litellm_expired_dashboard_key_cleanup
2026-04-27 20:22:05 -07:00
responses
Revert "Merge pull request #24417 from Chesars/refactor/shared-format-mapping"
2026-04-25 15:03:24 -03:00
router_strategy
refactor(adaptive_router): move update_queue out of litellm.proxy
2026-04-21 18:02:44 -07:00
router_utils
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
secret_managers
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_router
…
types
Merge pull request #25256 from BerriAI/litellm_ishaan_april6
2026-04-17 16:26:45 -07:00
vector_stores
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
__init__.py
…
conftest.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
log.txt
…
readme.md
…
test_a2a_registry_lookup.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_acompletion_session_reuse_e2e.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_add_deployment_no_master_key.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_aembedding_session_reuse_e2e.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_anthropic_beta_headers_filtering.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_anthropic_skills_transformation.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_azure_video_router.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_chat_ui_responses_session.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_claude_haiku_4_5_config.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_claude_opus_4_6_config.py
Revert "Merge pull request #24164 from dongyu-turo/feat/update-bedrock-claude-price-above-200k"
2026-04-25 15:04:05 -03:00
test_completion_timeout_resolution.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_compression.py
Prompt Compression - add it to the proxy (#25729)
2026-04-20 15:08:00 -07:00
test_constants.py
Fix test
2026-03-27 21:21:43 +05:30
test_container_router.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_cost_calculation_log_level.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_cost_calculator.py
fix(utils): allowed_openai_params must not forward unset params as None (#25777)
2026-04-16 19:04:26 +05:30
test_count_tokens_public_api.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_dashscope_image_generation.py
fix(dashscope): fail fast on image generation API errors
2026-04-23 18:41:01 +05:30
test_deepseek_model_metadata.py
…
test_dockerfile_non_root.py
fix(docker.non_root): use numeric UID 65534 for K8s runAsNonRoot (#26268)
2026-04-22 18:00:04 -07:00
test_eager_tiktoken_load.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_exception_exports.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_exception_header_preservation.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_exception_mapping_request_attribute.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_filter_out_litellm_params.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_get_blog_posts.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_gpt_image_cost_calculator.py
…
test_groq_streaming_encoding.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_lazy_imports.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_litellm_params_reserved_keys.py
fix(snowflake): transform tool_choice string to object format (#23268)
2026-03-11 01:41:24 +05:30
test_logging.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_lowest_latency_zero_tokens.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_main.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_model_cost_aliases.py
[Feat] - Ishaan main merge branch (#23596)
2026-03-14 09:40:00 -07:00
test_model_param_helper.py
style: black format test_model_param_helper.py
2026-04-15 18:18:52 -07:00
test_model_response_normalization.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_nested_drop_params.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_project_alias_tracking.py
feat(proxy): add project_alias tracking through callback metadata pipeline
2026-03-23 10:44:17 -07:00
test_project_tags_pydantic.py
…
test_redact_string_in_error_paths.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_redis.py
fix(redis): cache GCP IAM token to prevent async event loop blocking (#26441)
2026-04-25 23:13:39 -07:00
test_register_model_custom_pricing.py
test: fix misleading precedence test per review feedback
2026-03-02 08:31:33 +00:00
test_responses_api_bridge_non_stream.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_responses_id_security.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_router_google_genai.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_router_model_cost_isolation.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_router_order_fallback.py
fix(router): enable order fallback for wildcard model groups
2026-04-15 17:48:25 +05:30
test_router_per_deployment_num_retries.py
…
test_router_redis_init.py
…
test_router_retry_non_retryable_errors.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_router_silent_experiment.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_router.py
fix(router): propagate custom cost_per_token from db model_info in fallback path (#25888)
2026-04-27 08:58:41 +05:30
test_secret_redaction.py
Litellm ishaan march30 (#24887) (#25151)
2026-04-04 14:44:07 -07:00
test_service_logger.py
…
test_setup_wizard.py
test: test
2026-03-28 19:17:38 -07:00
test_shared_session_integration.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_ssl_verify_unit.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_stream_chunk_builder_annotations.py
fix: merge annotations from all streaming chunks in stream_chunk_builder
2026-03-15 14:20:45 +05:30
test_streaming_connection_cleanup.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_system_message_format_bug.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00
test_utils.py
fix(tests): replace deprecated Bedrock Claude 3.7 Sonnet model ID
2026-04-28 14:24:19 -07:00
test_uuid_helper.py
…
test_video_generation.py
feat(gemini): Veo Lite pricing, size→resolution, usage video_resolution for cost tiers
2026-04-08 19:50:50 +05:30
test_xai_responses_auto_routing.py
style: run black formatter on files from main merge
2026-04-17 13:02:59 -07:00

readme.md

Testing for litellm/

This directory 1:1 maps the the litellm/ directory, and can only contain mocked tests.

The point of this is to:

  1. Increase test coverage of litellm/
  2. Make it easy for contributors to add tests for the litellm/ package and easily run tests without needing LLM API keys.

File name conventions

  • litellm/proxy/test_caching_routes.py maps to litellm/proxy/caching_routes.py
  • test_<filename>.py maps to litellm/<filename>.py
Reference in New Issue View Git Blame Copy Permalink