4 people 4652c73259 feat(proxy): limit concurrent health checks with health_check_concurrency (#20584) ...

* staged first pass

* black

* Update litellm/proxy/health_check.py

Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>

* simpler

* restore cached logo

* fix tests for perform_health_check max_concurrency arg

* implement pr suggestion

* and the helm chart

* add configureable resources and probes to the deployment in the helm chart

* more helm chart unittests

* move some background healthcheck loggin to debug

---------

Co-authored-by: Sean Glover <sglover@athenahealth.com>
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>

2026-02-24 08:16:59 -08:00

..

example_config_yaml

fix tests

2025-10-25 10:19:24 -07:00

test_configs

fix tests

2025-10-25 10:19:24 -07:00

test_model_response_typing

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

adroit-crow-413218-bc47f303efc9.json

vertex testing use pathrise-convert-1606954137718

2025-01-05 14:00:17 -08:00

azure_fine_tune.jsonl

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

batch_job_results_furniture.jsonl

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

conftest copy.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

conftest.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

data_map.txt

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

eagle.wav

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

gettysburg.wav

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

large_text.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

messages_with_counts.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

model_cost.json

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

openai_batch_completions_router.jsonl

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

openai_batch_completions.jsonl

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

speech_vertex.mp3

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_aproxy_startup.py

(Security fix) - Upgrade to fastapi==0.115.5 (#7447)

2024-12-28 17:08:19 -08:00

test_audit_logs_proxy.py

fix(tests): skip prisma DB test and sync root schema.prisma with spec_path field

2026-02-20 12:29:53 -03:00

test_auth_checks.py

Fix: Anthropic model wildcard access issue

2026-02-23 17:12:55 +05:30

test_banned_keyword_list.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_blog_posts_endpoint.py

fix: log fallback warning in blog posts endpoint and tighten test

2026-02-21 17:34:08 -08:00

test_check_responses_cost.py

Add cost tracking for responses api in background mode

2025-12-19 13:35:48 +05:30

test_custom_callback_input.py

fix: use fastuuid helper (#14903)

2025-09-25 15:47:01 -07:00

test_custom_logger_s3_gcs.py

[Feat] Allow reading custom logger python scripts from s3 (#12623)

2025-07-16 15:07:01 -07:00

test_custom_tokenizer_bug.py

fix(token-counter): extract model_info from deployment for custom_tokenizer (#15657) (#15680)

2025-10-17 19:38:45 -07:00

test_db_schema_changes.py

test: initial test to enforce all functions in user_api_key_auth.py h… (#7797)

2025-01-15 21:52:45 -08:00

test_db_schema_migration.py

Fix CI: Revert security scan changes and add GitGuardian ignore rules (#18358)

2025-12-22 17:03:53 -08:00

test_default_end_user_budget_simple.py

[AI Gateway] - End User Budgets - Allow pointing max_end_user budget to an id, so the default ID applies to all end users (#16456)

2025-11-11 08:20:13 -08:00

test_deployed_proxy_keygen.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_e2e_pod_lock_manager.py

fix(tests): skip more CI tests requiring external DB/Redis connections

2026-02-20 11:49:38 -03:00

test_get_favicon.py

feat(proxy): add custom favicon support\n\nAdd ability to configure a custom favicon for the litellm proxy UI.\n\n- Add favicon_url field to UIThemeConfig model\n- Add LITELLM_FAVICON_URL env var support\n- Add /get_favicon endpoint to serve custom favicons\n- Update ThemeContext to dynamically set favicon\n- Add favicon URL input to UI theme settings page\n- Add comprehensive tests\n\nCloses #8323 (#21653)

2026-02-21 00:46:51 -08:00

test_get_image.py

fix: optimize logo fetching and resolve mcp import blockers (#19719)

2026-01-25 23:08:16 -08:00

test_google_endpoint_routing.py

Support model names with slashes on Gemini endpoints (#17743)

2025-12-09 18:40:51 -08:00

test_google_gemini_proxy_request.py

Fix: Send Gemini API key via x-goog-api-key header with custom api_base (#16085)

2025-11-05 07:12:13 -08:00

test_jwt.py

fix(tests): skip additional CI tests requiring external DB connection

2026-02-20 11:35:43 -03:00

test_key_generate_dynamodb.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_key_generate_prisma.py

fix(tests): skip all remaining prisma DB tests in test_key_generate_prisma.py

2026-02-20 12:36:59 -03:00

test_models_fallback_endpoint.py

feat: extended /v1/models endpoint, now it returns with fallbacks on demand (#12811)

2025-07-22 23:16:46 -07:00

test_prisma_client_backoff_retry.py

fix(tests): mock prisma.Prisma in backoff retry tests to avoid 'prisma generate'

2026-02-17 19:29:20 -03:00

test_project_endpoints_prisma.py

fix(tests): skip CI tests requiring external services (DB, API keys)

2026-02-20 11:28:42 -03:00

test_prompt_test_endpoint.py

[Feat] UI - Prompt Management - Allow testing prompts with Chat UI (#16898)

2025-11-21 08:53:18 -08:00

test_proxy_config_unit_test.py

fix: enable JSON logging via configuration and add regression test

2026-01-13 09:38:19 -07:00

test_proxy_custom_auth.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_proxy_custom_logger.py

fix test_chat_completion

2026-02-17 20:26:28 +05:30

test_proxy_encrypt_decrypt.py

test: fix test

2025-07-27 09:52:22 -07:00

test_proxy_exception_mapping.py

[Perf] Embeddings: Use router's O(1) lookup and shared sessions (#16344)

2025-11-14 09:21:45 -08:00

test_proxy_gunicorn.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_proxy_pass_user_config.py

fix test_chat_completion

2026-02-17 20:26:28 +05:30

test_proxy_reject_logging.py

[Security Bug Fix] Ensure only LLM API route fails get logged on Langfuse (and other loggers) (#12308)

2025-07-04 14:42:42 -07:00

test_proxy_routes.py

tests and route permissions (#21508)

2026-02-18 16:58:38 -08:00

test_proxy_server_caching.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_proxy_server_keys.py

fix tests

2025-10-25 10:19:24 -07:00

test_proxy_server_langfuse.py

(Security fix) - Upgrade to fastapi==0.115.5 (#7447)

2024-12-28 17:08:19 -08:00

test_proxy_server_spend.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_proxy_server.py

feat(proxy): limit concurrent health checks with health_check_concurrency (#20584)

2026-02-24 08:16:59 -08:00

test_proxy_setting_guardrails.py

fix(lakera-guardrail): use os.environ.get() to avoid KeyError on missing LAKERA_API_KEY

2026-02-17 19:30:22 -03:00

test_proxy_token_counter.py

fix(tests): use unconditional skip for vertex/gemini token counting test

2026-02-20 11:36:54 -03:00

test_proxy_utils.py

fix(tests): add missing start_db_health_watchdog_task mock (#21804)

2026-02-21 12:31:52 -08:00

test_realtime_cache.py

[Perf] Fix bottlenecks degrading realtime endpoint performance (#16670)

2025-11-22 10:01:02 -08:00

test_response_polling_handler.py

fix: complete asyncio.iscoroutinefunction deprecation fix across codebase

2026-02-17 18:20:44 -03:00

test_search_api_logging.py

fix(tests): skip test_search_api_logging_and_cost_tracking - requires Prisma DB

2026-02-20 13:19:01 -03:00

test_server_root_path.py

fix: server rooth path (#19790)

2026-01-26 09:48:06 -08:00

test_skills_db.py

fix(tests): skip CI tests requiring external services (DB, API keys)

2026-02-20 11:28:42 -03:00

test_ui_path_detection.py

fix: Add LITELLM_UI_PATH and LITELLM_ASSETS_PATH for read-only filesystem support (#20492)

2026-02-12 19:39:04 +05:30

test_unit_test_max_model_budget_limiter.py

fix conflicts with main- (this PR is from upstream/main)

2026-02-07 03:10:53 +05:30

test_unit_test_proxy_hooks.py

[Fix] CI/CD – Clean Up Performance PR Changes & others (#17838)

2025-12-11 12:50:03 -08:00

test_update_spend.py

[Fix] CI/CD – Clean Up Performance PR Changes & others (#17838)

2025-12-11 12:50:03 -08:00

test_user_api_key_auth.py

Fix mock target for enterprise license check

2026-02-17 21:25:00 -03:00

test_zero_cost_model_budget_bypass.py

Add support for 0 cost models

2026-02-02 13:29:37 +05:30

vertex_key.json

ci/cd update vertex acct

2025-01-05 13:43:32 -08:00