Xianzong Xie 1c3c12bb1b refactor: move background_streaming_task to separate module ...

- Create new background_streaming.py in response_polling/
- Update endpoints.py to import from new location
- Update __init__.py to export background_streaming_task
- Add tests for module imports and structure

Committed-By-Agent: cursor

2025-12-03 22:50:26 -08:00

..

example_config_yaml

fix tests

2025-10-25 10:19:24 -07:00

test_configs

fix tests

2025-10-25 10:19:24 -07:00

test_model_response_typing

…

adroit-crow-413218-bc47f303efc9.json

…

azure_fine_tune.jsonl

…

batch_job_results_furniture.jsonl

…

conftest copy.py

…

conftest.py

…

data_map.txt

…

eagle.wav

…

gettysburg.wav

…

large_text.py

…

messages_with_counts.py

…

model_cost.json

…

openai_batch_completions_router.jsonl

…

openai_batch_completions.jsonl

…

speech_vertex.mp3

…

test_aproxy_startup.py

…

test_audit_logs_proxy.py

fix: use fastuuid helper (#14903)

2025-09-25 15:47:01 -07:00

test_auth_checks.py

[Performance] RPS Improvement +500 RPS when sending the user field (#14616)

2025-09-16 16:18:23 -07:00

test_banned_keyword_list.py

…

test_custom_callback_input.py

fix: use fastuuid helper (#14903)

2025-09-25 15:47:01 -07:00

test_custom_logger_s3_gcs.py

…

test_custom_tokenizer_bug.py

fix(token-counter): extract model_info from deployment for custom_tokenizer (#15657) (#15680)

2025-10-17 19:38:45 -07:00

test_db_schema_changes.py

…

test_db_schema_migration.py

Revert "Security fix - prevent proxy_admin_viewer from modifying other user's credentials + remove hardcoded sensitive keys from test repo" (#14362)

2025-09-08 18:40:54 -07:00

test_default_end_user_budget_simple.py

[AI Gateway] - End User Budgets - Allow pointing max_end_user budget to an id, so the default ID applies to all end users (#16456)

2025-11-11 08:20:13 -08:00

test_deployed_proxy_keygen.py

…

test_e2e_pod_lock_manager.py

fix: use fastuuid helper (#14903)

2025-09-25 15:47:01 -07:00

test_google_gemini_proxy_request.py

Fix: Send Gemini API key via x-goog-api-key header with custom api_base (#16085)

2025-11-05 07:12:13 -08:00

test_jwt.py

test_end_user_jwt_auth

2025-10-02 18:48:11 -07:00

test_key_generate_dynamodb.py

…

test_key_generate_prisma.py

Litellm ci cd fixes 2 (#16693)

2025-11-15 14:12:44 -08:00

test_models_fallback_endpoint.py

…

test_prisma_client_backoff_retry.py

fix: prisma client state retries (#14925)

2025-09-25 21:54:00 -07:00

test_prompt_test_endpoint.py

[Feat] UI - Prompt Management - Allow testing prompts with Chat UI (#16898)

2025-11-21 08:53:18 -08:00

test_proxy_config_unit_test.py

…

test_proxy_custom_auth.py

…

test_proxy_custom_logger.py

test_embedding

2025-09-27 16:57:27 -07:00

test_proxy_encrypt_decrypt.py

…

test_proxy_exception_mapping.py

[Perf] Embeddings: Use router's O(1) lookup and shared sessions (#16344)

2025-11-14 09:21:45 -08:00

test_proxy_gunicorn.py

…

test_proxy_pass_user_config.py

fix tests

2025-10-25 10:19:24 -07:00

test_proxy_reject_logging.py

…

test_proxy_routes.py

…

test_proxy_server_caching.py

…

test_proxy_server_keys.py

fix tests

2025-10-25 10:19:24 -07:00

test_proxy_server_langfuse.py

…

test_proxy_server_spend.py

…

test_proxy_server.py

Fix 500 error for malformed request

2025-12-01 10:21:44 +05:30

test_proxy_setting_guardrails.py

…

test_proxy_token_counter.py

test_vertex_ai_partner_models_token_counting_endpoint

2025-11-26 11:37:55 -08:00

test_proxy_utils.py

feat: add parallel execution handling in during_call_hook (#16279)

2025-11-05 18:35:25 -08:00

test_realtime_cache.py

[Perf] Fix bottlenecks degrading realtime endpoint performance (#16670)

2025-11-22 10:01:02 -08:00

test_response_polling_handler.py

refactor: move background_streaming_task to separate module

2025-12-03 22:50:26 -08:00

test_search_api_logging.py

Add cost tracking and logging support

2025-11-25 17:14:59 +05:30

test_unit_test_max_model_budget_limiter.py

…

test_unit_test_proxy_hooks.py

…

test_update_spend.py

attempt to avoid/minimize deadlocks (#15281)

2025-10-24 12:22:38 -07:00

test_user_api_key_auth.py

fix: add missing mock attributes in websocket and realtime tests (#16974)

2025-11-22 10:44:23 -08:00

vertex_key.json

…