Files
tiennm99 c85f9eaa9b perf(templates): tune litellm defaults for lower RAM/CPU
- num_workers 8 -> 2
- run_gunicorn with max_requests_before_restart 1000
- log_raw_request_response false
- store_prompts_in_spend_logs false
- num_retries 3 -> 1, request_timeout 600 -> 120
- healthcheck interval 5s -> 30s with start_period, urllib instead of requests
2026-06-18 10:13:26 +07:00
..