Krish Dholakia d895ae827d Litellm batch api background cost calc (#12125) ...

* feat(check_batch_cost.py): emit spend log on successful request

ensures cost tracked for batch requests

* feat(proxy_server.py): add background job to poll completed batch jobs

used for calculating cost for batch jobs

* fix(proxy_server.py): run batch cost tracking job every hour

batch jobs take time to complete, no need to run every few seconds

* feat(proxy_server.py): run batch cost tracking job every hour

2025-06-27 21:46:25 -07:00

..

check_batch_cost.py

Litellm batch api background cost calc (#12125)

2025-06-27 21:46:25 -07:00