2 Commits

Author	SHA1	Message	Date
Krish Dholakia	d895ae827d	Litellm batch api background cost calc (#12125) ... * feat(check_batch_cost.py): emit spend log on successful request ensures cost tracked for batch requests * feat(proxy_server.py): add background job to poll completed batch jobs used for calculating cost for batch jobs * fix(proxy_server.py): run batch cost tracking job every hour batch jobs take time to complete, no need to run every few seconds * feat(proxy_server.py): run batch cost tracking job every hour	2025-06-27 21:46:25 -07:00
Krrish Dholakia	c3857e60f2	Store batch output file id in DB + Store batch file status in DB + (experimental) BATCH API COST TRACKING	2025-06-25 22:41:22 -07:00