mirror of
https://github.com/tiennm99/litellm.git
synced 2026-06-25 05:07:03 +00:00
Krish Dholakia
d895ae827d
* feat(check_batch_cost.py): emit spend log on successful request ensures cost tracked for batch requests * feat(proxy_server.py): add background job to poll completed batch jobs used for calculating cost for batch jobs * fix(proxy_server.py): run batch cost tracking job every hour batch jobs take time to complete, no need to run every few seconds * feat(proxy_server.py): run batch cost tracking job every hour
LiteLLM Proxy Enterprise Features - Readme
Overview
This directory contains enterprise features used on the LiteLLM proxy.
Format
Create a file for every group of endpoints (e.g. key_management_endpoints.py, user_management_endpoints.py, etc.)
If there is a broader semantic group of endpoints, create a folder for that group (e.g. management_endpoints, auth_endpoints, etc.)