Ishaan Jaff aea78b8d1a [Feat] Add support for Batch API Rate limiting - PR1 adds support for input based rate limits (#16075) ...

* add count_input_file_usage

* add count_input_file_usage

* fix count_input_file_usage

* _get_batch_job_input_file_usage

* fixes imports

* use _get_batch_job_input_file_usage

* test_batch_rate_limits

* add _check_and_increment_batch_counters

* add get_rate_limiter_for_call_type

* test_batch_rate_limit_multiple_requests

* fixes for batch limits

* fix linting

* fix MYPY linting

2025-10-29 18:28:52 -07:00

..

batch_job_results_furniture.jsonl

…

batch_small.jsonl

[Feat] Add support for Batch API Rate limiting - PR1 adds support for input based rate limits (#16075)

2025-10-29 18:28:52 -07:00

bedrock_batch_completions.jsonl

[Feat] Bedrock Batches - Working e2e flow to upload file + create batch (#14518)

2025-09-12 15:37:09 -07:00

conftest.py

[Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS (#13905)

2025-08-23 13:13:23 -07:00

openai_batch_completions.jsonl

…

pathrise-convert-1606954137718.json

…

test_batch_rate_limits.py

[Feat] Add support for Batch API Rate limiting - PR1 adds support for input based rate limits (#16075)

2025-10-29 18:28:52 -07:00

test_batches_logging_unit_tests.py

Store batch output file id in DB + Store batch file status in DB + (experimental) BATCH API COST TRACKING

2025-06-25 22:41:22 -07:00

test_bedrock_files_and_batches.py

[Feat] Batches - Add bedrock retrieve endpoint support (#14618)

2025-09-16 19:19:02 -07:00

test_fine_tuning_api.py

Litellm managed file updates combined (#11040)

2025-05-22 17:20:41 -07:00

test_openai_batches_and_files.py

openai.ConflictError

2025-07-12 17:07:21 -07:00

vertex_batch_completions.jsonl

…