 Ishaan Jaff
|
aea78b8d1a
|
[Feat] Add support for Batch API Rate limiting - PR1 adds support for input based rate limits (#16075)
* add count_input_file_usage
* add count_input_file_usage
* fix count_input_file_usage
* _get_batch_job_input_file_usage
* fixes imports
* use _get_batch_job_input_file_usage
* test_batch_rate_limits
* add _check_and_increment_batch_counters
* add get_rate_limiter_for_call_type
* test_batch_rate_limit_multiple_requests
* fixes for batch limits
* fix linting
* fix MYPY linting
|
2025-10-29 18:28:52 -07:00 |
|