Ishaan Jaff 1bb9e1bde8 [Feat] Add vllm batch+files API support (#15823) ...

* add OPENAI_COMPATIBLE_BATCH_AND_FILES_PROVIDERS

* fix use OPENAI_COMPATIBLE_BATCH_AND_FILES_PROVIDERS

* add _get_batch_job_total_usage_from_file_content

* fixes for vLLM + 12 labs async invoke

* fix: vLLM Batch APIs

* afile_retrieve

* test_hosted_vllm_full_workflow

* fix SERVER_URL for test

2025-12-02 08:41:50 -08:00

..

batch_job_results_furniture.jsonl

(feat) Add cost tracking for /batches requests OpenAI (#7384)

2024-12-23 17:47:26 -08:00

batch_small.jsonl

[Feat] Add support for Batch API Rate limiting - PR1 adds support for input based rate limits (#16075)

2025-10-29 18:28:52 -07:00

bedrock_batch_completions.jsonl

[Feat] Bedrock Batches - Working e2e flow to upload file + create batch (#14518)

2025-09-12 15:37:09 -07:00

conftest.py

[Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS (#13905)

2025-08-23 13:13:23 -07:00

openai_batch_completions.jsonl

(feat) Add cost tracking for /batches requests OpenAI (#7384)

2024-12-23 17:47:26 -08:00

pathrise-convert-1606954137718.json

use pathrise-convert-1606954137718

2025-01-05 14:14:43 -08:00

test_batch_rate_limits.py

[Feat] Add support for Batch API Rate limiting - PR1 adds support for input based rate limits (#16075)

2025-10-29 18:28:52 -07:00

test_batches_logging_unit_tests.py

Store batch output file id in DB + Store batch file status in DB + (experimental) BATCH API COST TRACKING

2025-06-25 22:41:22 -07:00

test_bedrock_files_and_batches.py

[Feat] Bedrock Batches - Add support for custom KMS encryption keys in Bedrock Batch operations (#16662)

2025-11-14 16:00:43 -08:00

test_fine_tuning_api.py

Litellm managed file updates combined (#11040)

2025-05-22 17:20:41 -07:00

test_hosted_vllm_batches_and_files.py

[Feat] Add vllm batch+files API support (#15823)

2025-12-02 08:41:50 -08:00

test_openai_batches_and_files.py

new mocked

2025-11-25 17:28:02 +05:30

vertex_batch_completions.jsonl

(feat) Add cost tracking for /batches requests OpenAI (#7384)

2024-12-23 17:47:26 -08:00