add vllm batches

This commit is contained in:
Ishaan Jaffer
2025-12-14 12:36:07 -08:00
parent d8fc5c3a37
commit c79e0c165f
2 changed files with 10 additions and 7 deletions
+2 -1
View File
@@ -7,7 +7,7 @@ Covers Batches, Files
| Feature | Supported | Notes |
|-------|-------|-------|
| Supported Providers | OpenAI, Azure, Vertex, Bedrock | - |
| Supported Providers | OpenAI, Azure, Vertex, Bedrock, vLLM | - |
| ✨ Cost Tracking | ✅ | LiteLLM Enterprise only |
| Logging | ✅ | Works across all logging integrations |
@@ -430,6 +430,7 @@ All batch and file endpoints support model-based routing:
### [OpenAI](#quick-start)
### [Vertex AI](./providers/vertex#batch-apis)
### [Bedrock](./providers/bedrock_batches)
### [vLLM](./providers/vllm_batches)
## How Cost Tracking for Batches API Works
+8 -6
View File
@@ -892,13 +892,14 @@
"chat_completions": true,
"messages": true,
"responses": true,
"embeddings": false,
"embeddings": true,
"image_generations": false,
"audio_transcriptions": false,
"audio_speech": false,
"moderations": false,
"batches": false,
"rerank": false,
"batches": true,
"files": true,
"rerank": true,
"a2a": true
}
},
@@ -1766,13 +1767,14 @@
"chat_completions": true,
"messages": true,
"responses": true,
"embeddings": false,
"embeddings": true,
"image_generations": false,
"audio_transcriptions": false,
"audio_speech": false,
"moderations": false,
"batches": false,
"rerank": false,
"batches": true,
"files": true,
"rerank": true,
"a2a": true
}
},