mirror of
https://github.com/tiennm99/litellm.git
synced 2026-08-23 22:27:10 +00:00
add vllm batches
This commit is contained in:
@@ -7,7 +7,7 @@ Covers Batches, Files
|
||||
|
||||
| Feature | Supported | Notes |
|
||||
|-------|-------|-------|
|
||||
| Supported Providers | OpenAI, Azure, Vertex, Bedrock | - |
|
||||
| Supported Providers | OpenAI, Azure, Vertex, Bedrock, vLLM | - |
|
||||
| ✨ Cost Tracking | ✅ | LiteLLM Enterprise only |
|
||||
| Logging | ✅ | Works across all logging integrations |
|
||||
|
||||
@@ -430,6 +430,7 @@ All batch and file endpoints support model-based routing:
|
||||
### [OpenAI](#quick-start)
|
||||
### [Vertex AI](./providers/vertex#batch-apis)
|
||||
### [Bedrock](./providers/bedrock_batches)
|
||||
### [vLLM](./providers/vllm_batches)
|
||||
|
||||
|
||||
## How Cost Tracking for Batches API Works
|
||||
|
||||
@@ -892,13 +892,14 @@
|
||||
"chat_completions": true,
|
||||
"messages": true,
|
||||
"responses": true,
|
||||
"embeddings": false,
|
||||
"embeddings": true,
|
||||
"image_generations": false,
|
||||
"audio_transcriptions": false,
|
||||
"audio_speech": false,
|
||||
"moderations": false,
|
||||
"batches": false,
|
||||
"rerank": false,
|
||||
"batches": true,
|
||||
"files": true,
|
||||
"rerank": true,
|
||||
"a2a": true
|
||||
}
|
||||
},
|
||||
@@ -1766,13 +1767,14 @@
|
||||
"chat_completions": true,
|
||||
"messages": true,
|
||||
"responses": true,
|
||||
"embeddings": false,
|
||||
"embeddings": true,
|
||||
"image_generations": false,
|
||||
"audio_transcriptions": false,
|
||||
"audio_speech": false,
|
||||
"moderations": false,
|
||||
"batches": false,
|
||||
"rerank": false,
|
||||
"batches": true,
|
||||
"files": true,
|
||||
"rerank": true,
|
||||
"a2a": true
|
||||
}
|
||||
},
|
||||
|
||||
Reference in New Issue
Block a user