mirror of https://github.com/tiennm99/litellm.git synced 2026-06-18 23:40:42 +00:00

Files

T

Ishaan Jaff b032e898c2 (fix) batch_completion fails with bedrock due to extraneous [max_workers] key (#6176 )

* fix batch_completion

* fix import batch completion

* fix batch completion usage

2024-10-12 14:10:24 +05:30

Implementation of `litellm.batch_completion`, `litellm.batch_completion_models`, `litellm.batch_completion_models_all_responses`

LiteLLM Python SDK allows you to:

litellm.batch_completion Batch litellm.completion function for a given model.
litellm.batch_completion_models Send a request to multiple language models concurrently and return the response as soon as one of the models responds.
litellm.batch_completion_models_all_responses Send a request to multiple language models concurrently and return a list of responses from all models that respond.

Implementation of litellm.batch_completion, litellm.batch_completion_models, litellm.batch_completion_models_all_responses