tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-11 01:05:19 +00:00
Code Issues Packages Projects Releases Wiki Activity

modified the exception mapping table

Browse Source
This commit is contained in:
pratik2315
2023-09-09 17:41:44 +05:30
parent 5ca8b23e22
commit bb473beceb
1 changed files with 33 additions and 32 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/my-website/docs/exception_mapping.md
+33 -32
View File
@@ -40,39 +40,40 @@ To see how it's implemented - [check out the code](https://github.com/BerriAI/li
Base case - we return the original exception.
| LLM Provider | Initial Status Code / Initial Error Message | Returned Exception | Returned Status Code |
|----------------------|------------------------|-----------------|-----------------|
| Anthropic | prompt is too long | ContextWindowExceededError | 400 |
| Anthropic | 401 | AuthenticationError | 401 |
| Anthropic | Could not resolve authentication method. Expected either api_key or auth_token to be set. | AuthenticationError | 401 |
| Anthropic | 400 | InvalidRequestError | 400 |
| Anthropic | 429 | RateLimitError | 429 |
| OpenAI | This model's maximum context length is | ContextWindowExceededError | 400 |
| Replicate | input is too long | ContextWindowExceededError | 400 |
| Replicate | Incorrect authentication token | AuthenticationError | 401 |
| Replicate | ModelError | InvalidRequestError | 400 |
| Replicate | Request was throttled | RateLimitError | 429 |
| Replicate | ReplicateError | ServiceUnavailableError | 500 |
| Cohere | invalid api token | AuthenticationError | 401 |
| Cohere | too many tokens | ContextWindowExceededError | 400 |
| Cohere | CohereConnectionError | RateLimitError | 429 |
| Huggingface | length limit exceeded | ContextWindowExceededError | 400 |
| Huggingface | 400 | InvalidRequestError | 400 |
| Huggingface | 401 | AuthenticationError | 401 |
| Huggingface | 429 | RateLimitError | 429 |
| Openrouter | 413 | ContextWindowExceededError | 400 |
| Openrouter | 401 | AuthenticationError | 401 |
| Openrouter | 429 | RateLimitError | 429 |
| AI21 | Prompt has too many tokens | ContextWindowExceededError | 400 |
| AI21 | 422 | InvalidRequestError | 400 |
| AI21 | 401 | AuthenticationError | 401 |
| AI21 | 429 | RateLimitError | 429 |
| TogetherAI | inputs` tokens + `max_new_tokens` must be <= | ContextWindowExceededError | 400 |
| TogetherAI | INVALID_ARGUMENT | InvalidRequestError | 400 |
| TogetherAI | "error_type": "validation" | InvalidRequestError | 400 |
| TogetherAI | invalid private key | AuthenticationError | 401 |
| TogetherAI | 429 | RateLimitError | 429 |
| LLM Provider | Returned Status Code |
| ------------- | --------------------- |
| Anthropic | 400 |
| Anthropic | 401 |
| Anthropic | 401 |
| Anthropic | 400 |
| Anthropic | 429 |
| OpenAI | 400 |
| Replicate | 400 |
| Replicate | 401 |
| Replicate | 400 |
| Replicate | 429 |
| Replicate | 500 |
| Cohere | 401 |
| Cohere | 400 |
| Cohere | 429 |
| Huggingface | 400 |
| Huggingface | 400 |
| Huggingface | 401 |
| Huggingface | 429 |
| Openrouter | 400 |
| Openrouter | 401 |
| Openrouter | 429 |
| AI21 | 400 |
| AI21 | 400 |
| AI21 | 401 |
| AI21 | 429 |
| TogetherAI | 400 |
| TogetherAI | 400 |
| TogetherAI | 400 |
| TogetherAI | 401 |
| TogetherAI | 429 |
> For a deeper understanding of these exceptions, you can check out [this](https://github.com/BerriAI/litellm/blob/d7e58d13bf9ba9edbab2ab2f096f3de7547f35fa/litellm/utils.py#L1544) implementation for additional insights.
The `ContextWindowExceededError` is a sub-class of `InvalidRequestError`. It was introduced to provide more granularity for exception-handling scenarios. Please refer to [this issue to learn more](https://github.com/BerriAI/litellm/issues/228).