diff --git a/docs/supported.md b/docs/supported.md index 692a55e7dc..0eb2ec3d15 100644 --- a/docs/supported.md +++ b/docs/supported.md @@ -36,3 +36,16 @@ | claude-instant-1 | `completion('claude-instant-1', messages)` | `os.environ['ANTHROPIC_API_KEY']` | | claude-v2 | `completion('claude-v2', messages)` | `os.environ['ANTHROPIC_API_KEY']` | +### Hugging Face Inference API +All `text2text-generation`, `text-generation` are supported by liteLLM +In order to use models on hugging face inference: +* copy the `model repo` from hugging face and set it as the `model` parameter in the completion call. +* set `hugging_face` to `True` + +| Model Name | Function Call | Required OS Variables | +|------------------|--------------------------------------------|--------------------------------------| +| stabilityai/stablecode-completion-alpha-3b-4k | `completion(model="stabilityai/stablecode-completion-alpha-3b-4k", messages=messages, hugging_face=True) | `os.environ['HF_TOKEN']` | +| google/flan-t5-xxl | `completion(model="google/flan-t5-xxl", messages=messages, hugging_face=True) | `os.environ['HF_TOKEN']` | + + +