From 8b87eeda859292fbbcbaefe6ebf8d8b65bcf5bcf Mon Sep 17 00:00:00 2001 From: ishaan-jaff Date: Tue, 8 Aug 2023 13:55:27 -0700 Subject: [PATCH] add docs --- docs/supported.md | 13 +++++++++++++ 1 file changed, 13 insertions(+) diff --git a/docs/supported.md b/docs/supported.md index 692a55e7dc..0eb2ec3d15 100644 --- a/docs/supported.md +++ b/docs/supported.md @@ -36,3 +36,16 @@ | claude-instant-1 | `completion('claude-instant-1', messages)` | `os.environ['ANTHROPIC_API_KEY']` | | claude-v2 | `completion('claude-v2', messages)` | `os.environ['ANTHROPIC_API_KEY']` | +### Hugging Face Inference API +All `text2text-generation`, `text-generation` are supported by liteLLM +In order to use models on hugging face inference: +* copy the `model repo` from hugging face and set it as the `model` parameter in the completion call. +* set `hugging_face` to `True` + +| Model Name | Function Call | Required OS Variables | +|------------------|--------------------------------------------|--------------------------------------| +| stabilityai/stablecode-completion-alpha-3b-4k | `completion(model="stabilityai/stablecode-completion-alpha-3b-4k", messages=messages, hugging_face=True) | `os.environ['HF_TOKEN']` | +| google/flan-t5-xxl | `completion(model="google/flan-t5-xxl", messages=messages, hugging_face=True) | `os.environ['HF_TOKEN']` | + + +