diff --git a/docs/my-website/docs/providers/vertex.md b/docs/my-website/docs/providers/vertex.md index 4541752f39..d44410ffc8 100644 --- a/docs/my-website/docs/providers/vertex.md +++ b/docs/my-website/docs/providers/vertex.md @@ -1,4 +1,4 @@ -# VertexAI - Google [Gemini] +# VertexAI - Google [Gemini, Model Garden] Open In Colab @@ -67,16 +67,39 @@ os.environ["VERTEXAI_LOCATION"] = "us-central1 # Your Location # set directly on module litellm.vertex_location = "us-central1 # Your Location ``` +## Model Garden +| Model Name | Function Call | +|------------------|--------------------------------------| +| llama2 | `completion('vertex_ai/', messages)` | + +#### Using Model Garden + +```python +from litellm import completion +import os + +## set ENV variables +os.environ["VERTEXAI_PROJECT"] = "hardy-device-38811" +os.environ["VERTEXAI_LOCATION"] = "us-central1" + +response = completion( + model="vertex_ai/", + messages=[{ "content": "Hello, how are you?","role": "user"}] +) +``` ## Gemini Pro | Model Name | Function Call | |------------------|--------------------------------------| -| gemini-pro | `completion('gemini-pro', messages)` | +| gemini-pro | `completion('gemini-pro', messages)`, `completion('vertex_ai/gemini-pro', messages)` | ## Gemini Pro Vision | Model Name | Function Call | |------------------|--------------------------------------| -| gemini-pro-vision | `completion('gemini-pro-vision', messages)` | +| gemini-pro-vision | `completion('gemini-pro-vision', messages)`, `completion('vertex_ai/gemini-pro-vision', messages)`| + + + #### Using Gemini Pro Vision @@ -114,6 +137,7 @@ response = litellm.completion( print(response) ``` + ## Chat Models | Model Name | Function Call | |------------------|--------------------------------------|