mirror of
https://github.com/tiennm99/litellm.git
synced 2026-08-08 14:22:08 +00:00
docs(docs): cleanup
This commit is contained in:
@@ -53,6 +53,9 @@ By default, LiteLLM raises an exception if the openai param being passed in isn'
|
||||
|
||||
To drop the param instead, set `litellm.drop_params = True`.
|
||||
|
||||
**For function calling:**
|
||||
|
||||
Add to prompt for non-openai models, set: `litellm.add_function_to_prompt = True`.
|
||||
:::
|
||||
|
||||
## Provider-specific Params
|
||||
|
||||
@@ -30,10 +30,9 @@ In order to use litellm to call a hosted vllm server add the following to your c
|
||||
import litellm
|
||||
|
||||
response = completion(
|
||||
model="facebook/opt-125m", # pass the vllm model name
|
||||
model="openai/facebook/opt-125m", # pass the vllm model name
|
||||
messages=messages,
|
||||
api_base="https://hosted-vllm-api.co",
|
||||
custom_llm_provider="openai",
|
||||
temperature=0.2,
|
||||
max_tokens=80)
|
||||
|
||||
|
||||
Reference in New Issue
Block a user