Files
litellm/cookbook/litellm_model_fallback.ipynb
T
Ishaan JaffandGitHub c7f14e936a (code quality) run ruff rule to ban unused imports (#7313)
* remove unused imports

* fix AmazonConverseConfig

* fix test

* fix import

* ruff check fixes

* test fixes

* fix testing

* fix imports
2024-12-19 12:33:42 -08:00

1.0 KiB
Vendored

In [ ]:
!pip install litellm
In [ ]:
from litellm import completion

model_fallback_list = ["claude-instant-1", "gpt-3.5-turbo", "chatgpt-test"]

user_message = "Hello, how are you?"
messages = [{ "content": user_message,"role": "user"}]

for model in model_fallback_list:
  try:
      response = completion(model=model, messages=messages)
  except Exception:
      print(f"error occurred: {traceback.format_exc()}")