Krish DholakiaandGitHub 4c7a988454 Guardrail API V2 - user api key metadata, session id, specify input type (request/response), image support (#17338) ...

* refactor(generic_guardrail_api.py): refactor to update to new guardrail api logic

* refactor: refactor llm api integrations to support passing in text as a list[str] instead of one at a time

* refactor: fix linting errors

* refactor: pass request type to guardrail api

allows request vs. response processing to occur

* feat: pass user api key dict information to the guardrail api

* fix: pass user api key dict information to the guardrail api

* feat: pass litellm call id + trace id, if present

* docs: update docs

2025-12-01 20:11:58 -08:00

..

benchmark

(code quality) run ruff rule to ban unused imports (#7313)

2024-12-19 12:33:42 -08:00

codellama-server

(code quality) run ruff rule to ban unused imports (#7313)

2024-12-19 12:33:42 -08:00

community-resources

(code quality) run ruff rule to ban unused imports (#7313)

2024-12-19 12:33:42 -08:00

litellm_proxy_server

[Feat] Add Custom Secret Manager - Allow users to define and write a custom secret manager (#16297)

2025-11-05 17:20:26 -08:00

litellm_router

(code quality) run ruff rule to ban unused imports (#7313)

2024-12-19 12:33:42 -08:00

litellm_router_load_test

fix: use fastuuid helper (#14903)

2025-09-25 15:47:01 -07:00

litellm-ollama-docker-image

build(deps): bump litellm in /cookbook/litellm-ollama-docker-image

2025-03-20 21:03:29 +00:00

logging_observability

docs litellm x langfuse cookbook

2025-02-14 09:31:51 -08:00

misc

docs fix

2025-11-22 14:02:14 -08:00

mock_guardrail_server

Guardrail API V2 - user api key metadata, session id, specify input type (request/response), image support (#17338)

2025-12-01 20:11:58 -08:00

Benchmarking_LLMs_by_use_case.ipynb

(code quality) run ruff rule to ban unused imports (#7313)

2024-12-19 12:33:42 -08:00

Claude_(Anthropic)_with_Streaming_liteLLM_Examples.ipynb

(docs) update how to use litellm streaming

2023-11-21 11:19:32 -08:00

Evaluating_LLMs.ipynb

(code quality) run ruff rule to ban unused imports (#7313)

2024-12-19 12:33:42 -08:00

google_adk_litellm_tutorial.ipynb

[Docs] Using litellm with Google ADK (#10777)

2025-05-12 16:41:49 -07:00

liteLLM_A121_Jurrasic_example.ipynb

add AI21 tutorial

2023-08-22 20:34:18 -07:00

LiteLLM_Azure_and_OpenAI_example.ipynb

(code quality) run ruff rule to ban unused imports (#7313)

2024-12-19 12:33:42 -08:00

liteLLM_Baseten.ipynb

Update Baseten LiteLLM integration

2025-08-19 12:21:05 -07:00

LiteLLM_batch_completion.ipynb

(code quality) run ruff rule to ban unused imports (#7313)

2024-12-19 12:33:42 -08:00

LiteLLM_Bedrock.ipynb

(docs) bedrock cookbook

2023-11-06 18:00:52 -08:00

liteLLM_clarifai_Demo.ipynb

Clarifai - Added streaming and async completion support

2024-05-03 14:03:38 +00:00

LiteLLM_CometAPI.ipynb

bump openai 2.8.0

2025-11-19 17:47:18 -08:00

LiteLLM_Comparing_LLMs.ipynb

(code quality) run ruff rule to ban unused imports (#7313)

2024-12-19 12:33:42 -08:00

LiteLLM_Completion_Cost.ipynb

add completion costs notebook

2023-09-06 18:43:09 -07:00

liteLLM_function_calling.ipynb

(code quality) run ruff rule to ban unused imports (#7313)

2024-12-19 12:33:42 -08:00

liteLLM_Getting_Started.ipynb

getting started cookbook litellm

2023-09-23 10:38:59 -07:00

LiteLLM_HuggingFace.ipynb

fix img URL for tests

2025-11-22 09:41:15 -08:00

liteLLM_IBM_Watsonx.ipynb

(docs) updated watsonx cookbook

2024-04-24 17:19:02 +02:00

liteLLM_Langchain_Demo.ipynb

(code quality) run ruff rule to ban unused imports (#7313)

2024-12-19 12:33:42 -08:00

litellm_model_fallback.ipynb

(code quality) run ruff rule to ban unused imports (#7313)

2024-12-19 12:33:42 -08:00

LiteLLM_NovitaAI_Cookbook.ipynb

Add new model provider Novita AI (#7582) (#9527)

2025-05-12 21:49:30 -07:00

liteLLM_Ollama.ipynb

docs

2023-09-21 12:33:39 -07:00

LiteLLM_OpenRouter.ipynb

Add new model provider Novita AI (#7582) (#9527)

2025-05-12 21:49:30 -07:00

LiteLLM_Petals.ipynb

cookbook petals

2023-09-20 09:34:33 -07:00

LiteLLM_PromptLayer.ipynb

edit promptlayer cookbook

2023-08-26 13:37:08 -07:00

liteLLM_Replicate_Demo.ipynb

fix replicate docs

2023-09-06 12:35:50 -07:00

liteLLM_Streaming_Demo.ipynb

add streaming example cookbook

2023-08-09 14:29:23 -07:00

litellm_test_multiple_llm_demo.ipynb

Rename Untitled155.ipynb to litellm_test_multiple_llm_demo.ipynb

2023-08-10 18:56:26 -07:00

litellm_Test_Multiple_Providers.ipynb

(code quality) run ruff rule to ban unused imports (#7313)

2024-12-19 12:33:42 -08:00

LiteLLM_User_Based_Rate_Limits.ipynb

add notebook on using litellm budget manager

2023-09-12 20:53:55 -07:00

liteLLM_VertextAI_Example.ipynb

(code quality) run ruff rule to ban unused imports (#7313)

2024-12-19 12:33:42 -08:00

Migrating_to_LiteLLM_Proxy_from_OpenAI_Azure_OpenAI.ipynb

build: cookbook on migrating to litellm proxy from openai/azure sdk

2024-07-27 16:09:50 -07:00

mlflow_langchain_tracing_litellm_proxy.ipynb

(code quality) run ruff rule to ban unused imports (#7313)

2024-12-19 12:33:42 -08:00

Parallel_function_calling.ipynb

(docs) parallel function calling with Azure OpenAI

2023-11-18 14:36:56 -08:00

Proxy_Batch_Users.ipynb

(code quality) run ruff rule to ban unused imports (#7313)

2024-12-19 12:33:42 -08:00

result.html

(docs) add embedding() profile

2023-11-30 19:04:51 -08:00

TogetherAI_liteLLM.ipynb

(code quality) run ruff rule to ban unused imports (#7313)

2024-12-19 12:33:42 -08:00

Using_Nemo_Guardrails_with_LiteLLM_Server.ipynb

(code quality) run ruff rule to ban unused imports (#7313)

2024-12-19 12:33:42 -08:00

veo_video_generation.py

[Feat] Allow using Veo Video Generation through LiteLLM Pass through routes (#14228)

2025-09-03 18:25:43 -07:00

VLLM_Model_Testing.ipynb

Add files via upload

2023-09-06 19:27:06 -07:00