Krish DholakiaandGitHub 2eaa0079f2 feat(handle_jwt.py): initial commit adding custom RBAC support on jwt… (#8037) ...

* feat(handle_jwt.py): initial commit adding custom RBAC support on jwt auth

allows admin to define user role field and allowed roles which map to 'internal_user' on litellm

* fix(auth_checks.py): ensure user allowed to access model, when calling via personal keys

Fixes https://github.com/BerriAI/litellm/issues/8029

* feat(handle_jwt.py): support role based access with model permission control on proxy

Allows admin to just grant users roles on IDP (e.g. Azure AD/Keycloak) and user can immediately start calling models

* docs(rbac): add docs on rbac for model access control

make it clear how admin can use roles to control model access on proxy

* fix: fix linting errors

* test(test_user_api_key_auth.py): add unit testing to ensure rbac role is correctly enforced

* test(test_user_api_key_auth.py): add more testing

* test(test_users.py): add unit testing to ensure user model access is always checked for new keys

Resolves https://github.com/BerriAI/litellm/issues/8029

* test: fix unit test

* fix(dot_notation_indexing.py): fix typing to work with python 3.8

2025-01-28 16:27:06 -08:00

..

release_notes

ui logs - view messages / responses

2025-01-17 20:20:49 -08:00

1_instance_proxy.png

(docs) Add docs on load testing benchmarks (#7499)

2025-01-01 18:33:20 -08:00

2_instance_proxy.png

(docs) Add docs on load testing benchmarks (#7499)

2025-01-01 18:33:20 -08:00

10_instance_proxy.png

(docs) Add docs on load testing benchmarks (#7499)

2025-01-01 18:33:20 -08:00

add_internal_user.png

docs(self_serve.md): cleanup images

2024-06-05 17:20:57 -07:00

admin_ui_2.png

(docs) hosted ui litellm

2024-01-29 09:43:55 -08:00

admin_ui_disabled.png

LiteLLM Minor Fixes & Improvements (09/17/2024) (#5742)

2024-09-17 23:00:04 -07:00

admin_ui_spend.png

doc - spend tracking with litellm

2024-06-03 13:39:38 -07:00

admin_ui_viewer.png

docs(ui.md): update

2024-02-28 21:25:39 -08:00

alerting_metadata.png

docs(alerting.md): add alerting metadata to docs

2024-06-14 19:04:16 -07:00

alt_dashboard.png

update dashboard tutorial

2023-08-24 15:39:41 -07:00

aporia_post.png

doc aporia_w_litellm

2024-08-19 14:36:55 -07:00

aporia_pre.png

doc aporia_w_litellm

2024-08-19 14:36:55 -07:00

aporia_projs.png

doc aporia_w_litellm

2024-08-19 14:36:55 -07:00

argilla.png

docs(argilla.md): add doc on argilla logging

2024-10-17 22:51:55 -07:00

athina_dashboard.png

Support for Athina logging

2024-02-23 21:49:40 +05:30

azure_blob.png

(feat) Add Azure Blob Storage Logging Integration (#7265)

2024-12-16 22:18:22 -08:00

batches_cost_tracking.png

release notes

2024-12-23 21:38:56 -08:00

bench_llm.png

update tutorial

2023-09-08 06:35:02 -07:00

cloud_run0.png

(docs) proxy server instructions

2023-10-23 10:10:55 -07:00

cloud_run1.png

(docs) set env variables on google cloud run

2023-10-23 09:36:11 -07:00

cloud_run2.png

(docs) set env variables on google cloud run

2023-10-23 09:36:11 -07:00

cloud_run3.png

(docs) set env variables on google cloud run

2023-10-23 09:36:11 -07:00

codellama_formatted_input.png

fix(proxy_server): cleaning up print statements

2023-10-13 20:16:31 -07:00

codellama_input.png

fix(proxy_server): cleaning up print statements

2023-10-13 20:16:31 -07:00

compare_llms.png

docs update

2023-08-31 17:23:46 -07:00

control_model_access_jwt.png

feat(handle_jwt.py): initial commit adding custom RBAC support on jwt… (#8037)

2025-01-28 16:27:06 -08:00

create_budget_modal.png

docs(customers.md): tutorial for setting customer budgets on proxy

2024-05-29 17:46:47 -07:00

create_key_in_team.gif

docs - setting team budgets on ui

2024-06-19 15:04:01 -07:00

create_service_account.png

docs service accounts (#5900)

2024-09-25 15:46:13 -07:00

create_team_gif_good.gif

docs - setting team budgets on ui

2024-06-19 15:04:01 -07:00

custom_root_path.png

docs - run custom path

2024-06-12 14:16:31 -07:00

custom_swagger.png

docs(enterprise.md): add swagger - custom routes + branding to docs

2024-05-17 15:31:02 -07:00

dash_output.png

docs

2023-08-24 09:34:41 -07:00

dashboard_log.png

update dashboard tutorial

2023-08-24 15:39:41 -07:00

dd_small1.png

(docs) litellm + datadog

2024-03-18 17:06:00 -07:00

debug_langfuse.png

docs - show langfuse debug on docs

2024-06-03 12:40:22 -07:00

deploy-to-aws.png

(docs) proxy server deploy to AWS

2023-10-25 17:07:53 -07:00

elastic_otel.png

(docs) OTEL simple proxy

2023-12-01 21:28:46 -08:00

email_notifs.png

docs- email notifs

2024-05-25 18:07:36 -07:00

end_user_enforcement.png

docs(call_hooks.md): show result in docs

2024-03-27 21:04:51 -07:00

favicon.png

Updated the favicon

2023-08-22 14:50:17 +03:00

gcp_acc_1.png

docs(vertex.md): add tutorial for using vertex ai with gcp service account

2024-04-04 21:28:28 -07:00

gcp_acc_2.png

docs(vertex.md): add tutorial for using vertex ai with gcp service account

2024-04-04 21:28:28 -07:00

gcp_acc_3.png

docs(vertex.md): add tutorial for using vertex ai with gcp service account

2024-04-04 21:28:28 -07:00

gcs_bucket.png

docs using gcs

2024-08-01 15:23:17 -07:00

gd_fail.png

✨ (Feat) Log Guardrails run, guardrail response on logging integrations (#7445)

2024-12-27 15:01:56 -08:00

gd_success.png

✨ (Feat) Log Guardrails run, guardrail response on logging integrations (#7445)

2024-12-27 15:01:56 -08:00

gemini_context_caching.png

LiteLLM Minor Fixes & Improvements (12/23/2024) - p3 (#7394)

2024-12-23 22:02:52 -08:00

google_oauth2.png

(docs) hosted ui litellm

2024-01-29 09:43:55 -08:00

google_redirect.png

(docs) hosted ui litellm

2024-01-29 09:43:55 -08:00

grafana_1.png

(feat proxy) add v2 maintained LiteLLM grafana dashboard (#6098)

2024-10-07 18:11:20 +05:30

grafana_2.png

(feat proxy) add v2 maintained LiteLLM grafana dashboard (#6098)

2024-10-07 18:11:20 +05:30

grafana_3.png

(feat proxy) add v2 maintained LiteLLM grafana dashboard (#6098)

2024-10-07 18:11:20 +05:30

hcorp_create_virtual_key.png

(Feat) Hashicorp Secret Manager - Allow storing virtual keys in secret manager (#7549)

2025-01-04 11:35:59 -08:00

hcorp_virtual_key.png

(Feat) Hashicorp Secret Manager - Allow storing virtual keys in secret manager (#7549)

2025-01-04 11:35:59 -08:00

hcorp.png

(Feat) Add support for reading secrets from Hashicorp vault (#7497)

2025-01-01 18:35:05 -08:00

hf_inference_endpoint.png

add huggingface

2023-08-30 16:05:33 -07:00

hosted_debugger_usage_page.png

add to hosted debugger back to docs

2023-09-07 21:11:37 -07:00

instances_vs_rps.png

(docs) Add docs on load testing benchmarks (#7499)

2025-01-01 18:33:20 -08:00

invitation_link.png

docs(self_serve.md): cleanup images

2024-06-05 17:20:57 -07:00

lago_2.png

docs(billing.md): update lago screenshot

2024-05-16 15:30:33 -07:00

lago.jpeg

docs(lago.md): add lago usage-based billing quick-start to docs

2024-05-16 13:24:04 -07:00

langfuse_prmpt_mgmt.png

add img to release notes

2024-12-21 21:24:16 -08:00

langfuse_prompt_id.png

fix(main.py): fix retries being multiplied when using openai sdk (#7221)

2024-12-14 11:56:55 -08:00

langfuse_prompt_management_model_config.png

Litellm dev 2024 12 19 p3 (#7322)

2024-12-20 13:30:16 -08:00

langfuse_small.png

(docs) using litellm proxy + langfuse

2023-11-15 14:29:14 -08:00

langfuse-example-trace-multiple-models-min.png

[docs] updated langfuse integration guide (#5921)

2024-09-27 07:49:47 -07:00

langfuse-litellm-ui.png

[docs] updated langfuse integration guide (#5921)

2024-09-27 07:49:47 -07:00

langfuse.png

fix img langfuse

2023-08-31 12:18:39 -07:00

langsmith_new.png

langsmith logs

2024-07-17 16:37:24 -07:00

langsmith.png

(docs) add langsmith callback docs

2023-10-18 12:13:39 -07:00

latency.png

(docs) proxy

2023-11-24 17:09:38 -08:00

litellm_custom_ai.png

(docs) custom ui branding

2024-02-21 22:07:40 -08:00

litellm_gateway.png

add arch diagram

2024-09-07 15:49:51 -07:00

litellm_hosted_ui_add_models.png

docs(hosted.md): add hosted proxy info to docs

2024-04-20 09:30:28 -07:00

litellm_hosted_ui_create_key.png

docs(hosted.md): add hosted proxy info to docs

2024-04-20 09:30:28 -07:00

litellm_hosted_ui_router.png

docs(hosted.md): add hosted proxy info to docs

2024-04-20 09:30:28 -07:00

litellm_hosted_usage_dashboard.png

docs(hosted.md): add hosted proxy info to docs

2024-04-20 09:30:28 -07:00

litellm_load_test.png

(docs) how to run a locust load test

2024-03-15 07:37:50 -07:00

litellm_streamlit_playground.png

completed tutorial

2023-08-25 19:20:35 -07:00

litellm_ui_3.gif

docs(ui.md): update ui docs

2024-02-10 17:26:04 -08:00

litellm_ui_admin.png

docs(ui.md): add proxy admin view to docs

2024-02-07 11:38:27 -08:00

litellm_ui_copy_id.png

docs(ui.md): add proxy admin view to docs

2024-02-07 11:38:27 -08:00

litellm_ui_create_key.png

docs(ui.md): add proxy admin view to docs

2024-02-07 11:38:27 -08:00

litellm_ui_login.png

docs(ui.md): ui doc updates

2024-02-07 11:38:27 -08:00

litellm_user_heirarchy.png

Support budget/rate limit tiers for keys (#7429)

2024-12-26 19:05:27 -08:00

literalai.png

Litellm Minor Fixes & Improvements (10/03/2024) (#6049)

2024-10-03 18:02:28 -04:00

locust_load_test1.png

(docs) add 1k rps load test doc (#6059)

2024-10-04 16:56:34 +05:30

locust_load_test2_setup.png

(docs) add 1k rps load test doc (#6059)

2024-10-04 16:56:34 +05:30

locust_load_test2.png

(docs) add 1k rps load test doc (#6059)

2024-10-04 16:56:34 +05:30

locust_load_test.png

(docs) how to run a locust load test

2024-03-15 07:37:50 -07:00

locust.png

(docs) load test litellm

2024-03-08 15:18:06 -08:00

logfire.png

Revert "Revert "Logfire Integration""

2024-05-21 11:07:40 +04:00

lunary-trace.png

[integrations/lunary] Improve Lunary documentaiton (#7770)

2025-01-15 15:00:25 -08:00

max_budget_for_internal_users.png

docs(self_serve.md): cleanup docs on how to onboard new users + teams

2024-08-07 19:58:36 -07:00

mlflow_tool_calling_tracing.png

Update MLflow calllback and documentation (#7809)

2025-01-21 20:56:48 -08:00

mlflow_tracing.png

LiteLLM Minor Fixes & Improvements (11/13/2024) (#6729)

2024-11-15 11:18:31 +05:30

model_hub.png

docs(enterprise.md): update enterprise docs with public model hub and custom email branding information

2024-06-01 09:01:05 -07:00

ms_teams_alerting.png

docs(alerting.md): add expected response teams alerting image to docs

2024-06-13 14:28:43 -07:00

multiple_deployments.png

docs(routing.md): adding comparison to docs

2023-11-06 18:57:50 -08:00

okta_callback_url.png

docs(ui.md): add okta sso support to docs

2024-06-11 13:17:41 -07:00

openmeter_img_2.png

docs(openmeter.md): add openmeter to docs

2024-05-01 18:31:45 -07:00

openmeter.png

docs(openmeter.md): add openmeter to docs

2024-05-01 18:31:45 -07:00

opik.png

[Feat] Observability integration - Opik by Comet (#6062)

2024-10-10 18:27:50 +05:30

otel_debug_trace.png

Litellm dev 11 20 2024 (#6838)

2024-11-21 05:20:37 +05:30

otel_parent.png

doc - OTEL trace propogation

2024-06-11 14:25:33 -07:00

pagerduty_fail.png

(Feat) - Add PagerDuty Alerting Integration (#7478)

2025-01-01 07:12:51 -08:00

pagerduty_hanging.png

(Feat) - Add PagerDuty Alerting Integration (#7478)

2025-01-01 07:12:51 -08:00

presidio_screenshot.png

docs(pii_masking.md): add pii masking to proxy docs

2024-02-12 21:40:34 -08:00

prompt_management_architecture_doc.png

Litellm dev 2024 12 19 p3 (#7322)

2024-12-20 13:30:16 -08:00

promptlayer.png

update docs

2023-08-26 12:33:47 -07:00

proxy_langfuse.png

docs - pass through langfuse requests on proxy

2024-06-28 17:53:13 -07:00

raw_request_log.png

fix(utils.py): allow user to opt in to raw request logging to langfuse

2024-06-11 13:35:22 -07:00

raw_response_headers.png

docs(raw_request_response.md): show how to get openai headers from response

2024-07-23 11:40:26 -07:00

render1.png

(docs) on deploying render

2023-10-24 21:28:37 -07:00

render2.png

(docs) on deploying render

2023-10-24 21:28:37 -07:00

response_cost_img.png

fix cost tracking img

2024-06-29 11:35:57 -07:00

router_architecture.png

docs(router_architecture.md): add router architecture docs

2024-11-26 12:54:38 +05:30

sagemaker_deploy.png

add sagemaker to docs

2023-09-04 21:53:52 -07:00

sagemaker_domain.png

add sagemaker to docs

2023-09-04 21:53:52 -07:00

sagemaker_endpoint.png

add sagemaker to docs

2023-09-04 21:53:52 -07:00

sagemaker_jumpstart.png

add sagemaker to docs

2023-09-04 21:53:52 -07:00

sentry.png

(docs) improve sentry callback

2023-10-27 16:33:12 -07:00

slack.png

(docs) add slack callback for litellm

2023-10-19 09:32:29 -07:00

soft_budget_alert.png

update docs

2025-01-07 22:35:07 -08:00

spend_logs_table.png

docs(sidebars.js): add custom pricing to docs

2024-01-22 15:15:34 -08:00

spend_per_user.png

(docs) spend per user

2024-01-24 12:17:23 -08:00

swagger.png

(docs) proxy server instructions

2023-10-23 10:10:55 -07:00

test_key_budget.gif

docs - setting team budgets on ui

2024-06-19 15:04:01 -07:00

test_python_server_1.png

update playground tutorial

2023-08-25 18:34:46 -07:00

test_python_server_2.png

update playground tutorial

2023-08-25 18:34:46 -07:00

throughput.png

(docs) proxy

2023-11-24 17:09:38 -08:00

traceloop_dash.png

fix: updates to traceloop docs

2023-10-18 19:37:12 +02:00

ui_3.gif

(docs) update ui

2024-02-03 20:43:43 -08:00

ui_clean_login.png

docs(self_serve.md): cleanup images

2024-06-05 17:20:57 -07:00

ui_invite_link.png

docs - how to invite users to view usage, caching analytics

2024-07-16 17:56:06 -07:00

ui_invite_user.png

docs - how to invite users to view usage, caching analytics

2024-07-16 17:56:06 -07:00

ui_key.png

docs release notes

2024-12-27 21:41:21 -08:00

ui_link.png

(docs) update proxy ui docs

2024-01-31 19:54:04 -08:00

ui_logout.png

docs - custom logout url

2024-06-13 20:54:08 -07:00

ui_self_serve_create_key.png

docs(self_serve.md): cleanup images

2024-06-05 17:20:57 -07:00

ui_usage.png

docs - how to invite users to view usage, caching analytics

2024-07-16 17:56:06 -07:00

wandb.png

(docs) add wandb callback

2023-10-17 18:15:58 -07:00