Commit Graph

2427 Commits

Author SHA1 Message Date
Ishaan Jaff 369ddfb49e docs vertex context caching 2024-08-08 17:18:12 -07:00
Ishaan Jaff 84c05a57d6 docs use (LLM Gateway) in some places 2024-08-08 17:00:52 -07:00
Ishaan Jaff f179759672 docs vertex ai 2024-08-08 16:12:36 -07:00
Ishaan Jaff e671ae58e3 Merge pull request #5119 from BerriAI/litellm_add_gemini_context_caching_litellm
[Feat-Proxy] Add Support for VertexAI context caching
2024-08-08 16:08:58 -07:00
Ishaan Jaff d78c38f8e7 docs vertex 2024-08-08 16:07:14 -07:00
Ishaan Jaff a3dd3a19fa docs cachedContent endpoint 2024-08-08 16:06:23 -07:00
Ishaan Jaff 8ad5a40283 doc on using litellm proxy with vertex ai content caching 2024-08-08 11:45:46 -07:00
Krrish Dholakia 2710bec02d docs(scheduler.md): cleanup docs to use /chat/completion endpoint 2024-08-07 21:49:06 -07:00
Krish Dholakia e1610d37b9 Merge pull request #5099 from BerriAI/litellm_personal_user_budgets
fix(user_api_key_auth.py): respect team budgets over user budget, if key belongs to team
2024-08-07 20:00:16 -07:00
Krish Dholakia baf01b47d8 Merge branch 'main' into litellm_personal_user_budgets 2024-08-07 19:59:50 -07:00
Krrish Dholakia 7e1f296981 docs(self_serve.md): cleanup docs on how to onboard new users + teams 2024-08-07 19:58:36 -07:00
Krrish Dholakia 400653992c feat(router.py): allow using .acompletion() for request prioritization
allows /chat/completion endpoint to work for request prioritization calls
2024-08-07 16:43:12 -07:00
Ishaan Jaff e585dfba92 docs prom 2024-08-07 16:03:11 -07:00
Ishaan Jaff 04b201efed Merge pull request #5098 from BerriAI/litellm_provider_wildcard_routing
[Feat-Router + Proxy] Add provider wildcard routing
2024-08-07 14:51:42 -07:00
Ishaan Jaff a367f97eb2 docs provider specific wildcard routing 2024-08-07 14:49:45 -07:00
Krish Dholakia 3605e873a1 Merge branch 'main' into litellm_add_pydantic_model_support 2024-08-07 13:07:46 -07:00
Ishaan Jaff 1bf36cd7a4 docs prom metrics 2024-08-07 12:50:03 -07:00
Ishaan Jaff 61ccd5354b docs prometheus 2024-08-07 12:47:06 -07:00
Ishaan Jaff 958e0fdfab show warning about prometheus moving to enterprise 2024-08-07 12:46:26 -07:00
Ishaan Jaff 72aebe5e59 docs link to enteprise pricing 2024-08-07 12:10:47 -07:00
Ishaan Jaff 8d1f051d8c docs prometheus 2024-08-07 11:37:05 -07:00
Krrish Dholakia a0bb89a372 docs(ui.md): add restrict email subdomains w/ sso 2024-08-06 22:54:33 -07:00
Krish Dholakia c82fc0cac2 Merge branch 'main' into litellm_support_lakera_config_thresholds 2024-08-06 22:47:13 -07:00
Ishaan Jaff 0d76f49ea6 docs run ui on custom server root path 2024-08-06 21:27:47 -07:00
Krrish Dholakia 2dd27a4e12 feat(utils.py): support validating json schema client-side if user opts in 2024-08-06 19:35:33 -07:00
Krrish Dholakia 0c88cc4153 docs(json_mode.md): add example of calling openai with pydantic model via litellm 2024-08-06 18:27:06 -07:00
Krrish Dholakia cf44d1e069 docs(sidebars.js): cleanup sidebar title 2024-08-06 18:24:54 -07:00
Krrish Dholakia f3a0eb8eb9 docs(json_mode.md): update json mode docs to show structured output responses
Relevant issue - https://github.com/BerriAI/litellm/issues/5074
2024-08-06 17:01:41 -07:00
Krrish Dholakia 0e222cf76b feat(lakera_ai.py): support lakera custom thresholds + custom api base
Allows user to configure thresholds to trigger prompt injection rejections
2024-08-06 15:21:45 -07:00
Krrish Dholakia 2a95484a83 docs(deploy.md): add iam-based auth to rds 2024-08-06 14:29:39 -07:00
Ishaan Jaff 645d3ae09d Merge pull request #5062 from BerriAI/litellm_forward_headers
[Fix-Proxy] allow forwarding headers from request
2024-08-06 12:34:25 -07:00
Ishaan Jaff 0cd2435aff doc forward_headers 2024-08-06 12:07:21 -07:00
Ishaan Jaff 621b5d5fba docs on gpt-4o-2024-08-06 2024-08-06 11:40:44 -07:00
Krrish Dholakia 6bf3a2cb3c docs(prod.md): add litellm salt key to prod docs 2024-08-06 11:33:23 -07:00
Krrish Dholakia 8fa39b058d docs(azure.md): cleanup docs 2024-08-05 09:38:45 -07:00
Krrish Dholakia 0230889ec4 docs: cleanup docs
Fixes https://github.com/BerriAI/litellm/issues/5043
2024-08-05 09:38:21 -07:00
Ishaan Jaff 0214ff5fe0 Merge pull request #5047 from BerriAI/litellm_log_request_response_gcs
[Feat-Proxy] Log request/response on GCS
2024-08-05 09:05:56 -07:00
Ishaan Jaff 9314341b9e docs show fields logged on gcs bucket 2024-08-05 08:58:54 -07:00
Krrish Dholakia 51211dc2a6 docs(gemini.md): add json mode, response schema, supported openai params to gemini docs 2024-08-05 08:11:07 -07:00
Krrish Dholakia d4796d6369 docs(sidebar.js): cleanup 2024-08-03 20:57:43 -07:00
Krish Dholakia 9ba8e3047f Merge branch 'main' into litellm_loadbalancing_test 2024-08-03 20:29:54 -07:00
Ishaan Jaff 22bc70633e docs add when to use litellm 2024-08-03 19:10:16 -07:00
Ishaan Jaff 3a94aac343 docs - fix merge conflicts 2024-08-03 17:59:46 -07:00
Ishaan Jaff 9d2eab555b docs tuning api 2024-08-03 17:58:20 -07:00
Ishaan Jaff 7f95a865fe docs add example curl command 2024-08-03 17:56:41 -07:00
Ishaan Jaff bef5a8b61f Merge branch 'main' into litellm_support_native_vertex_endpoint 2024-08-03 17:47:35 -07:00
Ishaan Jaff 50c9fa38f9 docs link to vertex ai endpoints 2024-08-03 17:44:28 -07:00
Ishaan Jaff 94e5d0f734 docs add vertex ai endpoints 2024-08-03 17:41:45 -07:00
Ishaan Jaff cfdbb3d237 docs secret manager 2024-08-03 12:54:07 -07:00
Ishaan Jaff 203cc35abc docs - use consistent name for LiteLLM proxy server 2024-08-03 12:54:07 -07:00