Commit Graph

24137 Commits

Author SHA1 Message Date
Krrish Dholakia b23e35f75e test: update tests 2025-08-23 12:09:19 -07:00
Krrish Dholakia 34ad646101 fix(auth_checks.py): handle both flows + add unit tests 2025-08-20 16:42:08 -07:00
Krrish Dholakia e5c3e006c2 fix(proxy_server.py): fix merge config + db router settings logic 2025-08-20 16:33:31 -07:00
Krrish Dholakia 52cbedf044 fix(auth_checks.py): ensure if key has access to aliased model, it still works 2025-08-20 15:36:32 -07:00
Krrish Dholakia b0c98efd14 fix(__init__.py): remove redundant value 2025-08-20 15:10:58 -07:00
Krrish Dholakia 5c1b27af99 docs(quick_start.md): add back to navbar
useful for showing setup via cli
2025-08-20 15:09:19 -07:00
Krrish Dholakia fb5b2d8d47 docs: remove old doc
prevent showing up on searches
2025-08-20 15:01:32 -07:00
tanjiro 5299e9ad4a fix key edit settings after regenerating key (#13815) 2025-08-20 14:34:38 -07:00
tanjiro f7a3af5cde new notifications (#13813) 2025-08-20 14:32:04 -07:00
Ishaan Jaff 6f6fd0de0d add fireworks_ai/accounts/fireworks/models/deepseek-v3-0324 (#13821) 2025-08-20 14:31:24 -07:00
Ishaan Jaff 12bae8fdda test_partner_models_httpx_streaming v1.75.9-nightly 2025-08-20 09:44:47 -07:00
Ishaan Jaff e69a895884 test_apply_default_settings 2025-08-20 08:53:38 -07:00
Ishaan Jaff 45a9af8063 security fix 2025-08-20 08:40:49 -07:00
Ishaan Jaff e229a6a796 security fix 2025-08-20 08:35:59 -07:00
Krish Dholakia 4df07a5060 Merge pull request #13622 from BerriAI/fix-passthrough-deletion-failure
Fix query passthrough deletion
2025-08-19 22:34:07 -07:00
Krish Dholakia bfe814f981 Merge pull request #13637 from Tasmay-Tibrewal/main
Added Qwen3, Deepseek R1 0528 Throughput, GLM 4.5 and GPT-OSS models for Together AI
2025-08-19 22:33:17 -07:00
Krish Dholakia 749bafc550 Merge pull request #13660 from BerriAI/litellm_azure_gpt-t
[LLM Translation] Adjust max_input_tokens for azure/gpt-5-chat models in JSON configuration
2025-08-19 22:32:56 -07:00
Krish Dholakia 04feaf33c0 Merge pull request #13748 from hakasecurity/migrate-to-aim-new-firewall-api
Migrate to aim new firewall api
2025-08-19 22:32:22 -07:00
Krish Dholakia be30bc68ae Merge pull request #13759 from kankute-sameer/litellm_feat_correct_cost_calculations
Add long context support for claude-4-sonnet
2025-08-19 22:30:25 -07:00
Krrish Dholakia 7d09375d52 fix: fix gpt-5-chat mappings 2025-08-19 22:21:00 -07:00
Ishaan Jaff 1832c09d6b [Feat] - UI Allow using Key/Team Based Logging for Langfuse OTEL (#13791)
* add langfuse_otel

* ui allow setting langfuse OTEL

* fixes - using langfuse OTEL

* add description for logging integrations

* add description
2025-08-19 19:06:26 -07:00
Ishaan Jaff a328ad56e3 [Bug Fix] Fixes for using Auto Router with LiteLLM Docker Image (#13788)
* fix install auto router.sh

* fixes for Docker IMG
2025-08-19 18:36:30 -07:00
Ishaan Jaff 56ac778316 [Bug Fix] Bedrock KB - Using LiteLLM Managed Credentials for Query (#13787)
* fix: add get_credentials_for_vector_store

* test_search_uses_registry_credentials

* test_bedrock_search_with_credentials_managed_registry
2025-08-19 15:39:36 -07:00
tanjiro b0e3469202 Models page row UI restructure (#13771)
* remove unused model dashboard

* move model_dashboard to templates folder

* moving  columns to molecules directory

* group model names and provider icon

* increase table column name font size. cleanup extra title and description inside the tab

* fix column width and truncate string

* moved credentials column

* combined created by and created at

* combine in and out costs

* remove edit button

* remove 2nd extra tooltip
2025-08-19 14:00:58 -07:00
Sameer Kankute 48622a4ee7 add cache above 200k keys in INTENDED_SCHEMA 2025-08-20 01:47:34 +05:30
Sameer Kankute fa81b6c639 Update test_cost_calculator.py 2025-08-19 23:14:22 +05:30
Ishaan Jaff 195ea6515e [Feat] Datadog LLM Observability - Add support for tracing guardrail input/output (#13767)
* add guardrail information on DD LLM Obs

* test_guardrail_information_in_metadata
2025-08-19 10:26:25 -07:00
Sameer Kankute b5f0a7b49b Merge branch 'main' into litellm_feat_correct_cost_calculations 2025-08-19 18:55:36 +05:30
Sameer Kankute d39b2e8888 Add test for long context cost calculation 2025-08-19 16:56:13 +05:30
Sameer Kankute 4f38a63152 Add long context support for claude-4-sonnet 2025-08-19 16:40:12 +05:30
drorbaron 7fedcf1ea9 migrate stream ws 2025-08-19 12:36:29 +03:00
drorbaron 6b78ade918 migrate to use new aim FW API 2025-08-19 12:20:19 +03:00
Krish Dholakia de59691c4b Enable update/delete org members on UI (#8560)
* feat(organization_endpoints.py): expose new `/organization/delete` endpoint. Cascade org deletion to member, teams and keys

Ensures any org deletion is handled correctly

* test(test_organizations.py): add simple test to ensure org deletion works

* feat(organization_endpoints.py): expose /organization/update endpoint, and define response models for org delete + update

* fix(organizations.tsx): support org delete on UI + move org/delete endpoint to use DELETE

* feat(organization_endpoints.py): support `/organization/member_update` endpoint

Allow admin to update member's role within org

* feat(organization_endpoints.py): support deleting member from org

* test(test_organizations.py): add e2e test to ensure org member flow works

* fix(organization_endpoints.py): fix code qa check

* fix(schema.prisma): don't introduce ondelete:cascade - breaking change

* docs(organization_endpoints.py): document missing params
2025-08-19 10:53:24 +03:00
Krrish Dholakia 137a98a5af bump: version 1.75.8 → 1.75.9 2025-08-18 23:11:08 -07:00
Krish Dholakia 435995ba5c Merge pull request #13617 from moandersson/fix/migratejob-resources
Add possibility to configure resources for migrations-job in Helm chart
2025-08-18 23:03:35 -07:00
Krish Dholakia 88e52c55d0 Merge pull request #13675 from colesmcintosh/fix/groq-streaming-encoding
Fix Groq streaming ASCII encoding issue
2025-08-18 23:00:00 -07:00
Krish Dholakia 9dadd279a4 Merge pull request #13741 from BerriAI/litellm_dev_08_18_2025_p1
Refactor - forward model group headers - reuse same logic as global header forwarding
2025-08-18 22:58:39 -07:00
Krrish Dholakia 2c0520635d test: cleanup old tests 2025-08-18 22:58:29 -07:00
Krish Dholakia 048f22b7ec Merge pull request #13742 from BerriAI/litellm_dev_08_18_2025_p2
Fix - gemini prompt caching cost calculation
2025-08-18 22:54:28 -07:00
Krish Dholakia b5f06e2bd3 Merge pull request #13685 from BerriAI/azure-deployment-name-preset
Add Azure Deployment Name Support in UI
2025-08-18 22:48:33 -07:00
Krish Dholakia 78fcf7afa9 Merge pull request #13687 from BerriAI/model-filter-on-models
Add Search Functionality for Public Model Names in Model Dashboard
2025-08-18 22:44:36 -07:00
Krish Dholakia 3713c926c0 Merge pull request #13704 from michal-otmianowski/use-namespace-as-prefix-for-s3-cache
Use namespace as prefix for s3 cache
2025-08-18 22:37:18 -07:00
Krrish Dholakia f7f1a0d0b7 test: add unit test 2025-08-18 22:32:36 -07:00
Krrish Dholakia 241f32b2a3 fix(vertex_and_google_ai_studio_gemini.py): adjust 'text token' value to be the non-cached tokens - for accurate cost tracking 2025-08-18 22:09:07 -07:00
Krrish Dholakia 2e16f2cb13 test: add unit tests 2025-08-18 21:19:43 -07:00
Krrish Dholakia 36f93444b2 refactor: cleanup 2025-08-18 21:14:38 -07:00
Krrish Dholakia 06d05c691d fix(litellm_pre_call_utils.py): forward headers by model group at litellm pre call utils level
do it at the proxy level instead of router - allows reusing same forwarding logic as global forwarding
2025-08-18 21:13:52 -07:00
Krish Dholakia 422447b7f1 Responses API - add default api version for openai responses api calls + Openrouter - fix claude-sonnet-4 on openrouter + Azure - Handle openai/v1/responses
Responses API - add default api version for openai responses api calls + Openrouter - fix claude-sonnet-4 on openrouter + Azure - Handle `openai/v1/responses`
2025-08-18 18:59:28 -07:00
Krrish Dholakia 0459604721 docs: document new param 2025-08-18 18:56:39 -07:00
Krish Dholakia 3b52545db3 Merge pull request #13529 from BerriAI/litellm_dev_08_11_2025_p1
[Fix] Cooldowns - don't return raw Azure Exceptions to client
2025-08-18 18:54:19 -07:00