Ishaan Jaff
56fc0cf374
ui polish
2025-07-31 17:08:47 -07:00
Ishaan Jaff and GitHub
3acb78d450
Litellm fix fallbacks UI ( #13191 )
...
* UI - fix setting fallbacks on UI
* fix add fallbacks
2025-07-31 17:07:15 -07:00
Ishaan Jaff and GitHub
ee70d593c1
[Feat] Allow redacting message / response content for specific logging integrations - DD LLM Observability ( #13158 )
...
* fix redact_standard_logging_payload
* add StandardCustomLoggerInitParams
* allow defining DatadogLLMObsInitParams
* fix init DataDogLLMObsLogger
* fix import
* update redact_standard_logging_payload_from_model_call_details
* test_dd_llms_obs_redaction
* docs DD logging
* docs DD
* docs DD
* Redacting Messages, Response docs DD LLM Obs
* fix redaction logic
* fix create_llm_obs_payload
* fix logging response
* fixes
* ruff fix
* fix test
* test_dd_llms_obs_redaction
* test_create_llm_obs_payload
* redact_standard_logging_payload_from_model_call_details
* img - dd_llm_obs
* docs DD
* fix linting
* fix linting
* fix mypy
* test_create_llm_obs_payload
* test_create_llm_obs_payload
* fix mock_env_vars
* fix _handle_anthropic_messages_response_logging
2025-07-31 16:44:16 -07:00
Ishaan Jaff and GitHub
115d2480c1
[Bug Fix] Infra - ensure that stale Prisma clients disconnect DB connection ( #13140 )
...
* ensure original client is disconnected when re-creating
* test_recreate_prisma_client_successful_disconnect
* test_recreate_prisma_client_successful_disconnect
2025-07-31 16:43:26 -07:00
Ishaan Jaff and GitHub
cbb922b1bb
[Bug Fix] Gemini-CLI Integration - ensure tool calling works as expected on generateContent ( #13189 )
...
* transform_generate_content_request
* add tools in GenerateContentRequestDict
* add generate_content_handler tool calling
* google_generate_content_endpoint_testing
* test_mock_stream_generate_content_with_tools
* test_validate_post_request_parameters
* fixes for generate_content_handler
* fix VertexAIGoogleGenAIConfig
* fixes veretx ai
* google_generate_content_endpoint_testing
* test_async_streaming_with_logging
* load_vertex_ai_credentials
* test_vertex_anthropic.py
2025-07-31 16:42:57 -07:00
Anand Khinvasara and GitHub
212a339954
fix: support negative indexes in cache_control_injection_points for Anthropic Claude ( #10226 ) ( #13187 )
2025-07-31 15:50:53 -07:00
Ishaan Jaff
edd3c3bc40
UI - new build
2025-07-31 14:16:16 -07:00
Jugal D. Bhatt and GitHub
524a1ffd5f
[Proxy Startup]fix db config through envs ( #13111 )
...
* fix db config through envs
* add helper
* fix ruff
* fix imports
* add unit tests in db config changes
2025-07-31 13:52:56 -07:00
Ishaan Jaff and GitHub
79be436c2b
[Feat] Background Health Checks - Allow disabling background health checks for a specific ( #13186 )
...
* disable background health checks for specific models
* test_background_health_check_skip_disabled_models
* Disable Background Health Checks For Specific Models
2025-07-31 13:48:35 -07:00
Ishaan Jaff
65ca4f66f6
Revert "add framework name to UserAgent header in AWS Bedrock API call ( #13159 )"
...
This reverts commit 77f506e860
2025-07-30 23:12:36 -07:00
Ishaan Jaff
fad453bbf3
test_chat_completion_ratelimit
2025-07-30 23:12:11 -07:00
Kowyo and GitHub
c35003bba0
fix: remove obsolete attribute version in docker compose ( #13172 )
...
Fix the warning: WARN[0000] docker-compose.yml: the attribute `version` is obsolete, it will be ignored, please remove it to avoid potential confusion
2025-07-30 22:56:06 -07:00
0x-fang and GitHub
77f506e860
add framework name to UserAgent header in AWS Bedrock API call ( #13159 )
2025-07-30 22:44:22 -07:00
Krish Dholakia and GitHub
c6a8733234
build(config.yml): migrate build_and_test to ci/cd pg db ( #13166 )
2025-07-30 18:19:36 -07:00
Ishaan Jaff
cf4c639dad
test fix xai - it goes through base llm tests already
2025-07-30 18:18:49 -07:00
Krrish Dholakia
e3ba350345
ci: migrate to postgres in ci/cd
2025-07-30 17:00:06 -07:00
Krrish Dholakia
2266938184
ci(config.yml): remove check
2025-07-30 16:33:42 -07:00
Krrish Dholakia
09cc748871
test: handle api instability
2025-07-30 16:32:23 -07:00
Ishaan Jaff
50b1332fd5
poetry lock
2025-07-30 16:05:56 -07:00
Ishaan Jaff
090e2ffb5a
Revert "[LLM translation] Fix bedrock computer use ( #13143 )"
...
This reverts commit 840dd2e7c7
2025-07-30 16:03:35 -07:00
Jugal D. Bhatt and GitHub
fa7e203953
fix migrations ( #13157 )
2025-07-30 15:56:45 -07:00
Krrish Dholakia
88aed06bbb
ci: migrate to db in pipeline
2025-07-30 15:48:15 -07:00
Krrish Dholakia
2af5900c00
build(pyproject.toml): bump version
2025-07-30 15:45:37 -07:00
Ishaan Jaff
5aa4a70bd3
fix grype scan
2025-07-30 15:35:16 -07:00
Krrish Dholakia
3bf7411491
ci(config.yml): run prisma generate before running enterprise tests
2025-07-30 15:28:45 -07:00
Krrish Dholakia
6da36049fe
ci: remove bad script
2025-07-30 15:25:32 -07:00
Jugal D. Bhatt and GitHub
5db4862cbf
[MCP Gateway] Litellm mcp client list fail ( #13114 )
...
* fix headers
* fix test
* fix ruff
* added try except for catching errors which lead to client failures
* fix mypy
* fix ruff
* fix tests
* fix python error
* fix test
* fix test
* fixed the MCP Call Tool result
2025-07-30 15:23:19 -07:00
Krish Dholakia and GitHub
3ca99f1def
Litellm explore postgres db ci cd ( #13156 )
...
* ci(config.yml): testing with ci/cd db
* build: spin up pg db in ci/cd test
2025-07-30 15:17:12 -07:00
92cdac2e87
[Feat] v2 updates - tracking DAU, WAU, MAU for coding tool usage + show Daily Usage per User ( #13147 )
...
* Add user agent analytics endpoints and UI for tracking client metrics
Co-authored-by: ishaan <ishaan@berri.ai >
* fix user agent analytics
* fix getting DAU
* fixes for user agent
* showing top user agents
* on this page remove Success Rate by User Agent
* fix linting
* add agent activity
* cleanup interface
* fix ruff
* round cost
* fix charts
* fixes - show DAU, MAU, WAU
* move to a diff file
* fix
* fixes for user agent analytics
* fix user_agent_analytics_endpoints
* fix mypy linting
* fix linting
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
Co-authored-by: ishaan <ishaan@berri.ai >
2025-07-30 14:42:30 -07:00
Jugal D. Bhatt and GitHub
eb8a338d9b
[MCP Guardrails] move pre and during hooks to ProxyLoggin ( #13109 )
...
* move pre and during hooks t o ProxyLoggin
* fix lint
* fix ruff
* fix tests
2025-07-30 13:58:41 -07:00
Jugal D. Bhatt and GitHub
840dd2e7c7
[LLM translation] Fix bedrock computer use ( #13143 )
...
* Add support for bedrock computer use
* remove print
* split bedrock tools
* add hosted tools
* fix tool use
* fix tool use
* fix function calling
* fix converse transformation
* fix tests
* fix llm translation test
* fix computer use
2025-07-30 12:27:12 -07:00
0201c51b50
[Feat] UI + Backend add a tab for use agent activity ( #13146 )
...
* Add user agent analytics endpoints and UI for tracking client metrics
Co-authored-by: ishaan <ishaan@berri.ai >
* fix user agent analytics
* fix getting DAU
* fixes for user agent
* showing top user agents
* on this page remove Success Rate by User Agent
* fix linting
* add agent activity
* cleanup interface
* fix ruff
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
Co-authored-by: ishaan <ishaan@berri.ai >
2025-07-30 12:11:07 -07:00
tanjiro and GitHub
1f0e5ef340
New Advanced Date Range Picker Component ( #13141 )
...
* new date-range picker added
* remove unused utils
2025-07-30 11:56:24 -07:00
Jugal D. Bhatt and GitHub
89daa665a3
fix object permission for orgs ( #13142 )
2025-07-30 11:41:25 -07:00
Krrish Dholakia
68177686e3
docs: cleanup
2025-07-30 10:21:45 -07:00
tanjiro and GitHub
0af45206a3
Added Voyage, Jinai, Deepinfra and VolcEngine providers on the UI ( #13131 )
...
* added voyage and jinai and volcengine
* deepinfra added and alphabetically ordered
2025-07-30 10:01:07 -07:00
Jugal D. Bhatt and GitHub
5fbe732ce1
[MCP Protocol header] fix issue with clients protocol header ( #13112 )
...
* fix headers
* fix test
* fix ruff
* fix mypy
2025-07-30 20:42:29 +05:30
Jugal D. Bhatt and GitHub
e324f76859
[MCP Gateway] add health check endpoints for MCP ( #13106 )
...
* add health check endpoints for MCP
* add import
* Clean up endpopints
* fix ruff
2025-07-30 20:40:44 +05:30
Krrish Dholakia
8c70025a63
docs: cleanup
2025-07-30 08:02:00 -07:00
Johnny.H and GitHub
97d89584c1
fix tool aws bedrock call index when the function only have optional arg ( #13115 )
2025-07-29 22:07:24 -07:00
Krrish Dholakia
ae947e63ce
test: update test
2025-07-29 22:07:07 -07:00
Krish Dholakia and GitHub
ea6b4b08d3
move to use_prisma_migrate by default + resolve team-only models on auth checks + UI - add sagemaker on UI ( #13117 )
...
* fix(proxy_cli.py): make use_prisma_migrate proxy default
Fixes https://github.com/BerriAI/litellm/issues/13046
Prisma migrate deploy prevents resetting db
* fix(auth_checks.py): resolve team only models while doing auth checks on model access groups
Fixes issue where key had access via an access group, but team only model could not be called
* test(test_router.py): add unit testing
* feat(provider_specific_fields.tsx): add aws sagemaker on UI
2025-07-29 21:56:18 -07:00
Krish Dholakia and GitHub
a34206f67e
fix(model_checks.py): handle custom values in wildcard model name (e.g. genai/test/*) ( #13116 )
...
Fixes https://github.com/BerriAI/litellm/issues/13078
2025-07-29 21:42:15 -07:00
Krrish Dholakia
7e5bc8af28
test: update test
2025-07-29 21:35:44 -07:00
Krish Dholakia and GitHub
1c182919b5
Revert "[LLM translation] Add support for bedrock computer use ( #12948 )" ( #13118 )
...
This reverts commit 760d747465
2025-07-29 21:33:46 -07:00
Krrish Dholakia
f544a4e238
test: update test
2025-07-29 21:08:36 -07:00
Ishaan Jaff
36d46e0ecf
use _safe_get_request_query_params
2025-07-29 18:19:38 -07:00
Ishaan Jaff
1af0743e58
Revert "Revert "[MCP Gateway] Add protocol headers ( #13062 )""
...
This reverts commit acd915f2db
2025-07-29 18:14:31 -07:00
Ishaan Jaff
50466e0077
test_user_api_key_auth
2025-07-29 18:01:40 -07:00
tanjiro and GitHub
c4088841d9
After selecting date range show loader on usage cost charts ( #13113 )
...
* prettier
* added loader in bar chart
* prettier
* added existing loader style
* make datepicker responsive
2025-07-29 17:55:39 -07:00
Ishaan Jaff