Krish Dholakia and GitHub
f73b9da2cd
Merge pull request #14040 from dmvieira/main
...
Fix error saving latency as timedelta on Redis
2025-08-29 06:25:43 -07:00
Krish Dholakia and GitHub
c4f60f1a06
Merge pull request #14038 from datarobot-forks/carsongee/add_docs
...
📖 Add DataRobot to the provider documentation.
2025-08-29 06:25:13 -07:00
Krish Dholakia and GitHub
38a7c8a560
Merge pull request #14041 from Const-antine/litellm_helm_custom_configmap
...
[Helm charts] Enhance proxy_config configuration: add support for existing configmap
2025-08-29 06:24:57 -07:00
Krish Dholakia and GitHub
fffccc0675
Merge pull request #14042 from WilsonSunBritten/10988-set-truncation-threshold
...
Allow configuration to set threshold before request entry in spend log gets truncated
2025-08-29 06:24:28 -07:00
Krish Dholakia and GitHub
dd33e3f928
Merge pull request #14050 from lmwang9527/fix/logging-worker-graceful-shutdown
...
Fix LoggingWorker graceful shutdown to prevent CancelledError warnings
2025-08-29 06:23:53 -07:00
Carson Gee and Nate Goudreault
f90072b226
Apply suggestions from code review
...
Co-authored-by: Nate Goudreault <50588929+nate-goudreault@users.noreply.github.com >
2025-08-28 23:00:09 -06:00
Carson Gee
bf55bf5072
Update datarobot.md
2025-08-28 23:00:09 -06:00
mjnitz02 and Carson Gee
5c73b17387
Add initial docs
2025-08-28 23:00:09 -06:00
Ishaan Jaff and GitHub
81db36c06c
add xai/grok-code-fast ( #14054 )
2025-08-28 18:10:04 -07:00
Ishaan Jaff and GitHub
3fe05b300a
fix - use import fastuuid as uuid ( #14016 )
2025-08-28 17:57:46 -07:00
WilsonSunBritten
b3edff02e8
fix mock tests
2025-08-28 17:40:16 -06:00
WilsonSunBritten
8bf2fe2991
attempt to fix unrelated lint error
2025-08-28 17:21:17 -06:00
WilsonSunBritten
e6ba9b4c91
lint fix
2025-08-28 17:12:48 -06:00
WilsonSunBritten
4ea92d96cb
lint fix
2025-08-28 17:11:50 -06:00
WilsonSunBritten
0721345703
Switch to string constant based truncation
2025-08-28 16:28:36 -06:00
Ishaan Jaff and GitHub
f3338bef9f
[MCP] Bug fix - adding SSE MCP tools - fix connection test when adding MCPs ( #14048 )
...
* fix: _execute_with_mcp_client
* add warning for SSE MCP
* docs - MCP videos / guides
2025-08-28 15:16:34 -07:00
Ishaan Jaff and GitHub
37a599932d
[Bug Fix] Virtual keys with llm_api type cause Internal Server Error when using /anthropic/* and other llm passthrough routes ( #14046 )
...
* fix route checks passthrough_routes_wildcard
* refactor check_route_access
* test_virtual_key_llm_api_route_includes_passthrough_prefix
2025-08-28 15:14:09 -07:00
WilsonSunBritten
026480358b
Revert "Allow configuration to on what threshold to try truncating request content in db"
...
This reverts commit 771052d67d
2025-08-28 16:12:42 -06:00
lmwang
6760a6aaa1
Fix LoggingWorker graceful shutdown to prevent CancelledError warnings
...
- Change exception logging to debug level during shutdown cancellation
- Add clear_queue() call to process remaining coroutines during shutdown
- Prevents 'RuntimeWarning: coroutine was never awaited' messages
- Add comprehensive tests for graceful shutdown behavior
Fixes #13970
2025-08-28 14:15:17 -07:00
Const-antine
f8d1e03450
rework tests
2025-08-28 13:39:09 -04:00
Const-antine
1350336515
fix tests
2025-08-28 13:30:11 -04:00
Const-antine
d3b526041f
better formatting
2025-08-28 13:18:36 -04:00
Const-antine
730e9c90a2
fix formatting
2025-08-28 13:18:33 -04:00
Const-antine
5d973ea06e
update readme
2025-08-28 13:18:26 -04:00
Const-antine
409429ddd6
add new tests
2025-08-28 13:18:23 -04:00
Const-antine
ff4040bbe1
add functionality to mount existing configmap if needed
2025-08-28 13:18:05 -04:00
Wilson Britten
771052d67d
Allow configuration to on what threshold to try truncating request content in db
2025-08-28 09:48:50 -06:00
Diogo Munaro Vieira
d2ffca24bb
fix: timedelta as cache serializable error
2025-08-28 11:42:25 -03:00
Krish Dholakia and GitHub
e638c5490d
Merge pull request #13945 from NoWall57/feature/force-anthropic-custom-api-base
...
feat: Add support for custom Anthropic-compatible API endpoints
2025-08-27 22:28:55 -07:00
Krish Dholakia and GitHub
74c9663189
Merge pull request #12797 from ericgtkb/fix-vertex-ai-anyof
...
Fix additional anyOf corner cases for Vertex AI Gemini tool calls - issue #11164
2025-08-27 22:26:13 -07:00
Krish Dholakia and GitHub
68f4847659
Merge pull request #12865 from aholmberg/holmberg/default-reasoning
...
fix: make gemini and openai responses return reasoning by default
2025-08-27 22:25:30 -07:00
Krish Dholakia and GitHub
fc738c5822
Merge branch 'main' into holmberg/default-reasoning
2025-08-27 22:25:22 -07:00
Krish Dholakia and GitHub
df39320889
Merge pull request #12885 from xywei/main
...
Remove vector store methods from global scope
2025-08-27 22:22:59 -07:00
Krish Dholakia and GitHub
67d432a6d7
Merge pull request #13243 from nagyv-team/main
...
Ensure that `function_call_prompt` extends system messages following its current schema
2025-08-27 22:16:53 -07:00
Krish Dholakia and GitHub
10816a44d4
Merge pull request #13160 from pangeacyber/aidr-update
...
Update Pangea Guardrail to support new AIDR endpoint
2025-08-27 22:15:32 -07:00
Krish Dholakia and GitHub
cf491a7931
Merge pull request #13562 from qidu/main
...
refactor(router): choose weights by 'weight', 'rpm', 'tpm' in one loop for simple_shuffle
2025-08-27 22:13:42 -07:00
Krish Dholakia and GitHub
c692f19346
Merge branch 'main' into main
2025-08-27 22:13:29 -07:00
Krish Dholakia and GitHub
12bef8fbf4
Merge pull request #13691 from timelfrink/feat/github-copilot-thinking-reasoning-support
...
feat: Add thinking and reasoning_effort parameter support for GitHub Copilot provider
2025-08-27 22:09:22 -07:00
Krish Dholakia and GitHub
a913ecf60b
Merge branch 'main' into feat/github-copilot-thinking-reasoning-support
2025-08-27 22:09:15 -07:00
Krish Dholakia and GitHub
f01c7d13e7
Merge pull request #13991 from ikaadil/fix/gemini-imagen-model-name-validation
...
[Bug Fix] Resolve invalid model name error for Gemini Imagen models
2025-08-27 21:56:19 -07:00
Krish Dholakia and GitHub
f764e415be
Merge pull request #14012 from KRRT7/in-memory-cache-optimization
...
⚡ ️ Speed up InMemoryCache.evict_cache by 21%
2025-08-27 21:55:34 -07:00
d5774d89cc
Update Docker image tag to v1.75.8-stable ( #14014 )
...
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
Co-authored-by: ishaan <ishaan@berri.ai >
2025-08-27 16:44:50 -07:00
Ishaan Jaff and GitHub
04dc1a5351
[Feat] Add support for returning images with gemini/gemini-2.5-flash-image-preview with /chat/completions ( #13983 )
...
* add gemini-2.5-flash-image-preview
* add gemini-2.5-flash-image-preview
* add image in ChatCompletionResponseMessage
* test_gemini_image_generation_async
* Revert "Merge pull request #13394 from Deviad/feature/enhance_logging_for_containers"
This reverts commit 539b94ad4e71af7bcf9c
2025-08-27 16:16:19 -07:00
9acf80b8ad
Fix issue #13995 : Handle None metadata in batch requests ( #13996 )
...
* Fix issue #13995 : Handle None metadata in batch requests
- Added null check in add_key_level_controls method to prevent NoneType error
- Updated type hint to Optional[dict] for better type safety
- Added comprehensive test suite to verify the fix works correctly
- All existing tests pass, confirming no regression
Fixes #13995
Co-authored-by: openhands <openhands@all-hands.dev >
* Move test file to tests/test_litellm/proxy/ directory
- Moved test_batch_metadata_none_fix.py from tests/ to tests/test_litellm/proxy/
- Updated import structure to match existing test patterns
- This ensures the test runs in GitHub Actions as requested by @krrishdholakia
Co-authored-by: openhands <openhands@all-hands.dev >
---------
Co-authored-by: openhands <openhands@all-hands.dev >
2025-08-27 14:51:09 -07:00
Ishaan Jaff and GitHub
165242e31f
[Feat] langfuse_otel logger - allow using LANGFUSE_OTEL_HOST for configuring host ( #14013 )
...
* feat - add _get_langfuse_otel_host
* test_get_langfuse_otel_config_with_otel_host_priority
* docs: LANGFUSE_OTEL_HOST
2025-08-27 14:43:47 -07:00
Ifta Khairul Alam Adil
75aeca14b2
Merge branch 'main' into fix/gemini-imagen-model-name-validation
2025-08-27 21:52:47 +02:00
Sam Xie and GitHub
ee13c65701
[Bug]: /responses endpoint proxy ignores extra_headers in GitHub Copilot ( #13775 )
...
* fix: pass extra_headers parameter through responses API transformation chain
Ensure extra_headers parameter is properly forwarded from the responses() function
through the transformation handler and config to maintain header propagation in
litellm_completion_request dict.
* Add tests
2025-08-27 12:35:09 -07:00
Ishaan Jaff and GitHub
4fff05f1cc
[Feature]: Support Gemini requests with only system prompt ( #14010 )
...
* _default_user_message_when_system_message_passed
* test_system_prompt_only_adds_blank_user_message
* test_system_message_with_no_user_message
2025-08-27 12:12:47 -07:00
Kevin Turcios
8404fdea5b
Update in_memory_cache.py
2025-08-27 13:35:48 -05:00
Ishaan Jaff and GitHub
f35ce02475
[Bug Fix] LLM Translation - Allow using dynamic api_key for image generation requests ( #14007 )
...
* fix - allow using dyanmic api key for img gen
* test_aiml_image_generation_with_dynamic_api_key
2025-08-27 10:51:24 -07:00
