5d5c19a302
Merge pull request #14077 from TomeHirata/codex/add-support-for-anthropic-citation-api
...
Add support for anthropic citation api in Databricks
2025-09-04 20:46:11 -07:00
379b0dbf14
[Fix] Ensure team_id is a required field for generating service account keys ( #14270 )
...
* generate_service_account_key_fn
* fix validate_team_id_used_in_service_account_request
* fix types
* test_validate_team_id_used_in_service_account_request_requires_team_id
2025-09-04 18:14:38 -07:00
5847037b3a
Add validation for STORE_MODEL_IN_DB when updating public model groups ( #14269 )
...
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
Co-authored-by: ishaan <ishaan@berri.ai >
2025-09-04 14:40:28 -07:00
1352545617
[Fix] DD LLM Observability - Ensure apm_id is set on traces ( #14272 )
...
* add apm_id for DD LLM
* feat: add _get_apm_trace_id
2025-09-04 14:35:41 -07:00
796192dabe
Merge pull request #14130 from moshemorad/bedrock_fix_structure_output
...
Bedrock fix structure output
2025-09-04 12:22:35 -07:00
1c75139cd3
Merge pull request #14136 from BerriAI/add-client-side-pagination
...
Add client side pagination on All Models table
2025-09-04 12:21:48 -07:00
e7b4892124
Merge pull request #14156 from byrongrogan/byron--bedrock-passthrough-override
...
fix: Support AWS_BEDROCK_RUNTIME_ENDPOINT on bedrock passthrough, make work for URLs with a base path
2025-09-04 12:20:17 -07:00
fc9560573b
[BUG] Fix response api for reasoning item in input for litellm proxy ( #14200 )
...
* fix response api for litellm proxy
* Add test for checking if status is getting removed
* add test in correct file
* remove hardcoded fields
* Make the handling simpler
* fix lint error:
2025-09-04 10:36:48 -07:00
5f79e8aac6
Litellm passthrough cost tracking chat completion ( #14256 )
...
* feat: add structured output for sdk
* Add support for cost tracking for chat completion in passthrough
* remove not required changes
2025-09-04 09:57:48 -07:00
1237be04a5
test_aaamodel_prices_and_context_window_json_is_valid
2025-09-04 07:58:20 -07:00
572ac0b88f
Merge pull request #14211 from zhxlp/main
...
fix: image_generation supports extra_body parameter
2025-09-04 07:35:53 -07:00
cb8e3936ae
Merge pull request #14216 from mubashir1osmani/fix_all_docs
...
Fix custom callbacks doc
2025-09-04 07:35:38 -07:00
8738f630ac
Merge pull request #14232 from mubashir1osmani/litellm_docs
...
[docs]: added more info to load balancing & pass through endpoints
2025-09-04 07:31:54 -07:00
8878951f16
docs fix: disable_add_user_agent_to_request_tags
2025-09-04 07:30:18 -07:00
a8cce5fbf3
Merge pull request #14237 from yeahyung/fix/tpm_limit_bug
...
Fixes #14204 TPM Rate Limit Bug
2025-09-04 07:29:47 -07:00
a74feb221f
Merge pull request #14241 from 22mSqRi/fix-key-reset-and-expires
...
fix: Key Budget not resets at expectable times
2025-09-04 07:29:06 -07:00
25afa67616
fix: Key Budget not resets at expectable times
2025-09-04 09:04:01 +00:00
7829de2948
( #14204 ) add test code
2025-09-04 16:41:29 +09:00
9e3010daa4
( #14204 ) increase token usage with TTL preservation
2025-09-04 16:41:23 +09:00
b0450d2ddf
docs: added more info to load balancing & passthrough endpoints
2025-09-03 23:58:48 -04:00
69d5a91e02
bump: version 1.76.2 → 1.76.3
2025-09-03 18:28:52 -07:00
ab3cd5e96e
fix memory_usage_in_mem_cache cache endpoint vulnerability ( #14229 )
2025-09-03 18:28:11 -07:00
23ae7170d1
[Feat] Allow using Veo Video Generation through LiteLLM Pass through routes ( #14228 )
...
* fix: add follow_redirects=True,
* test_pass_through_with_httpbin_redirect
* cook book veo video
* docs Veo Video Generation with Google AI Studio
* add veo-3.0-generate-preview cost tracking details
* track vertex_video_models
2025-09-03 18:25:43 -07:00
be7c762882
add video_generation
2025-09-03 18:25:27 -07:00
19e2bab8c8
[Feat] Add Initial support for Bedrock Batches API ( #14190 )
...
* fix acreate_file with bedrock
* fix routing to bedrock batches api
* fix create_file
* working batch file upload
* fix batches API for file upload
* test: bedrock files and batches API
* add BaseBatchesConfig
* fix get_provider_batches_config
* transform bedrock batches
* fix run create batch through llm http handler
* test_async_file_and_batch
* main.batches creation
* fix: CommonBatchFilesUtils
* fix async_create_batch
* test_async_file_and_batch
* BedrockBatchesConfig
* fix ruff check
* ruff check fix
* fix docs ref
2025-09-03 17:19:58 -07:00
beb300abae
[Fix] SCIM - Bug fixes for handling SCIM Group Memberships ( #14226 )
...
* Feat: add better SCIM debugging
* fix _get_scim_member_display
* fix patch_group
* test_update_group_e2e
* test_get_scim_member_value
2025-09-03 16:15:51 -07:00
e127820bf1
fix proxy_logging_guardrails_model_info_tests
2025-09-03 16:10:30 -07:00
1d44a6e4a1
Feat: add better SCIM debugging ( #14221 )
2025-09-03 15:52:53 -07:00
057d6f5af6
fix: PartnerModelPrefixes
2025-09-03 13:03:04 -07:00
c9f211f331
fix VertexAIPartnerModels
2025-09-03 13:01:47 -07:00
8e9352fce7
test fix
2025-09-03 11:06:09 -07:00
3b8409f469
bump: version 1.76.1 → 1.76.2
2025-09-03 11:00:07 -07:00
9eecff9d9a
test_proxy_custom_logger.py::test_chat_completio
2025-09-03 10:57:10 -07:00
ca43514db4
[Feat] Support reasoning_effort in Groq ( #14207 )
...
* Support reasoning_effort in groq
* add test
2025-09-03 10:43:47 -07:00
bc84b411f4
Fix/remove deprecated cerebras gpt oss 20b ( #14213 )
...
* fix: remove deprecated cerebras/openai/gpt-oss-20b model from pricing files
- Remove cerebras/openai/gpt-oss-20b entry from model_prices_and_context_window.json
- Remove cerebras/openai/gpt-oss-20b entry from model_prices_and_context_window_backup.json
- Fixes GitHub issue #13972 where the deprecated model was still being treated as valid
- Only the 120b version is now supported by Cerebras
* fix: remove deprecated cerebras gpt-oss-20b
2025-09-03 09:46:08 -07:00
d1c376f93e
fix custom callback docs
2025-09-03 12:45:42 -04:00
583df9ade0
fix: image_generation supports extra_body parameter
2025-09-03 23:27:28 +08:00
ecc607257b
fixed prometheus metrics
2025-09-03 02:14:59 -04:00
63c4a30564
TestVertexAIGPTOSSTransformation
2025-09-02 23:07:52 -07:00
35b501b8d5
Merge pull request #14176 from mjmendo/feat/alert_type_in_slack_message
...
feat: added alert type to alert messate to slack for easier handling
2025-09-02 23:05:41 -07:00
dc0d2a44a5
Merge pull request #14171 from kutsushitaneko/fix/14158_tool_call_id
...
fix(oci): Handle assistant messages with both content and tool_calls in OCI provider (#14158 )
2025-09-02 23:05:04 -07:00
6e852bcec6
Merge pull request #14169 from BerriAI/remove-filters-in-user-info
...
Remove table filter on user info page
2025-09-02 23:03:30 -07:00
c8b177963e
Merge pull request #14191 from kayoch1n/fix-h11-model-name
...
Remove "/" or ":" from model name when being used as h11 header name
2025-09-02 23:02:45 -07:00
cfead05086
Merge pull request #14193 from zhxlp/main
...
fix: Log page parameter passing error
2025-09-02 23:01:17 -07:00
54cca0cc7e
fix: Log page parameter passing error
2025-09-03 11:34:58 +08:00
76555cad81
Format code
2025-09-03 11:20:52 +08:00
1a97a80c51
Format code
2025-09-03 11:18:57 +08:00
ffbe5cd899
Add a testcase
2025-09-03 11:08:23 +08:00
46655544a4
Merge pull request #14179 from zhirafovod/otel_logs_metrics
2025-09-02 19:50:40 -07:00
edf047b6bb
Replace "/" with "-" in model name when being used as a h11 header name
2025-09-03 10:00:16 +08:00
Krish Dholakia