eycjur
b472bf6aef
update docs
2025-09-06 21:15:59 +09:00
eycjur
58cf72ef5e
add test
2025-09-06 21:12:18 +09:00
eycjur
e27c4c98c0
Added conditional branch for gpt-oss
2025-09-06 21:11:53 +09:00
Sameer Kankute and GitHub
07ba3ff036
[Feat] Add pass through image gen and image editing on OpenAI ( #14292 )
...
* add pass through image gen and image editing on OpenAI
* fix lint
2025-09-05 12:25:49 -07:00
Pierre-Emmanuel MERCIER and GitHub
31f806f7d0
feat: add redis ssl and username support ( #11319 )
2025-09-05 10:35:11 -07:00
Krrish Dholakia
c051ab5b5a
refactor: remove unused function
2025-09-05 10:21:16 -07:00
Ishaan Jaff
0a60390521
Revert "[Feat] LiteLLM CloudZero Integration updates - using LiteLLM_SpendLogs Table ( #12922 )"
...
This reverts commit e3b752d3dc
2025-09-05 10:04:07 -07:00
Ishaan Jaff and GitHub
982800069c
[Bug Fix] x-litellm-tags not routing with Responses API ( #14289 )
...
* fix: get_deployments_for_tag
* fix get_deployments_for_tag
* test_router_tag_routing.py
* test_get_metadata_variable_name_from_kwargs
* fix mapped tests
* docs fix
2025-09-05 09:40:37 -07:00
Krish Dholakia and GitHub
63a2a47ce0
Merge pull request #14003 from BerriAI/teams-on-users-page
...
Team name badge added on the User Details
2025-09-04 21:03:02 -07:00
Krish Dholakia and GitHub
f67339a86c
Merge pull request #14028 from onlylhf/volcengine-embedding-support
...
Add Volcengine embedding module with handler and transformation logic
2025-09-04 21:01:25 -07:00
Krish Dholakia and GitHub
62d4623d1c
Merge pull request #14107 from uc4w6c/feat/add_guardrails_anthropic
...
feat: Add guardrail to the Anthropic API endpoint
2025-09-04 20:50:43 -07:00
Krish Dholakia and GitHub
5d5c19a302
Merge pull request #14077 from TomeHirata/codex/add-support-for-anthropic-citation-api
...
Add support for anthropic citation api in Databricks
2025-09-04 20:46:11 -07:00
Ishaan Jaff and GitHub
379b0dbf14
[Fix] Ensure team_id is a required field for generating service account keys ( #14270 )
...
* generate_service_account_key_fn
* fix validate_team_id_used_in_service_account_request
* fix types
* test_validate_team_id_used_in_service_account_request_requires_team_id
2025-09-04 18:14:38 -07:00
5847037b3a
Add validation for STORE_MODEL_IN_DB when updating public model groups ( #14269 )
...
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
Co-authored-by: ishaan <ishaan@berri.ai >
2025-09-04 14:40:28 -07:00
Ishaan Jaff and GitHub
1352545617
[Fix] DD LLM Observability - Ensure apm_id is set on traces ( #14272 )
...
* add apm_id for DD LLM
* feat: add _get_apm_trace_id
2025-09-04 14:35:41 -07:00
Krish Dholakia and GitHub
796192dabe
Merge pull request #14130 from moshemorad/bedrock_fix_structure_output
...
Bedrock fix structure output
2025-09-04 12:22:35 -07:00
Krish Dholakia and GitHub
1c75139cd3
Merge pull request #14136 from BerriAI/add-client-side-pagination
...
Add client side pagination on All Models table
2025-09-04 12:21:48 -07:00
Krish Dholakia and GitHub
e7b4892124
Merge pull request #14156 from byrongrogan/byron--bedrock-passthrough-override
...
fix: Support AWS_BEDROCK_RUNTIME_ENDPOINT on bedrock passthrough, make work for URLs with a base path
2025-09-04 12:20:17 -07:00
Sameer Kankute and GitHub
fc9560573b
[BUG] Fix response api for reasoning item in input for litellm proxy ( #14200 )
...
* fix response api for litellm proxy
* Add test for checking if status is getting removed
* add test in correct file
* remove hardcoded fields
* Make the handling simpler
* fix lint error:
2025-09-04 10:36:48 -07:00
Sameer Kankute and GitHub
5f79e8aac6
Litellm passthrough cost tracking chat completion ( #14256 )
...
* feat: add structured output for sdk
* Add support for cost tracking for chat completion in passthrough
* remove not required changes
2025-09-04 09:57:48 -07:00
Ishaan Jaff
1237be04a5
test_aaamodel_prices_and_context_window_json_is_valid
2025-09-04 07:58:20 -07:00
Krish Dholakia and GitHub
572ac0b88f
Merge pull request #14211 from zhxlp/main
...
fix: image_generation supports extra_body parameter
2025-09-04 07:35:53 -07:00
Krish Dholakia and GitHub
cb8e3936ae
Merge pull request #14216 from mubashir1osmani/fix_all_docs
...
Fix custom callbacks doc
2025-09-04 07:35:38 -07:00
Krish Dholakia and GitHub
8738f630ac
Merge pull request #14232 from mubashir1osmani/litellm_docs
...
[docs]: added more info to load balancing & pass through endpoints
2025-09-04 07:31:54 -07:00
Ishaan Jaff
8878951f16
docs fix: disable_add_user_agent_to_request_tags
2025-09-04 07:30:18 -07:00
Krish Dholakia and GitHub
a8cce5fbf3
Merge pull request #14237 from yeahyung/fix/tpm_limit_bug
...
Fixes #14204 TPM Rate Limit Bug
2025-09-04 07:29:47 -07:00
Krish Dholakia and GitHub
a74feb221f
Merge pull request #14241 from 22mSqRi/fix-key-reset-and-expires
...
fix: Key Budget not resets at expectable times
2025-09-04 07:29:06 -07:00
22mSqRi
25afa67616
fix: Key Budget not resets at expectable times
2025-09-04 09:04:01 +00:00
yeahyung
7829de2948
( #14204 ) add test code
2025-09-04 16:41:29 +09:00
yeahyung
9e3010daa4
( #14204 ) increase token usage with TTL preservation
2025-09-04 16:41:23 +09:00
mubashir1osmani
b0450d2ddf
docs: added more info to load balancing & passthrough endpoints
2025-09-03 23:58:48 -04:00
Ishaan Jaff
69d5a91e02
bump: version 1.76.2 → 1.76.3
2025-09-03 18:28:52 -07:00
Ishaan Jaff and GitHub
ab3cd5e96e
fix memory_usage_in_mem_cache cache endpoint vulnerability ( #14229 )
2025-09-03 18:28:11 -07:00
Ishaan Jaff and GitHub
23ae7170d1
[Feat] Allow using Veo Video Generation through LiteLLM Pass through routes ( #14228 )
...
* fix: add follow_redirects=True,
* test_pass_through_with_httpbin_redirect
* cook book veo video
* docs Veo Video Generation with Google AI Studio
* add veo-3.0-generate-preview cost tracking details
* track vertex_video_models
2025-09-03 18:25:43 -07:00
Ishaan Jaff
be7c762882
add video_generation
2025-09-03 18:25:27 -07:00
Ishaan Jaff and GitHub
19e2bab8c8
[Feat] Add Initial support for Bedrock Batches API ( #14190 )
...
* fix acreate_file with bedrock
* fix routing to bedrock batches api
* fix create_file
* working batch file upload
* fix batches API for file upload
* test: bedrock files and batches API
* add BaseBatchesConfig
* fix get_provider_batches_config
* transform bedrock batches
* fix run create batch through llm http handler
* test_async_file_and_batch
* main.batches creation
* fix: CommonBatchFilesUtils
* fix async_create_batch
* test_async_file_and_batch
* BedrockBatchesConfig
* fix ruff check
* ruff check fix
* fix docs ref
2025-09-03 17:19:58 -07:00
Ishaan Jaff and GitHub
beb300abae
[Fix] SCIM - Bug fixes for handling SCIM Group Memberships ( #14226 )
...
* Feat: add better SCIM debugging
* fix _get_scim_member_display
* fix patch_group
* test_update_group_e2e
* test_get_scim_member_value
2025-09-03 16:15:51 -07:00
Ishaan Jaff
e127820bf1
fix proxy_logging_guardrails_model_info_tests
2025-09-03 16:10:30 -07:00
Ishaan Jaff and GitHub
1d44a6e4a1
Feat: add better SCIM debugging ( #14221 )
2025-09-03 15:52:53 -07:00
Yuta Saito
447016817c
fix: Call guardrail during stream processing
2025-09-04 07:11:44 +09:00
Ishaan Jaff
057d6f5af6
fix: PartnerModelPrefixes
2025-09-03 13:03:04 -07:00
Ishaan Jaff
c9f211f331
fix VertexAIPartnerModels
2025-09-03 13:01:47 -07:00
Ishaan Jaff
8e9352fce7
test fix
2025-09-03 11:06:09 -07:00
Ishaan Jaff
3b8409f469
bump: version 1.76.1 → 1.76.2
2025-09-03 11:00:07 -07:00
Ishaan Jaff
9eecff9d9a
test_proxy_custom_logger.py::test_chat_completio
2025-09-03 10:57:10 -07:00
katsuhiro muto and GitHub
ca43514db4
[Feat] Support reasoning_effort in Groq ( #14207 )
...
* Support reasoning_effort in groq
* add test
2025-09-03 10:43:47 -07:00
Harshavardhan K and GitHub
bc84b411f4
Fix/remove deprecated cerebras gpt oss 20b ( #14213 )
...
* fix: remove deprecated cerebras/openai/gpt-oss-20b model from pricing files
- Remove cerebras/openai/gpt-oss-20b entry from model_prices_and_context_window.json
- Remove cerebras/openai/gpt-oss-20b entry from model_prices_and_context_window_backup.json
- Fixes GitHub issue #13972 where the deprecated model was still being treated as valid
- Only the 120b version is now supported by Cerebras
* fix: remove deprecated cerebras gpt-oss-20b
2025-09-03 09:46:08 -07:00
mubashir1osmani
d1c376f93e
fix custom callback docs
2025-09-03 12:45:42 -04:00
zhxlp
583df9ade0
fix: image_generation supports extra_body parameter
2025-09-03 23:27:28 +08:00
mubashir1osmani
ecc607257b
fixed prometheus metrics
2025-09-03 02:14:59 -04:00
eycjur