Ishaan Jaffer
b8eda0ef55
proxy_store_model_in_db_tests
2025-11-10 18:20:52 -08:00
Ishaan Jaff and GitHub
8140d85d28
[Bug Fix] - LiteLLM Usage shows key_hash- ( #16471 )
...
* test_get_logging_payload_api_key_preserved_when_standard_logging_payload_is_none
* fix get_logging_payload
* test_api_key_preserved_through_failure_hook_to_database
2025-11-10 18:15:52 -08:00
912be308b2
fix: allow internal users to access video generation routes ( #16472 )
...
Fixes #16470
Video generation endpoints (/v1/videos, /videos/{video_id}, etc.) were
incorrectly restricted to proxy_admin role only. These routes are now
added to openai_routes list, making them accessible to internal_user
role as they should be - video generation is a legitimate user feature,
not a management/admin operation.
Changes:
- Added 8 video route patterns to LiteLLMRoutes.openai_routes in _types.py
- Added comprehensive tests verifying internal_user and virtual key access
- All existing route permission tests continue to pass
🤖 Generated with [Claude Code](https://claude.com/claude-code )
Co-authored-by: Claude <noreply@anthropic.com >
2025-11-10 17:44:16 -08:00
Ishaan Jaffer
82d538c6f3
fix code qa check
2025-11-10 17:42:16 -08:00
yuneng-jiang and GitHub
a03c9fde4a
Add deprecation warning to Model Analytics Page ( #16417 )
2025-11-10 17:17:31 -08:00
Ishaan Jaff and GitHub
dc76b6c76e
[Fix] Management Endpoints - Fixes inconsistent error responses in customer management endpoints. Non-existent user errors now return proper 404 status codes with consistent error schema format across all endpoints. ( #16450 )
...
* fix: ensure end user endpoints use "handle_exception_on_proxy" correctly
* test 404 on info and update for non-existent user
* test 404 for no customer found
* fix 404 handling for customer endpoints
* test_error_schema_consistency
* test_customer_endpoints_error_schema_consistency
2025-11-10 17:16:53 -08:00
Cesar Garcia and GitHub
656dce92d0
docs: fix streaming example in README ( #16461 )
...
* docs: add messages variable definition in streaming example
- Add missing messages variable in streaming code example
- Makes the example complete and runnable without modifications
* docs: capitalize LiteLLM in streaming section
* docs: add gpt-4o comment
2025-11-10 17:16:17 -08:00
Artem and GitHub
3289038089
add kimi k2 thinking ( #16445 )
2025-11-10 15:56:06 -08:00
yuneng-jiang and GitHub
39ae7549a4
[Feature] UI - Model Info Page Health Check ( #16416 )
...
* Add test connection button to model info page
* Unused import
2025-11-10 11:10:06 -08:00
Artem and GitHub
a97676b8ae
Add softgen to projects that are using litellm ( #16423 )
...
* Add Softgen project documentation
* Add Softgen project to sidebars
* Update Softgen
2025-11-10 11:09:29 -08:00
Sameer Kankute and GitHub
013c195ab7
Fix container api link ( #16440 )
2025-11-10 11:09:10 -08:00
Krrish Dholakia
50f35fca47
docs: reorder docs
2025-11-10 07:33:22 -08:00
Ishaan Jaffer
c088483da9
docs playground
2025-11-08 18:15:52 -08:00
Ishaan Jaffer
8c1dd78c13
fix imports
2025-11-08 18:01:32 -08:00
Ishaan Jaffer
b2df26d0be
fix _transform_usage_objects
2025-11-08 17:29:19 -08:00
Ishaan Jaffer
8a8c24e391
ci/cd new deploy
2025-11-08 17:25:13 -08:00
Ishaan Jaffer
f2832ba2f8
docs fix
2025-11-08 17:25:01 -08:00
Ishaan Jaffer
b803af4aae
docs fix
2025-11-08 17:05:20 -08:00
Ishaan Jaffer
36d181e398
docs fix + linting fix
2025-11-08 17:02:00 -08:00
Ishaan Jaffer
42c1e4740a
docs built in guard
2025-11-08 16:59:00 -08:00
Ishaan Jaffer
a298a9d492
docs fix
2025-11-08 16:52:26 -08:00
Ishaan Jaffer
7fb46e0b29
docs fix
2025-11-08 16:50:51 -08:00
Ishaan Jaffer
4647b41d7f
docs fix
2025-11-08 16:50:06 -08:00
Krrish Dholakia
0640949333
fix(litellm_logging.py): correctly log token usage for audio transcription calls to langfuse
2025-11-08 16:47:58 -08:00
Ishaan Jaff and GitHub
08cfc2bf7e
[Docs] Litellm 1 79 2 rc ( #16415 )
...
* stash - v1
* docs fix
* docs fix
* docs
* folder fix
* docs fix
2025-11-08 16:47:15 -08:00
Alexsander Hamir and GitHub
277b564385
add: performance improvements to release notes ( #16401 )
...
* add: performance improvements to release notes
* fix: mention which endpoint is getting faster
* fix: clarify that reported latency is end-to-end
2025-11-08 16:42:58 -08:00
Ishaan Jaffer
3d9dcead8e
bump: version 1.79.2 → 1.79.3
2025-11-08 16:30:35 -08:00
Ishaan Jaff and GitHub
20180ff93b
[Docs] litellm content filter guard ( #16413 )
...
* add gif 1
* add guard 2
* add guard 3
* guard 5
* docs fix
* docs fix
2025-11-08 16:30:13 -08:00
Ishaan Jaff and GitHub
b242567778
[Bug Fix] Content Filter Guard ( #16414 )
...
* fix add_guardrail_to_db
* bump commit
2025-11-08 16:30:05 -08:00
Krish Dholakia and GitHub
6759ea0198
(feat) audio transcription - add gpt-4o-transcribe cost tracking ( #16412 )
...
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation
Fixes https://github.com/BerriAI/litellm/issues/11846
Closes https://github.com/BerriAI/litellm/issues/14605
* fix(cost_calculator.py): correctly use base model, when set
Fixes issue where azure base model was being ignored
* feat(cost_calculator.py): fix default cost tracking quality param for image generation
* feat(image_generations/): return output_format, quality, size
aligns response to openai spec and improves cost tracking accuracy
* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params
* build: update build
* fix: fix cost calculation
* build: update poetry lock
* fix: fix ruff checks
* fix: fix aembedding
* fix: fix ruff errors
* fix: modify to catch errors
* fix: test
* fix: loosen test to handle openai lib out of sync
* fix: fix base models
* fix: fix usage object
* fix(usage_object_transformation.py): add cost tracking for gpt-4o-mini-tts (uses token based usage tracking)
2025-11-08 16:25:57 -08:00
Krish Dholakia and GitHub
06906534b3
feat(audio_transcriptions/): calculate duration of audio file for cost calculation + feat (image_generations): cost tracking accuracy improved with output_format, quality, size values fixed per openai model
...
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation
Fixes https://github.com/BerriAI/litellm/issues/11846
Closes https://github.com/BerriAI/litellm/issues/14605
* fix(cost_calculator.py): correctly use base model, when set
Fixes issue where azure base model was being ignored
* feat(cost_calculator.py): fix default cost tracking quality param for image generation
* feat(image_generations/): return output_format, quality, size
aligns response to openai spec and improves cost tracking accuracy
* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params
* build: update build
* fix: fix cost calculation
* build: update poetry lock
* fix: fix ruff checks
* fix: fix aembedding
* fix: fix ruff errors
* fix: modify to catch errors
* fix: test
* fix: loosen test to handle openai lib out of sync
* fix: fix base models
* fix: fix usage object
2025-11-08 16:24:31 -08:00
Ishaan Jaffer
ef8e59e27e
fix types
2025-11-08 16:21:55 -08:00
Ishaan Jaffer
5299a97d2c
bump: version 1.79.1 → 1.79.2
2025-11-08 16:06:54 -08:00
Ishaan Jaffer
44a2299a24
UI new build
2025-11-08 16:06:39 -08:00
yuneng-jiang and GitHub
11af05f5f4
Small issues ( #16406 )
2025-11-08 16:05:42 -08:00
86d73c918c
Adds support for returning Azure Content Policy error information when exceptions from Azure OpenAI occur ( #16231 )
...
* add provider_specific_fields to ContentPolicyViolationError
* use provider_specific_fields in ProxyException
* update openai_exception_handler
* fix use exception checker for content policy violation azure
* add AzureOpenAIExceptionMapping
* test_azure_with_content_safety_error
* Accessing Provider-Specific Error Details
* TestExceptionCheckers
* unit test got provider_specific_fields=
* add clear types for error dict
* fix test_azure_with_content_safety_error
---------
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com >
2025-11-08 16:04:36 -08:00
e037d9315d
Add Vertex and Gemini Videos API with Cost Tracking + UI support ( #16323 )
...
* Use video id for videos api
* remove mock code
* Potential fix for code scanning alert no. 3630: Clear-text logging of sensitive information
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
* remove print statements
* Update video prefix for 'video_'
* Add veo with openai videos unified specs
* Add videos testing to UI
* remove mock code
* Remove not need ui changes:
* Fix mypy errors related to gemini
* fix test_transform_video_create_request
* Add vertex ai veo config
* Add vertex ai veo config
* Add cost tracking for gemini and add optional param passing
* fix bugs related to vertex ai veo
* Add Gemini Veo Video Generation in Openai Videos Unified Spec (#16229 )
* Add veo with openai videos unified specs
* Add videos testing to UI
* remove mock code
* Remove not need ui changes:
* Fix mypy errors related to gemini
* fix test_transform_video_create_request
* Add contant video duration for gemini and vertex
* Fix litellm_mapped_tests tests
* fix azure videos issue
* Added doc for videos vertex ai
* fix seconds param error
* fix lint errors
* test_transform_video_create_response_cost_tracking_no_duration
---------
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
Co-authored-by: Ishaan Jaffer <ishaanjaffer0324@gmail.com >
2025-11-08 16:03:51 -08:00
Alexsander Hamir and GitHub
454ffcd9c7
fix: install runtime node for prisma ( #16410 )
...
Prisma CLI recently started bootstrapping npm@10 inside the runtime image, which now fails with a sizeCalculation cache error on the slim Python base. Installing Debian's nodejs/npm (along with libatomic1) lets Prisma reuse the system binaries so prisma generate completes again.
2025-11-08 15:48:32 -08:00
Krish Dholakia and GitHub
202eaeb1a2
Revert "(feat) Audio transcription - cost tracking + (feat) image generation …" ( #16409 )
...
This reverts commit c96da44265
2025-11-08 15:38:16 -08:00
Krish Dholakia and GitHub
c96da44265
(feat) Audio transcription - cost tracking + (feat) image generation - accurate cost tracking based on output_format/quality/size
...
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation
Fixes https://github.com/BerriAI/litellm/issues/11846
Closes https://github.com/BerriAI/litellm/issues/14605
* fix(cost_calculator.py): correctly use base model, when set
Fixes issue where azure base model was being ignored
* feat(cost_calculator.py): fix default cost tracking quality param for image generation
* feat(image_generations/): return output_format, quality, size
aligns response to openai spec and improves cost tracking accuracy
* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params
* build: update build
* fix: fix cost calculation
* build: update poetry lock
* fix: fix ruff checks
* fix: fix aembedding
* fix: fix ruff errors
* fix: modify to catch errors
* fix: test
* fix: loosen test to handle openai lib out of sync
2025-11-08 15:30:46 -08:00
Ishaan Jaffer
0a1fc0eeb2
Revert "fix: fix ruff errors"
...
This reverts commit eef864360e
2025-11-08 14:33:51 -08:00
Krish Dholakia and GitHub
bce8a5d6b7
Revert "(feat) audio transcriptions cost tracking (for azure/other non-openai…" ( #16402 )
...
This reverts commit 9a88fe0861
2025-11-08 14:24:51 -08:00
Ishaan Jaffer
e4c31add58
test_dd_llms_obs_redaction
2025-11-08 14:23:42 -08:00
Krrish Dholakia
eef864360e
fix: fix ruff errors
2025-11-08 14:15:12 -08:00
Ishaan Jaffer
1bf284abca
test_delete_callbacks_in_db
2025-11-08 14:05:44 -08:00
Ishaan Jaffer
a4c008c433
test_datadog_message_redaction
2025-11-08 14:02:24 -08:00
Krish Dholakia and GitHub
9a88fe0861
(feat) audio transcriptions cost tracking (for azure/other non-openai models) + (fix) image generations - accurate cost tracking for dalle3/gpt-image-1 - uses the correct max image quality ( #16076 )
...
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation
Fixes https://github.com/BerriAI/litellm/issues/11846
Closes https://github.com/BerriAI/litellm/issues/14605
* fix(cost_calculator.py): correctly use base model, when set
Fixes issue where azure base model was being ignored
* feat(cost_calculator.py): fix default cost tracking quality param for image generation
* feat(image_generations/): return output_format, quality, size
aligns response to openai spec and improves cost tracking accuracy
* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params
* build: update build
* fix: fix cost calculation
* build: update poetry lock
* fix: fix ruff checks
2025-11-08 13:54:37 -08:00
Ishaan Jaffer
3f8f2d2185
redact_standard_logging_payload_from_model_call_details
2025-11-08 13:49:59 -08:00
Ishaan Jaffer
993c75d10b
test_redaction_responses_api
2025-11-08 13:43:22 -08:00
Ishaan Jaffer
9fff639b93
revert changes to redaction
2025-11-08 13:43:01 -08:00
Ishaan Jaffer