Krish Dholakia and GitHub
c96da44265
(feat) Audio transcription - cost tracking + (feat) image generation - accurate cost tracking based on output_format/quality/size
...
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation
Fixes https://github.com/BerriAI/litellm/issues/11846
Closes https://github.com/BerriAI/litellm/issues/14605
* fix(cost_calculator.py): correctly use base model, when set
Fixes issue where azure base model was being ignored
* feat(cost_calculator.py): fix default cost tracking quality param for image generation
* feat(image_generations/): return output_format, quality, size
aligns response to openai spec and improves cost tracking accuracy
* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params
* build: update build
* fix: fix cost calculation
* build: update poetry lock
* fix: fix ruff checks
* fix: fix aembedding
* fix: fix ruff errors
* fix: modify to catch errors
* fix: test
* fix: loosen test to handle openai lib out of sync
2025-11-08 15:30:46 -08:00
Ishaan Jaffer
0a1fc0eeb2
Revert "fix: fix ruff errors"
...
This reverts commit eef864360e
2025-11-08 14:33:51 -08:00
Krish Dholakia and GitHub
bce8a5d6b7
Revert "(feat) audio transcriptions cost tracking (for azure/other non-openai…" ( #16402 )
...
This reverts commit 9a88fe0861
2025-11-08 14:24:51 -08:00
Ishaan Jaffer
e4c31add58
test_dd_llms_obs_redaction
2025-11-08 14:23:42 -08:00
Krrish Dholakia
eef864360e
fix: fix ruff errors
2025-11-08 14:15:12 -08:00
Ishaan Jaffer
1bf284abca
test_delete_callbacks_in_db
2025-11-08 14:05:44 -08:00
Ishaan Jaffer
a4c008c433
test_datadog_message_redaction
2025-11-08 14:02:24 -08:00
Krish Dholakia and GitHub
9a88fe0861
(feat) audio transcriptions cost tracking (for azure/other non-openai models) + (fix) image generations - accurate cost tracking for dalle3/gpt-image-1 - uses the correct max image quality ( #16076 )
...
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation
Fixes https://github.com/BerriAI/litellm/issues/11846
Closes https://github.com/BerriAI/litellm/issues/14605
* fix(cost_calculator.py): correctly use base model, when set
Fixes issue where azure base model was being ignored
* feat(cost_calculator.py): fix default cost tracking quality param for image generation
* feat(image_generations/): return output_format, quality, size
aligns response to openai spec and improves cost tracking accuracy
* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params
* build: update build
* fix: fix cost calculation
* build: update poetry lock
* fix: fix ruff checks
2025-11-08 13:54:37 -08:00
Ishaan Jaffer
3f8f2d2185
redact_standard_logging_payload_from_model_call_details
2025-11-08 13:49:59 -08:00
Ishaan Jaffer
993c75d10b
test_redaction_responses_api
2025-11-08 13:43:22 -08:00
Ishaan Jaffer
9fff639b93
revert changes to redaction
2025-11-08 13:43:01 -08:00
Ishaan Jaffer
c43fcf2ded
test_redaction_responses_api
2025-11-08 13:39:40 -08:00
Ishaan Jaffer
f82852fdd0
redact_message_input_output_from_custom_logger
2025-11-08 13:30:03 -08:00
Alan Ponnachan and GitHub
30873688f2
docs: Add documentation for Anthropic memory tool ( #16388 )
2025-11-08 12:38:57 -08:00
6fb0a8fc58
Added xai responses support ( #16391 )
...
* Added xai responses support
* add the xai provider config above
* remove init file
* remove init file
* Fix f string lint error
---------
Co-authored-by: Ishaan Jaffer <ishaanjaffer0324@gmail.com >
2025-11-08 12:30:09 -08:00
Ishaan Jaffer
eef8c01d4e
test_redaction_responses_api
2025-11-08 12:29:38 -08:00
Ishaan Jaffer
1d2bdaebb6
test_openai_streaming_logging
2025-11-08 11:49:36 -08:00
Ishaan Jaffer
9b4e32c880
Revert "Added support for desabling thoughts by setting budget to 0 ( #16347 )"
...
This reverts commit b6f792f301
2025-11-08 11:34:05 -08:00
Ishaan Jaffer
c5f87d1d65
test responses api non streaming
2025-11-08 11:32:08 -08:00
Ishaan Jaffer
4fb521c251
test_basic_openai_responses_api_non_streaming_with_logging
2025-11-08 11:12:35 -08:00
Ishaan Jaffer
c60a13c919
fixes
2025-11-08 11:11:22 -08:00
Ishaan Jaffer
da7ecb3ea9
test_gemini_reasoning_effort_zero_budget_disables_thoughts
2025-11-08 11:10:54 -08:00
Ishaan Jaffer
9e3a8c4b0d
fix _success_handler_helper_fn
2025-11-08 11:06:12 -08:00
Ishaan Jaffer
bbcdf6f996
test_basic_openai_responses_api_non_streaming_with_logging
2025-11-08 10:47:48 -08:00
Ishaan Jaffer
0148b8d2f7
test_basic_openai_responses_api_non_streaming_with_logging
2025-11-08 10:36:47 -08:00
Ishaan Jaffer
78741ebd56
fix linting
2025-11-08 10:35:23 -08:00
Krish Dholakia and GitHub
c1b2dff595
fix(pass_through_endpoints.py): improve clearing logic - only remove unvisited endpoints ( #16400 )
...
simpler than clear all, and try to re-add
2025-11-08 10:33:47 -08:00
Ishaan Jaffer
bae1857787
fix doc
2025-11-08 10:31:19 -08:00
Ishaan Jaffer
89157f4b5c
test_basic_openai_responses_api_streaming_with_logging
2025-11-08 10:30:41 -08:00
Ishaan Jaffer
9b6a4c2650
bump pyproject
2025-11-08 10:24:23 -08:00
Ishaan Jaffer
e64c889b1e
bump proxy exras
2025-11-08 10:22:36 -08:00
Ishaan Jaffer
ec2749199e
bump: version 0.4.2 → 0.4.3
2025-11-08 10:21:47 -08:00
Ishaan Jaffer
eec76cbe49
add safe_dumps
2025-11-08 10:19:38 -08:00
Ishaan Jaffer
6bb963dca2
test_basic_openai_responses_api_non_streaming_with_logging
2025-11-08 10:13:27 -08:00
Ishaan Jaffer
68d24b40c6
test_gemini_25_implicit_caching_cost
2025-11-08 10:13:04 -08:00
yuneng-jiang and GitHub
8412950b94
[Feature] UI - Cache Settings Redis Add Semantic Cache Settings ( #16398 )
...
* Tests
* Merging Tests
* Redis Semantic Cache Settings
* Readd mock to test
* Fixing build issues
2025-11-08 10:09:49 -08:00
Ishaan Jaffer
f9d95b71bb
fix _get_assembled_streaming_response
2025-11-08 10:08:03 -08:00
yuneng-jiang and GitHub
f9ee0cb79d
Building UI for sanity testing ( #16399 )
2025-11-08 09:44:05 -08:00
Ishaan Jaffer
14c5665820
fix remove unused var
2025-11-08 09:29:50 -08:00
yuneng-jiang and GitHub
e26875b8ed
[Fix] UI - Test Key Page Revert Model To Single Select ( #16390 )
...
* Test Key Single Select
* fix build issues
2025-11-08 09:08:32 -08:00
Ishaan Jaffer
7bf9d69007
test_gemini_reasoning_effort_env_override
2025-11-07 22:09:59 -08:00
Ishaan Jaffer
45323dd537
test_patch_guardrail_endpoint
2025-11-07 22:09:52 -08:00
Alan Ponnachan and GitHub
2408e09f6a
feat: Add support for Anthropic Memory Tool ( #16115 )
...
* add memory tool in anthropic.py
* add memory tool test
* make format
* update transformation
* adding memory to hosted tools
* add test
* make format
2025-11-07 19:27:28 -08:00
YutaSaito and GitHub
6eb74bd62a
Feat/persist mcp credentials in db ( #16308 )
...
* feat: persist mcp credentials in db
* feat: remove Auth Value field from MCP Tool Testing Playground
* fix: test
2025-11-07 19:22:49 -08:00
Sameer Kankute and GitHub
b6f792f301
Added support for desabling thoughts by setting budget to 0 ( #16347 )
2025-11-07 19:19:16 -08:00
Jack Cherng and GitHub
2ab34f9a52
Fix HostedVLLMRerankConfig will not be used ( #16352 )
...
* Fix HostedVLLMRerankConfig will not be used
Signed-off-by: Jun-Fei Cherng <jfcherng@realtek.com >
* Fix no usage statistics in rerank with hosted_vllm
Signed-off-by: Jun-Fei Cherng <jfcherng@realtek.com >
* Revise typo in comment
Signed-off-by: Jun-Fei Cherng <jfcherng@realtek.com >
---------
Signed-off-by: Jun-Fei Cherng <jfcherng@realtek.com >
2025-11-07 19:11:59 -08:00
Sumit Tembe and GitHub
0a527bd1d8
Fix cache_read_input_token_cost for gemini-2.5-flash ( #16354 )
2025-11-07 19:11:10 -08:00
Sameer Kankute and GitHub
fd95909d9f
Add cohere embed v4 model support ( #16358 )
2025-11-07 19:10:42 -08:00
Will Chen and GitHub
c495320b87
Propagate cache creation/read token costs for model info to fix Anthropic long context cost calculations ( #16376 )
...
* Fix
* fix
* fix
* fix
2025-11-07 19:06:43 -08:00
Cesar Garcia and GitHub
d65a29b88d
docs: fix image generation response format from 'image' to 'images' ( #16378 )
...
Update documentation to reflect actual API response format:
- Change singular 'image' field to plural 'images' array
- Add complete ImageURLListItem structure with index and type fields
- Update all code examples to use message.images instead of message.image
- Fix streaming examples to access images[0]["image_url"]["url"]
The documentation was incorrectly showing 'image' (singular object)
but the actual implementation returns 'images' (array of ImageURLListItem).
Related to issue #16227
2025-11-07 19:06:03 -08:00
