61cf169926
test_basic_openai_responses_api_streaming
2025-11-06 16:18:30 -08:00
78ed5126a5
fix: Fix Responses API streaming tests usage field names and cost ( #16236 )
...
This commit fixes two bugs in Responses API streaming tests:
1. **Usage field naming bug**: Tests were using `input_tokens` and
`output_tokens` but the Usage object uses `prompt_tokens` and
`completion_tokens`.
2. **Missing cost in streaming usage**: When `include_cost_in_streaming_usage`
was enabled, the cost was calculated and added to ResponseAPIUsage, but was
lost during the transformation to the Usage object.
Changes:
- Updated test assertions to use correct field names (prompt_tokens, completion_tokens)
- Added cost preservation logic in FakeStreamerResponsesAPIIterator
- Modified _transform_response_api_usage_to_chat_usage() to preserve cost attribute
All streaming tests now pass successfully.
2025-11-04 15:57:59 -08:00
44495c0117
fix encrypted content error ( #15782 )
2025-10-21 23:29:48 -07:00
97626f2d02
fix test
2025-10-11 11:30:19 -07:00
708c0bd78d
[Feat] Return Cost for Responses API Streaming requests ( #15053 )
...
* test_basic_openai_responses_api_streaming
* _transform_chat_completion_usage_to_responses_usage
* ResponseAPIUsage.cost
* test fixes for anthropic cost with /responses
* fix mypy typng
2025-09-29 19:47:04 -07:00
eaa04cd8ce
fix: use fastuuid helper ( #14903 )
...
* fix: use fastuuid helper across the codebase
First batch of changes, simple drop in replacement.
* second batch of changes
* fixed: script mistake on helper file
2025-09-25 15:47:01 -07:00
8e22cf5d65
[Fix] /responses API - add cancel endpoint + allow non-admins to use this as an llm api endpoint ( #14594 )
...
* fix: ensure /responses/cancel works for non admins
* test: cancel endpoint
* fix responses API cancel endpoint
* test fix
* TestGoogleAIStudioResponsesAPITest
2025-09-15 18:49:54 -07:00
110ce543c2
[Feat]Add cancel endpoint support for openai and azure ( #14561 )
...
* Add cancel endpoint support for openai
and azure
* fix lint error
* fix cancel url contruction azure
* readd changes
2025-09-15 07:08:56 -07:00
ad9f54a192
Move test to test_litellm/ folder
2025-09-05 10:08:34 +05:30
94c1b21ae7
Merge branch 'main' into litellm_responses_structured_output
2025-09-04 12:23:26 -07:00
fc9560573b
[BUG] Fix response api for reasoning item in input for litellm proxy ( #14200 )
...
* fix response api for litellm proxy
* Add test for checking if status is getting removed
* add test in correct file
* remove hardcoded fields
* Make the handling simpler
* fix lint error:
2025-09-04 10:36:48 -07:00
8d67392e99
Merge branch 'main' into litellm_responses_structured_output
2025-09-04 22:35:30 +05:30
5f79e8aac6
Litellm passthrough cost tracking chat completion ( #14256 )
...
* feat: add structured output for sdk
* Add support for cost tracking for chat completion in passthrough
* remove not required changes
2025-09-04 09:57:48 -07:00
8e363fe78c
feat: add structured output for sdk
2025-09-03 17:58:55 +05:30
cbb161f10b
test: handle internal server errors
2025-08-23 11:00:18 -07:00
76f1064229
[Bug Fix] litellm incompatible with newest release of openAI v1.100.0 ( #13728 )
...
* fix imports OpenAI SDK
* ResponseText fixes
* fixes ResponseText
* fix imports
* catch AttributeError
* fix import
* use openai==1.100.1
* fix build from PIP
* fix lint test
* Print OpenAI version
* fix Install dependencies
2025-08-18 18:26:17 -07:00
825ea65b96
[Bug Fix] Responses API - Responses API failed if input containing ResponseReasoningItem ( #13465 )
...
* add test_responses_api_multi_turn_with_reasoning_and_structured_output
* fix transform_responses_api_request
2025-08-09 11:20:34 -07:00
f3749709b8
Bug Fix - Responses API raises error with Gemini Tool Calls in input ( #13260 )
...
* add _transform_responses_api_function_call_to_chat_completion_message
* test_responses_api_with_tool_calls
* TestFunctionCallTransformation
* fixes for responses API testing google ai studio
* TestGoogleAIStudioResponsesAPITest
* test_responses_api_with_tool_calls
* test_responses_api_with_tool_calls
* test_basic_openai_responses_streaming_delete_endpoint
2025-08-04 12:01:33 -07:00
66a139a86a
test_basic_openai_responses_api_streaming
2025-07-19 15:30:03 -07:00
88834b8550
[Bump] Litellm responses format ( #12253 )
...
* Add responses format changes
* Add check
* Add check
* added more testing
2025-07-02 16:32:06 -07:00
4dc9626fd5
[Feat] New LLM API Endpoint - Add List input items for Responses API ( #11602 )
...
* (feat) add list_input_items
* add alist_input_items to router
* add GET input_items for responses API
* test_basic_openai_list_input_items_endpoint
* TestTransformListInputItemsRequest
* test_ensure_initialize_azure_sdk_client_always_used
2025-06-10 15:47:16 -07:00
66cf75cd5d
test: handle internal server errors
2025-05-01 16:47:30 -07:00
a69fa1dc1e
[Bug Fix] Responses API - fix for handling multiturn responses API sessions ( #10415 )
...
* fix for handling previous_response_id id sessions on responses API
* fix test_decode_previous_response_id_to_original_previous_response_id
2025-04-29 17:22:47 -07:00
dc9b058dbd
[Feat] Add support for GET Responses Endpoint - OpenAI, Azure OpenAI ( #10235 )
...
* Added get responses API (#10234 )
* test_basic_openai_responses_get_endpoint
* transform_get_response_api_request
* test_basic_openai_responses_get_endpoint
---------
Co-authored-by: Prathamesh Saraf <pratamesh1867@gmail.com >
2025-04-23 15:19:29 -07:00
868cdd0226
[Feat] Add Support for DELETE /v1/responses/{response_id} on OpenAI, Azure OpenAI ( #10205 )
...
* add transform_delete_response_api_request to base responses config
* add transform_delete_response_api_request
* add delete_response_api_handler
* fixes for deleting responses, response API
* add adelete_responses
* add async test_basic_openai_responses_delete_endpoint
* test_basic_openai_responses_delete_endpoint
* working delete for streaming on responses API
* fixes azure transformation
* TestAnthropicResponsesAPITest
* fix code check
* fix linting
* fixes for get_complete_url
* test_basic_openai_responses_streaming_delete_endpoint
* streaming fixes
2025-04-22 18:27:03 -07:00
0717369ae6
[Feat] Expose Responses API on LiteLLM UI Test Key Page ( #10166 )
...
* add /responses API on UI
* add makeOpenAIResponsesRequest
* add makeOpenAIResponsesRequest
* fix add responses API on UI
* fix endpoint selector
* responses API render chunks on litellm chat ui
* fixes to streaming iterator
* fix render responses completed events
* fixes for MockResponsesAPIStreamingIterator
* transform_responses_api_request_to_chat_completion_request
* fix for responses API
* test_basic_openai_responses_api_streaming
* fix base responses api tests
2025-04-19 13:18:54 -07:00
3d5022bd79
[Feat] Support for all litellm providers on Responses API (works with Codex) - Anthropic, Bedrock API, VertexAI, Ollama ( #10132 )
...
* transform request
* basic handler for LiteLLMCompletionTransformationHandler
* complete transform litellm to responses api
* fixes to test
* fix stream=True
* fix streaming iterator
* fixes for transformation
* fixes for anthropic codex support
* fix pass response_api_optional_params
* test anthropic responses api tools
* update responses types
* working codex with litellm
* add session handler
* fixes streaming iterator
* fix handler
* add litellm codex example
* fix code quality
* test fix
* docs litellm codex
* litellm codexdoc
* docs openai codex with litellm
* docs litellm openai codex
* litellm codex
* linting fixes for transforming responses API
* fix import error
* fix responses api test
* add sync iterator support for responses api
2025-04-18 19:53:59 -07:00
d3e04eac7f
[Feat] Unified Responses API - Add Azure Responses API support ( #10116 )
...
* initial commit for azure responses api support
* update get complete url
* fixes for responses API
* working azure responses API
* working responses API
* test suite for responses API
* azure responses API test suite
* fix test with complete url
* fix test refactor
* test fix metadata checks
* fix code quality check
2025-04-17 16:47:59 -07:00
Ishaan Jaffer