 Ishaan Jaffer
|
0bedf1c0a7
|
fix tests
|
2025-10-25 10:19:24 -07:00 |
|
|
Ishaan Jaffer
|
c27beb74b9
|
test fix
|
2025-09-27 12:40:34 -07:00 |
|
|
Ishaan JaffandGitHub
|
4d941c914e
|
[Feat] Responses API Session Handling - Multi media support (#13347)
* rename ResponsesSessionHandler
* use ResponsesSessionHandler
* test session handler
* refactor ResponsesSessionHandler
* fix get_proxy_server_request_from_spend_log
* use constant for LITELLM_TRUNCATED_PAYLOAD_FIELD
* add _should_check_cold_storage_for_full_payload
* add get_class_type_for_custom_logger_name
* get_active_custom_logger_for_callback_name
* add get_proxy_server_request_from_cold_storage to CustomLogger
* add ColdStorageHandler
* start using cold storage integration
* add get_proxy_server_request_from_cold_storage
* fixes from manual testing
* s3 v2 fix getting region name
* ChatCompletionImageUrlObject
* use _get_configured_cold_storage_custom_logger
* fixes for _should_check_cold_storage_for_full_payload
* fix _download_object_from_s3
* test_s3_v2_with_cold_storage
* add cold_storage_object_key to StandardLoggingMetadata
* use get_proxy_server_request_from_cold_storage_with_object_key
* add cold_storage_object_key to SpendLogsMetadata
* add cold_storage_object_key
* get_proxy_server_request_from_cold_storage_with_object_key
* use get_proxy_server_request_from_cold_storage_with_object_key
* test responses API
* add get_proxy_server_request_from_cold_storage_with_object_key
* session handler fixes
* test session handler
* fix ruff checks
* _download_object_from_s3
* cleanup
* test
* lint fix
* test_e2e_cold_storage_successful_retrieval
* test_e2e_generate_cold_storage_object_key_successful
* test_async_gcs_pub_sub_v1
* test fix
* test fix
* test fix
* test_standard_logging_metadata_has_cold_storage_object_key_field
* test_sanitize_request_body_for_spend_logs_payload_basic
* test_transform_input_image_item_to_image_item_with_image_data
|
2025-08-07 10:59:53 -07:00 |
|
|
Ishaan JaffandGitHub
|
3d71b49d11
|
[Feat] Add failure logging support for s3 logger (#12299)
* add async_log_failure_event
* test_basic_s3_v2_logging_failure
|
2025-07-04 11:11:30 -07:00 |
|
|
Ishaan JaffandGitHub
|
3db272b6d2
|
[Perf] - Add Async + Batched S3 Logging (#11340)
* fix: add s3 v2 async
* fix: add s3 v2 async
* fix: add s3 v2 async
* test: s3 v2 logging
* fixes: s3 logging
* fixes: s3 logging use max upload batch size
* fixes: s3 logging tests
* fixes: s3 logging tests
* fixes: s3 logging tests
|
2025-06-02 21:52:34 -07:00 |
|
|
Krish DholakiaandGitHub
|
1ea046cc61
|
test: update tests to new deployment model (#10142)
* test: update tests to new deployment model
* test: update model name
* test: skip cohere rbac issue test
* test: update test - replace gpt-4o model
|
2025-04-18 14:22:12 -07:00 |
|
|
Ishaan JaffandGitHub
|
b6f2e659b9
|
(Feat) Add x-litellm-overhead-duration-ms and "x-litellm-response-duration-ms" in response from LiteLLM (#7899)
* add track_llm_api_timing
* add track_llm_api_timing
* test_litellm_overhead
* use ResponseMetadata class for setting hidden params and response overhead
* instrument http handler
* fix track_llm_api_timing
* track_llm_api_timing
* emit response overhead on hidden params
* fix resp metadata
* fix make_sync_openai_embedding_request
* test_aaaaatext_completion_endpoint fixes
* _get_value_from_hidden_params
* set_hidden_params
* test_litellm_overhead
* test_litellm_overhead
* test_litellm_overhead
* fix import
* test_litellm_overhead_stream
* add LiteLLMLoggingObject
* use diff folder for testing
* use diff folder for overhead testing
* test litellm overhead
* use typing
* clear typing
* test_litellm_overhead
* fix async_streaming
* update_response_metadata
* move test file
* pply metadata to the response objec
|
2025-01-21 20:27:55 -08:00 |
|