Commit Graph

3019 Commits

Author SHA1 Message Date
Ishaan Jaff f1699d4cbf fix IGNORE_FUNCTIONS 2025-09-08 17:33:36 -07:00
Ishaan Jaff e37c1069a1 fix test images gemini 2025-09-08 17:22:59 -07:00
Ishaan Jaff 6400552308 fix lic check 2025-09-08 17:18:42 -07:00
Ishaan Jaff c7f9be6803 test_async_log_cache_hit_on_callbacks 2025-09-08 17:15:53 -07:00
Krish Dholakia 9a62b9bdb9 Merge pull request #14161 from BerriAI/litellm_dev_09_01_2025_p2
Security fix - prevent proxy_admin_viewer from modifying other user's credentials + remove hardcoded sensitive keys from test repo
2025-09-06 22:14:45 -07:00
Krish Dholakia e31b2d9eba Merge pull request #9902 from btemplep/main
fix bedrock embedding invocations with app inference profiles
2025-09-06 22:13:35 -07:00
Krish Dholakia fbc0ec98b6 Merge pull request #12438 from jasonpnnl/fix-customer-update
Fix 500 error in `/customer/update` endpoint when updating with `budget_id`
2025-09-06 22:12:30 -07:00
Krish Dholakia ba10173ec7 Merge branch 'main' into heroku-llms 2025-09-06 22:10:20 -07:00
Krish Dholakia 884cca7da9 Merge pull request #12984 from darashenka/main
honor OLLAMA_API_KEY for ollama_chat
2025-09-06 22:07:28 -07:00
Krrish Dholakia 06d472f205 test: fix tests 2025-09-06 21:59:02 -07:00
Krish Dholakia db6fd68540 Merge pull request #14160 from BerriAI/litellm_dev_09_01_2025_p1
MINOR update: Add openrouter image generation support + refactor Gemini `image` output param to be `images` (openrouter compatible)
2025-09-06 19:26:00 -07:00
Ishaan Jaff c9ab104445 [Fix] Perf fix: Heavy RAM Usage over time when using Passthrough Routes (#14305)
* Implement pass-through route registration and removal to prevent duplicates and memory leaks

* fix MYPY linting

* fix InitPassThroughEndpointHelpers

* fix test_aaparallel_function_call

---------

Co-authored-by: Jugal Bhatt <jugalbhatt3@gmail.com>
2025-09-06 19:22:25 -07:00
Krish Dholakia 2716fa7981 Merge branch 'main' into litellm_dev_09_01_2025_p2 2025-09-06 19:03:25 -07:00
Krrish Dholakia 5a0328b1a9 test: update tests 2025-09-06 19:02:03 -07:00
Krish Dholakia a3ffc3060e Merge branch 'main' into litellm_dev_09_01_2025_p1 2025-09-06 18:50:49 -07:00
Ishaan Jaff 0f26ec57d8 TestGroq 2025-09-06 18:19:09 -07:00
Ishaan Jaff 3b0aec2e5d test_azure_openai_gpt_5_responses_api 2025-09-06 17:47:01 -07:00
Ishaan Jaff 679d0414e2 test fix 2025-09-06 17:08:31 -07:00
Ishaan Jaff d89a2a0797 test 2025-09-06 16:38:43 -07:00
Ishaan Jaff c168fff38a test_cooldown_badrequest_error 2025-09-06 16:28:00 -07:00
Ishaan Jaff 2982c2a932 fix test_key_budget_metrics 2025-09-06 16:18:50 -07:00
Ishaan Jaff 7054067238 test_cooldown_handlers.py 2025-09-06 16:13:30 -07:00
Ishaan Jaff c709d7505d test fix: test_parallel_streaming_requests 2025-09-06 16:07:30 -07:00
Ishaan Jaff 49532d6d8b Revert "[Feat]Cancel upstream on client disconnect (#14295)" (#14304)
This reverts commit 51de2ebb64.
2025-09-06 15:29:15 -07:00
Ishaan Jaff 7f5460465c unit test oai pass through 2025-09-06 14:54:34 -07:00
Ishaan Jaff b1552cae46 fix mocked CZ tests 2025-09-06 14:33:02 -07:00
Ishaan Jaff 8920a645e9 Revert "feat: add redis ssl and username support (#11319)" (#14303)
This reverts commit 31f806f7d0.
2025-09-06 14:01:00 -07:00
Ishaan Jaff fc7accad74 test_dry_run_export_usage_data_cbf_transformation_failure 2025-09-06 13:59:28 -07:00
Ishaan Jaff 1227b54fa6 test_get_model_info_gemini 2025-09-06 13:43:42 -07:00
Krrish Dholakia 7a083750ce refactor: remove 'input_fidelity' from image gen -> it's a image_edit param 2025-09-06 12:14:27 -07:00
Krish Dholakia 447f1ea6bc Merge pull request #14118 from iabhi4/fix-14100
bug(auth): support for ES256/ES384/ES512 and EdDSA JWT verification
2025-09-06 09:57:26 -07:00
Krish Dholakia 1980960218 Merge branch 'main' into litellm_responses_structured_output 2025-09-06 09:20:00 -07:00
Krish Dholakia d1adc7896d Merge pull request #14262 from TobiMayr/feature/gemini-reasoning-effort-minimal
feat: Add support for reasoning_effort='minimal' for Gemini models
2025-09-06 09:17:23 -07:00
Krish Dholakia 943f6a38ed Merge pull request #14300 from eycjur/gpt-oss-reasoning-effort-mapping
Bug fix for openai.gpt-oss when using reasoning_effort parameter
2025-09-06 09:13:03 -07:00
katsuhiro muto 51de2ebb64 [Feat]Cancel upstream on client disconnect (#14295)
* cancel upstream on client disconnect

* add comments

* add test

* set timeout in constraints.py

* Guard against missing 'type' key

* update dependency to fix uvicorn bugs
2025-09-06 08:58:51 -07:00
eycjur 58cf72ef5e add test 2025-09-06 21:12:18 +09:00
Ishaan Jaff 5310bba35b [Feat] Litellm x CloudZero Integration - Cost Tracking (#14296)
* fix: just pull LiteLLM_DailyUserSpend

* get the team_id from user daily spend table

* cloudzero_dry_run_export

* fix CZ endpoints

* trace entity_id

* fix: get_usage_data

* fix get_usage_data

* fix _create_cbf_record

* fix get_usage_data

* ensure start and end time is used for exporting data

* fix init_cloudzero_background_job

* fix CloudZeroExportRequest

* fix initialize_cloudzero_export_job

* fix initialize_cloudzero_export_job

* allow init with env + config.yaml for cloudzero

* fix: init CZ through config.yaml

* fix DRY run on CZ

* TestCloudZeroDryRunEndpoint

* fix: CLOUDZERO_EXPORT_INTERVAL_MINUTES

* fix init_cloudzero_background_job

* fix exporting data

* fix transform

* stash cloudzero docs

* docs: CloudZero

* ruff fix

* fix rendering key alias

* fix polars
2025-09-05 21:29:41 -07:00
Sameer Kankute 07ba3ff036 [Feat] Add pass through image gen and image editing on OpenAI (#14292)
* add pass through image gen and image editing on OpenAI

* fix lint
2025-09-05 12:25:49 -07:00
Pierre-Emmanuel MERCIER 31f806f7d0 feat: add redis ssl and username support (#11319) 2025-09-05 10:35:11 -07:00
Ishaan Jaff 0a60390521 Revert "[Feat] LiteLLM CloudZero Integration updates - using LiteLLM_SpendLogs Table (#12922)"
This reverts commit e3b752d3dc.
2025-09-05 10:04:07 -07:00
Ishaan Jaff 982800069c [Bug Fix] x-litellm-tags not routing with Responses API (#14289)
* fix: get_deployments_for_tag

* fix get_deployments_for_tag

* test_router_tag_routing.py

* test_get_metadata_variable_name_from_kwargs

* fix mapped tests

* docs fix
2025-09-05 09:40:37 -07:00
Sameer Kankute 231d54741f Move test to test_litellm/ folder 2025-09-05 10:40:26 +05:30
Sameer Kankute 4fefac1bf2 Move test to test_litellm/ folder 2025-09-05 10:24:55 +05:30
Sameer Kankute ad9f54a192 Move test to test_litellm/ folder 2025-09-05 10:08:34 +05:30
Sameer Kankute f7f106f8b8 Move test to test_litellm/ folder 2025-09-05 10:00:58 +05:30
Krish Dholakia f67339a86c Merge pull request #14028 from onlylhf/volcengine-embedding-support
Add Volcengine embedding module with handler and transformation logic
2025-09-04 21:01:25 -07:00
Krish Dholakia 62d4623d1c Merge pull request #14107 from uc4w6c/feat/add_guardrails_anthropic
feat: Add guardrail to the Anthropic API endpoint
2025-09-04 20:50:43 -07:00
Krish Dholakia 5d5c19a302 Merge pull request #14077 from TomeHirata/codex/add-support-for-anthropic-citation-api
Add support for anthropic citation api in Databricks
2025-09-04 20:46:11 -07:00
Ishaan Jaff 379b0dbf14 [Fix] Ensure team_id is a required field for generating service account keys (#14270)
* generate_service_account_key_fn

* fix validate_team_id_used_in_service_account_request

* fix types

* test_validate_team_id_used_in_service_account_request_requires_team_id
2025-09-04 18:14:38 -07:00
Ishaan Jaff 1352545617 [Fix] DD LLM Observability - Ensure apm_id is set on traces (#14272)
* add apm_id for DD LLM

* feat: add _get_apm_trace_id
2025-09-04 14:35:41 -07:00