tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-16 06:16:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
31,241 Commits 2,072 Branches 1,425 Tags
aa75bec100e7eb0f9817e28c202e24bd97d834d5
Commit Graph
937 Commits
Author SHA1 Message Date
Sameer KankuteandGitHub df072979e5 Merge branch 'main' into litellm_oss_staging_01_28_2026 2026-01-29 17:39:42 +05:30
Alexsander HamirandGitHub 69bd4426e8 [Release Day] - Fixed CI/CD issues & changed processes (#19902) 2026-01-28 17:57:24 -08:00
Brian CaswellandGitHub 920ef665a3 inspect BadRequestError after all other policy types (#19878) 
As indicated by https://docs.litellm.ai/docs/exception_mapping,
BadRequestError is used as the base type for multiple exceptions.  As
such, it should be tested last in handling retry policies.

This updates the integration test that validates retry policies work as
expected.

Fixes #19876
 2026-01-27 18:15:04 -08:00
michelligabrieleandGitHub 8c4ccdc313 test(proxy): add regression tests for vertex passthrough model names with slashes (#19855) 
Added test cases for custom model names containing slashes in Vertex AI
passthrough URLs (e.g., gcp/google/gemini-2.5-flash).

Test cases:
- gcp/google/gemini-2.5-flash
- gcp/google/gemini-3-flash-preview
- custom/model
 2026-01-27 17:34:40 -08:00
Sameer Kankute 9883c2fd64 Fix: timeout exception raised eror 2026-01-27 12:32:37 +05:30
Ishaan Jaffer f2fd54ffcf test fixes 2026-01-24 14:27:56 -08:00
Ishaan Jaffer 489c986cac test_hanging_request_azure 2026-01-24 13:14:48 -08:00
Ishaan Jaffer 6587cd228b test_partner_models_httpx_streaming 2026-01-24 10:58:35 -08:00
yuneng-jiang 86676142c9 Fixing failing tests 2026-01-23 22:33:00 -08:00
yuneng-jiang fbe5ae9e17 fixing flaky tests 2026-01-23 12:20:27 -08:00
yuneng-jiang 8b5b343841 attempt fix flaky tests 2026-01-23 12:10:08 -08:00
Sameer KankuteandGitHub 12463809bd Merge pull request #19638 from BerriAI/main 
merge main in stagin 1 22 26
 2026-01-23 14:54:17 +05:30
Alexsander HamirandGitHub 57d777bc69 Fix unsafe access to request attribute (#19573) 2026-01-22 10:58:29 -08:00
Sameer Kankute b729622bf5 Fix: generationConfig removal from tests 2026-01-22 19:00:37 +05:30
Emerson GomesandGitHub c8669cf8fa Fix Azure RPM calculation formula (#19513) 
* Fix Azure RPM calculation formula

* updated test
 2026-01-21 21:03:23 -08:00
Sameer KankuteandGitHub aeb38ffa9b Merge pull request #19497 from BerriAI/main 
merge main
 2026-01-21 18:43:27 +05:30
Sameer Kankute a5ea08a0bf Fix test_default_api_base failing because of chatgpt as provider 2026-01-21 09:32:38 +05:30
Sameer Kankute 0b9f6b543f Fixes test_aaabasic_gcs_logger 2026-01-21 08:58:16 +05:30
Sameer KankuteandGitHub 9e1275b76c Merge branch 'main' into litellm_staging_01_19_2026 2026-01-20 19:19:36 +05:30
Sameer Kankute cd96c8cbb0 Fix:test_aaaaazure_tenant_id_auth 2026-01-20 17:39:08 +05:30
Sameer Kankute a4bfdf2427 Fix: total timeout is not respected 2026-01-20 09:37:43 +05:30
Emerson GomesandGitHub 13d887a275 Fix queue persistence to Redis (#19304) 
* Fix queue persistence to Redis

* add test
 2026-01-19 19:01:34 -08:00
Cesar GarciaandGitHub d30c25af21 feat(gemini): use responseJsonSchema for Gemini 2.0+ models (#19314) 
* feat(gemini): add opt-in support for responseJsonSchema

Add support for Gemini's native responseJsonSchema parameter which uses
standard JSON Schema format instead of OpenAPI-style responseSchema.

Benefits of responseJsonSchema (Gemini 2.0+ only):
- Standard JSON Schema format (lowercase types)
- Supports additionalProperties for stricter validation
- Better compatibility with Pydantic's model_json_schema()
- No propertyOrdering required

Usage:
```python
response_format={
    "type": "json_schema",
    "json_schema": {"schema": {...}},
    "use_json_schema": True  # opt-in
}
```

This is backwards compatible - existing code continues to use
responseSchema by default.

Closes #16340

* docs: add documentation for use_json_schema parameter

Document the new use_json_schema option for Gemini 2.0+ models
in the JSON Mode documentation.

* refactor(gemini): use responseJsonSchema by default for Gemini 2.0+

Remove opt-in flag `use_json_schema` and automatically detect model version:
- Gemini 2.0+: uses responseJsonSchema (standard JSON Schema, supports additionalProperties)
- Gemini 1.5: uses responseSchema (OpenAPI format, legacy)

This follows LiteLLM's philosophy of abstracting provider differences -
users write the same code regardless of model version.

* test(vertex): update json_schema tests to accept both responseSchema formats

Gemini 2.x+ uses responseJsonSchema while Gemini 1.x uses responseSchema.
Update tests to accept both formats since litellm now auto-selects based
on model version.
 2026-01-19 10:45:37 -08:00
Harshit JainandGitHub 6cd4b3603f fix(router): prevent retrying 4xx client errors (#19275) 2026-01-19 05:18:35 -08:00
Ishaan Jaffer 5812654bdd test_router_fallbacks_with_custom_model_costs 2026-01-17 16:34:46 -08:00
Sameer Kankute 09fb1581cb Fix:add async_get_available_deployment_for_pass_through in code tests 2026-01-16 16:37:44 +05:30
Sameer KankuteandGitHub dca42047b9 Merge pull request #19068 from BerriAI/litellm_responses_caching_support 
[Fix] Add support for caching for responses API
 2026-01-15 08:38:31 +05:30
Sameer Kankute 52d3c9dcfc Add retry policy support to responses API 2026-01-14 14:55:17 +05:30
Sameer Kankute 333947e236 Add support for caching for responses API 2026-01-14 13:33:07 +05:30
Sameer KankuteandGitHub e98c2e4425 Merge pull request #19012 from BerriAI/litellm_fix_model_deployment_routing 
Fix: Model matching priority in configuration
 2026-01-13 17:55:01 +05:30
Sameer KankuteandGitHub d656f01bc9 Merge pull request #19009 from Dima-Mediator/fix-image-tokens-spend-logging 
Fix image tokens spend logging for /images/generations
 2026-01-13 15:03:37 +05:30
Sameer KankuteandGitHub ecb3959c3c Merge pull request #18208 from Chesars/fix/case-insensitive-model-cost-lookup 
fix: case-insensitive model cost map lookup
 2026-01-13 11:53:43 +05:30
Sameer Kankute dfece51f8c Fix: Model matching priority in configuration 2026-01-13 11:44:48 +05:30
Yuta Saito a57f1e2e08 test: remove flaky azure oidc embedding test 2026-01-13 10:34:01 +09:00
Sameer Kankute ab85eb8f43 Fix: gaurdrail moderation support with responses API 2026-01-12 17:27:13 +05:30
Ishaan Jaffer 5873cd4a32 test_completion_bedrock_titan_null_response 2026-01-07 15:09:44 +05:30
Ishaan Jaffer 269771a7c9 test_bedrock_httpx_streaming 2026-01-07 15:02:10 +05:30
Ishaan Jaffer 645ca64780 a121 fixes 2026-01-07 15:00:49 +05:30
Yuta Saito 1d16a8526e feat: allow configuring project name for OpenTelemetry service name 2026-01-07 14:20:10 +09:00
Rohit Ravikant RaneandGitHub a7c39ccc12 fix(router): correct num_retries tracking in retry logic (#18712) 
* fix(router): correct num_retries tracking in retry logic

- Fix off-by-one error in num_retries attribute when retries exhausted
- Correct remaining_retries calculation
- Add comprehensive tests for retry tracking edge cases

Fixes incorrect retry count in error messages and logging

* chore: trigger CI re-run

* chore: trigger CI tests again
 2026-01-06 23:58:41 +05:30
Yuta Saito ca14160375 Revert "fix: model eol" 
This reverts commit 5aa1665d79.
 2026-01-06 16:49:30 +09:00
Yuta Saito 23713d1811 fix: anthropic claude-3-opus-20240229 EOL 2026-01-06 16:06:21 +09:00
Yuta Saito 5aa1665d79 fix: model eol 2026-01-06 15:47:37 +09:00
Sameer KankuteandGitHub c8bb92afdc Merge pull request #18579 from BerriAI/litellm_remove_prompt_chaching_header 
Remove prompt caching headers as the support has been removed
 2026-01-02 21:01:50 +05:30
Sameer Kankute dd96f91254 Add thought signature for non tool call requests 2026-01-02 12:31:31 +05:30
Sameer Kankute ca94990307 remove prompt caching headers as the support has been removed 2026-01-02 11:08:35 +05:30
Sameer Kankute 0addab4f63 Add test for removal of thought signature 2025-12-23 14:56:42 +05:30
Alexsander HamirandGitHub 5534038e93 Fix CI: Revert security scan changes and add GitGuardian ignore rules (#18358) 2025-12-22 17:03:53 -08:00
Ishaan Jaffer 09dcb38b4b Revert "test_update_model_cost_map_url" 
This reverts commit c9d61fcdba.
 2025-12-22 12:41:30 +05:30
Ishaan Jaffer c9d61fcdba test_update_model_cost_map_url 2025-12-22 11:51:30 +05:30