tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-13 02:22:50 +00:00
Code Issues Packages Projects Releases Wiki Activity
31,657 Commits 2,072 Branches 1,425 Tags
ea35ab6d4e5abc5c47e86f3cd99d573ca30560fc
Commit Graph
309 Commits
Author SHA1 Message Date
Sameer Kankute 8b3213ce5c Add mapping for responses tools in file ids 2026-02-04 13:12:45 +05:30
Sameer KankuteandGitHub 7b57d1acf1 Merge pull request #20331 from BerriAI/litellm_bstch_status_retrieve 
Fix: Managed Batches: Inconsistent State Management for list and cancel batches
 2026-02-04 08:52:17 +05:30
Ishaan Jaffer c80fae71ef bump litellm enterprise PIP 2026-02-03 10:39:39 -08:00
Sameer Kankute 410e54648c Fix: Managed Batches: Inconsistent State Management for list and cancel batches 2026-02-03 14:47:28 +05:30
shin-bot-litellmGitHubshin-bot-litellm
 		5434b66b9c litellm_fix(mypy): fix remaining type errors (#20164) 
- route_llm_request.py: add acancel_batch and afile_delete to route_type Literal
- router.py: add SearchToolInfoTypedDict and search_tool_info to SearchToolTypedDict
- gemini/files/transformation.py: fix validate_environment signature to match base class
- responses transformation.py: fix Dict type annotations to use int instead of Optional[int]
- vector_stores/endpoints.py: add team_id and user_id to LiteLLM_ManagedVectorStoresTable constructor

Co-authored-by: shin-bot-litellm <shin-bot-litellm@users.noreply.github.com>
 2026-01-31 10:25:23 -08:00
Sameer Kankute 70684ca86f Fix File access permissions for .retreive and .delete 2026-01-29 11:19:24 +05:30
Sameer Kankute 833cf6a2cf Fix: Batch cancellation ownership bug 2026-01-29 10:54:42 +05:30
Sameer KankuteandGitHub 42a0d576f3 Merge pull request #19910 from BerriAI/main 
merge 01 27
 2026-01-28 08:30:47 +05:30
michelligabrieleandGitHub fc7a9b4cb0 fix(enterprise): correct error message for DISABLE_ADMIN_ENDPOINTS (#19861) 
The error message for DISABLE_ADMIN_ENDPOINTS incorrectly said
"DISABLING LLM API ENDPOINTS is an Enterprise feature" instead of
"DISABLING ADMIN ENDPOINTS is an Enterprise feature".

This was a copy-paste bug from the is_llm_api_route_disabled() function.

Added regression tests to verify both error messages are correct.
 2026-01-27 09:34:30 -08:00
Ephrim Stanley 88280d9cca Fix batch creation to return the input file's expires_at attribute 2026-01-26 12:02:35 -05:00
Ephrim Stanley caa2c57619 Fix /batches to return encoded ids (from managed objects table) 2026-01-26 10:36:43 -05:00
Sameer Kankute 7fa8ef620b bump litellm version to 0.1.28 2026-01-15 11:35:49 +05:30
Matthias HumtandGitHub 9adc19deab Normalize OpenAI SDK BaseModel choices/messages to avoid Pydantic serializer warnings (#18972) 
* Normalize BaseModel choices + suppress serializer warnings

* Fix ModelResponse normalization and test deps
 2026-01-14 03:40:11 +05:30
houdataaliGitHubEphrim StanleyYuta Saitoyuneng-jiangYutaSaitoIshaan JaffSameer Kankute
 		cbb72045a3 fix(ui): use non-streaming method for endpoint v1/a2a/message/send in… (#19025) 
* Add end to end integration tests for batches

* Add end to end integration tests for batches

* Add end to end integration tests for batches

* Fix linter errors: remove unused imports and variables

* Add end to end integration tests for batches

* Add end to end integration tests for batches

* Add end to end integration tests for batches

* Add end to end integration tests for batches

* chore: document temporary grype ignore for CVE-2019-1010022

* chore: add config option

* chore: add ALLOWED_CVES

* refetch after key create

* test: remove flaky azure oidc embedding test

* fixing build

* bump: version 1.80.15 → 1.80.16

* [Fix] MSFT SSO - allow setting custom MSFT Base URLs (#18977)

* fix TestCustomMicrosoftSSO

* init CustomMicrosoftSSO

* use CustomMicrosoftSSO

* docs fix

* docs fix

* [Feat] UI Feedback Form - why LiteLLM  (#18999)

* init survey prompt

* init survey modal

* init Survey Modal

* POST feedback hook

* survey Modal

* add other

* in product survey fixes

* fix survey prompt

* fix survey

* fix build

* ui new build

* [Feat] MSFT SSO - allow overriding env var attribute names  (#18998)

* add MSFT SSO constants

* fix MSFT SSO env vars

* test_microsoft_sso_handler_openid_from_response_with_custom_attributes

* Add pricing of azure_ai/claude-opus-4-5

* test: temporarily disable flaky responses_id_security tests

* fix(ui): use non-streaming method for endpoint v1/a2a/message/send in A2A playground

'

---------

Co-authored-by: Ephrim Stanley <ephrim.stanley@point72.com>
Co-authored-by: Yuta Saito <uc4w6c@bma.biglobe.ne.jp>
Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com>
Co-authored-by: YutaSaito <36355491+uc4w6c@users.noreply.github.com>
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Sameer Kankute <sameer@berri.ai>
 2026-01-14 03:29:10 +05:30
Sameer Kankute 7d0f41f437 Add cost tracking for responses api in background mode 2025-12-19 13:35:48 +05:30
yuneng-jiang d7514c0976 Max budget alerts working 2025-12-17 16:01:59 -08:00
yuneng-jiang d6f8e79f0d bump: version 0.1.26 → 0.1.27 2025-12-17 15:07:16 -08:00
yuneng-jiang dad2a29b2b Max budget alerts 2025-12-17 15:04:20 -08:00
yuneng-jiang 087dfbf648 Merge remote-tracking branch 'origin' into litellm_email_budget_alerts_2 2025-12-17 11:37:49 -08:00
Sameer Kankute 755f024087 remove print statments 2025-12-16 21:37:09 +05:30
Sameer Kankute 3222b4e3a8 Add batch output file in managed table 2025-12-16 15:44:30 +05:30
yuneng-jiang 14feda694b Email budget alerts working 2025-12-15 16:51:25 -08:00
yuneng-jiang 7a18c81cf4 bump: version 0.1.25 → 0.1.26 2025-12-15 16:00:37 -08:00
yuneng-jiang d8663efeab Revert "Base commit" 
This reverts commit 1186cc6966.
 2025-12-15 10:25:22 -08:00
yuneng-jiang 1186cc6966 Base commit 2025-12-15 10:24:47 -08:00
Sameer KankuteandGitHub da81ab6d97 Merge pull request #17758 from BerriAI/litellm_managed_files_target_storage 
Add v0 support for target storage
 2025-12-12 22:26:34 +05:30
Sameer Kankute 7b1cef86a7 Add support for target_storage param 2025-12-11 15:08:17 +05:30
yuneng-jiang ca11264bbf Fixing sendgrid integration 2025-12-10 20:31:33 -08:00
yuneng-jiang 439d42ba67 bump: version 0.1.24 → 0.1.25 2025-12-10 18:26:07 -08:00
yuneng-jiang 0769a290da Sendgrid integration + bump enterprise package 2025-12-09 19:34:09 -08:00
yuneng-jiang b5763d27eb bump: version 0.1.23 → 0.1.24 2025-12-09 19:31:12 -08:00
yuneng-jiang 6a60c950fe bumping enterprise build 2025-12-05 11:14:00 -08:00
yuneng-jiang a750f5ca69 bump: version 0.1.22 → 0.1.23 2025-12-05 11:08:04 -08:00
Sameer Kankute 99fd96687f Fix vector store configuration synchronization failure 2025-12-05 11:46:14 +05:30
Ishaan JaffandGitHub 4370f6fb74 [Feat] Agent Gateway - Allow invoking agents through AI Gateway (#17440) 
* init litellm A2a client

* simpler a2a client interface

* test a2a

* move a2a invoking tests

* test fix

* ensure a2a send message is tracked n logs

* rename tags

* add streaming handlng

* add a2a invocation
 2025-12-03 18:54:55 -08:00
Ishaan JaffandGitHub 1cdfb3da8f [Bug Fix] - Fix litellm_enterprise ensure imported routes exist (#17337) 
* test_enterprise_routes.py

* test_enterprise_routes_all_imports_exist
 2025-12-01 19:14:12 -08:00
Ishaan JaffandGitHub 38ddd50628 [Bug fix] Vector Store List Endpoint Returns 404 (#17229) 
* fix vector store management

* fix: add vector_store_management_router

* TestVectorStoreManagementEndpointsExist

* fix pass_through
 2025-11-27 12:51:51 -08:00
Krish DholakiaGitHubCursor Agent
 		1cb5fcddba make generic api OSS + support multiple generic API's (#17152) 
* feat(generic_api_callback.py): make generic api OSS + support multiple generic API's

Enables https://github.com/BerriAI/litellm/pull/17094#discussion_r2562832967

* feat(callback_utils.py): support custom generic api callbacks

* feat(generic_api_callback.py): support specifying which event types to run the generic api for

* fix(litellm_logging.py): log system prompt for anthropic messages

* feat(generic_api_callback.py): support generic api compatible api's - e.g. rubrik agent cloud

* docs(sidebars.js): document new OSS generic api

* docs(generic_api.md): document new OSS Generic API

* docs(custom_webhook_api.md): document custom webhook api integration tutorial

* docs(custom_webhook_api.md): cleanup

* docs(custom_webhook_api.md): document what get's logged to custom webhook api

* Refactor: Pass callback config to GenericAPILogger

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* Fix: Handle empty messages list in logging payload

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* Checkpoint before follow-up message

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* feat: Cache GenericAPILogger instances to improve performance

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
 2025-11-26 18:38:38 -08:00
Ishaan Jaffer d389b9dd66 bump litellm enterprise 2025-11-19 16:56:50 -08:00
Krish DholakiaGitHubIshaan Jaffer
 		70e1e83102 feat(managed_files.py): support /delete for files + feat(managed_batches): support /cancel for batches (#16387) 
* feat(managed_files.py): initial commit fixing managed file delete on litellm

* fix(managed_files.py): fix file delete

* feat(batches_endpoints/endpoints.py): fix cancelling a batch

ensures managed batches works

---------

Co-authored-by: Ishaan Jaffer <ishaanjaffer0324@gmail.com>
 2025-11-18 17:36:26 -08:00
Sameer KankuteandGitHub 7cebc151b0 Add managed files support for responses API (#16733) 
* Fix responses api with managed files

* fix litellm/llms/vertex_ai/gemini/vertex_and_google_ai_studio_gemini.py mypy

* fix litellm/llms/vertex_ai/gemini/vertex_and_google_ai_studio_gemini.py mypy

* fix mypy errors
 2025-11-17 18:41:26 -08:00
Ishaan JaffandGitHub 83ea037bc9 [Feat] AI Gateway - Allow admins to disable, dynamic callback controls (#16750) 
* add flag to allow_dynamic_callback_disabling

* fix EnterpriseCallbackControls

* test controls

* add docs on dynamic logging
 2025-11-17 18:29:07 -08:00
Krish DholakiaandGitHub 586f126395 Prometheus - make OSS (#16689) 
* refactor: remove enterprise license from prometheus metrics

* refactor: complete refactoring imports

* refactor: complete prometheus refactoring

* bump: version 1.80.0 → 1.80.1

* bump: version 1.80.1 → 1.80.2

* build: update litellm lock file

* docs(enterprise.md): cleanup enterprise docs

* docs: more docs cleanup

* docs: doc cleanup

* fix: fix imports

* fix: fix linting error
 2025-11-15 11:06:34 -08:00
Krish DholakiaandGitHub 06906534b3 feat(audio_transcriptions/): calculate duration of audio file for cost calculation + feat (image_generations): cost tracking accuracy improved with output_format, quality, size values fixed per openai model 
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation

Fixes https://github.com/BerriAI/litellm/issues/11846

Closes https://github.com/BerriAI/litellm/issues/14605

* fix(cost_calculator.py): correctly use base model, when set

Fixes issue where azure base model was being ignored

* feat(cost_calculator.py): fix default cost tracking quality param for image generation

* feat(image_generations/): return output_format, quality, size

aligns response to openai spec and improves cost tracking accuracy

* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params

* build: update build

* fix: fix cost calculation

* build: update poetry lock

* fix: fix ruff checks

* fix: fix aembedding

* fix: fix ruff errors

* fix: modify to catch errors

* fix: test

* fix: loosen test to handle openai lib out of sync

* fix: fix base models

* fix: fix usage object
 2025-11-08 16:24:31 -08:00
Krish DholakiaandGitHub 202eaeb1a2 Revert "(feat) Audio transcription - cost tracking + (feat) image generation …" (#16409) 
This reverts commit c96da44265.
 2025-11-08 15:38:16 -08:00
Krish DholakiaandGitHub c96da44265 (feat) Audio transcription - cost tracking + (feat) image generation - accurate cost tracking based on output_format/quality/size 
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation

Fixes https://github.com/BerriAI/litellm/issues/11846

Closes https://github.com/BerriAI/litellm/issues/14605

* fix(cost_calculator.py): correctly use base model, when set

Fixes issue where azure base model was being ignored

* feat(cost_calculator.py): fix default cost tracking quality param for image generation

* feat(image_generations/): return output_format, quality, size

aligns response to openai spec and improves cost tracking accuracy

* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params

* build: update build

* fix: fix cost calculation

* build: update poetry lock

* fix: fix ruff checks

* fix: fix aembedding

* fix: fix ruff errors

* fix: modify to catch errors

* fix: test

* fix: loosen test to handle openai lib out of sync
 2025-11-08 15:30:46 -08:00
Ishaan Jaffer 0a1fc0eeb2 Revert "fix: fix ruff errors" 
This reverts commit eef864360e.
 2025-11-08 14:33:51 -08:00
Krrish Dholakia eef864360e fix: fix ruff errors 2025-11-08 14:15:12 -08:00
Ishaan JaffandGitHub 2541a54023 [Feat] Email Notifications - Ensure Users get Key Rotated Email (#16292) 
* add virtual_key_rotated

* add KEY_ROTATED_EMAIL_TEMPLATE

* fix base email

* add _send_key_rotated_email

* fix _send_key_rotated_email

* key rotated email fix

* fix: async_key_generated_hook ensure behavior matches regenerate

* test_send_key_rotated_email

* expose EMAIL_INCLUDE_API_KEY

* docs mask api keys

* add email regen

* docs key regen

* docs email

* docs email

* docs fix

* fix code qa check
 2025-11-05 15:56:49 -08:00
Sameer KankuteGitHubIshaan Jaffer
 		bb86c94df4 Add Prometheus metric to track callback logging failures in S3 (#16209) 
* Add v1 cut of container api

* fix lint errors

* Add proxy support to container apis & logging support (#16049)

* Add proxy support to container apis

* Add logging support

* Add cost tracking support for containers and documentation

* Add new constant documentation

* Add container cost in model map

* fix failing azure tests

* Update tests based on model map changes

* fix model map tests

* fix model map tests

* Container modeshould be container

* Container tests fix

* Merge branch 'main' into litellm_sameer_oct_staging_2

* Add Prometheus metric to track callback logging failures in S3 (#16102)

* Add proxy support to container apis

* Add logging support

* prometheus metric  measures how often s3_v2 is failing

* remove not needed files

* remove not needed files

* remove not needed files

* fix mypy errors

* Use logging_callback_manager to get all the callbacks

---------

Co-authored-by: Ishaan Jaffer <ishaanjaffer0324@gmail.com>
 2025-11-03 18:46:52 -08:00