tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-16 10:17:33 +00:00
Code Issues Packages Projects Releases Wiki Activity
26,500 Commits 2,072 Branches 1,425 Tags
455dc8a31cd75ffccaed9bf4cf893fc619bc2383
Commit Graph
26500 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Krish DholakiaandGitHub 455dc8a31c Merge pull request #15569 from FelipeRodriguesGare/fix/gpt-5-codex-params-off 
adding support parameters to model_prices json
 2025-10-16 07:33:55 -07:00
Krish DholakiaandGitHub 68caebe119 Merge pull request #15580 from aniketmaurya/patch-1 
Add type hint to function_to_dict and fix typo
 2025-10-16 07:30:29 -07:00
Krish DholakiaandGitHub e95a42d0b8 Merge pull request #15583 from TeddyAmkie/fix/entraid-app-roles-jwt-claim-clean 
Fix/entraid app roles jwt claim clean
 2025-10-16 07:29:49 -07:00
Krish DholakiaandGitHub af8cf6861d Merge pull request #15591 from TensorNull/fix/cometapi 
fix(cometapi): improve CometAPI provider support (embeddings, image generation, docs)
 2025-10-16 07:26:59 -07:00
Krish DholakiaandGitHub e314d946e2 Merge pull request #15598 from shinharaguchi/feature/add_jp_haiku4_5_price 
Add JP Cross-Region Inference jp.anthropic.claude-haiku-4-5-20251001
 2025-10-16 07:12:58 -07:00
shinharaguchi 359a095319 Add jp.anthropic.claude-haiku-4-5-20251001 price 2025-10-16 21:52:44 +09:00
TensorNull 074b9954a0 docs(readme): Add CometAPI to supported providers table 2025-10-16 14:18:55 +08:00
TensorNull e3566faf15 fix(cookbook): Remove the CometAPI key used for testing. 2025-10-16 14:14:58 +08:00
TensorNull 55a6dd3a8b feat(cometapi): Add CometAPI provider support (embeddings, image generation, docs) 
- Add CometAPI embedding and image generation transformations and configs
- Add image cost calculator and export/init files
- Register provider in constants, utils, main (embedding path) and sidebars
- Add CometAPI docs page and cookbook notebook (Colab) for usage examples
 2025-10-16 13:08:14 +08:00
berri-teddy 1b55803c76 test: reduce EntraID app roles tests to essential scenarios 
- Keep only 2 focused tests: single role extraction and no roles claim
- Remove complex fixtures and edge case tests
- Maintain clean, maintainable test coverage
 2025-10-15 18:15:04 -07:00
berri-teddy 6b166e046d fix: correct EntraID app roles JWT claim extraction 
- Fix get_app_roles_from_id_token to use 'app_roles' claim instead of 'roles'
- Add comprehensive unit tests for EntraID app roles functionality
- Prevent regressions in Microsoft EntraID SSO authentication

Resolves issue where EntraID app roles were not being extracted correctly
from JWT tokens, causing authentication failures for users with assigned
app roles in Microsoft EntraID.
 2025-10-15 18:06:03 -07:00
AndreasGitHubAndreas Feldl
 		f1fbae8409 feat(pricing): Add Gemini 2.5 Flash Image (Nano Banana) in GA (#15557) 
* feat(pricing): Add Gemini 2.5 Flash Image (Nano Banana) in GA

* change mode to image_generation

---------

Co-authored-by: Andreas Feldl <andreas.feldl@netlight.com>
 2025-10-15 17:50:15 -07:00
Ishaan Jaffer fd83b292a6 test_bedrock_anthropic_prompt_caching v1.78.2-nightly 2025-10-15 17:46:44 -07:00
Ishaan Jaffer 8ab720409c bump v 2025-10-15 17:44:29 -07:00
Ishaan JaffandGitHub 354e62bde4 [Feat] Add anthropic.claude-haiku-4-5-20251001-v1:0 on Bedrock, VertexAI (#15581) 
* add claude 4-5

* add anthropic.claude-haiku-4-5-20251001-v1:0
 2025-10-15 17:41:09 -07:00
Aniket MauryaandGitHub 495e6c0a2b Add type hint to function_to_dict and fix typo 
Updated type hint for function_to_dict and fixed typo in docstring.
 2025-10-16 01:36:32 +01:00
Mubashir OsmaniandGitHub ad7f4411a3 added claude-haiku-4.5 (#15579) 2025-10-15 17:28:49 -07:00
Ishaan JaffGitHubCopilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
 		bc26845ec4 [Feat] Native /ocr endpoint support (#15573) 
* [Feat] Add native litellm.ocr() functions (#15567)

* fix get_supported_ocr_params

* add get_provider_ocr_config

* init OCR

* init ocr functions

* add OCRResponse Base Model

* add ocr to llm http handlers

* add main.py for OCR

* fix linting for OCR

* TestMistralOCR

* update to use DocumentType for Mistral

* fix _prepare_ocr_request

* fix transform

* add main.py for OCR

* add spec to init

* fix OCR

* TestMistralOCR

* ruff fix

* Potential fix for code scanning alert no. 3521: Clear-text logging of sensitive information

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

---------

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

* [Feat] Add /ocr route on LiteLLM AI Gateway - Adds support for native mistral ocr calling (#15571)

* fix get_supported_ocr_params

* add get_provider_ocr_config

* init OCR

* init ocr functions

* add OCRResponse Base Model

* add ocr to llm http handlers

* add main.py for OCR

* fix linting for OCR

* TestMistralOCR

* update to use DocumentType for Mistral

* fix _prepare_ocr_request

* fix transform

* add main.py for OCR

* add spec to init

* fix OCR

* TestMistralOCR

* ruff fix

* add router.ocr() methods

* add OCR routes

* feat add ocr routes

* add OCR routes

* feat: add OCR routes in proxy server

* working /ocr routes

* test_router_aocr_with_mistral

* docs Mistral OCR

* docs OCR

* [Feat] Add Azure AI Mistral OCR Integration  (#15572)

* fix get_supported_ocr_params

* add get_provider_ocr_config

* init OCR

* init ocr functions

* add OCRResponse Base Model

* add ocr to llm http handlers

* add main.py for OCR

* fix linting for OCR

* TestMistralOCR

* update to use DocumentType for Mistral

* fix _prepare_ocr_request

* fix transform

* add main.py for OCR

* add spec to init

* fix OCR

* TestMistralOCR

* ruff fix

* add router.ocr() methods

* add OCR routes

* feat add ocr routes

* add OCR routes

* feat: add OCR routes in proxy server

* working /ocr routes

* test_router_aocr_with_mistral

* docs Mistral OCR

* docs OCR

* add azure ai to get_provider_ocr_config

* add AzureAIOCRConfig

* TestAzureAIOCR

* TestAzureAIOCR

* test fixes for azure ai ocr

* fix async OCR transform for Azure

* fix transform_ocr_request

---------

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
 2025-10-15 17:20:01 -07:00
Felipe Gare a87a3d0f95 adding support parameters to model_prices json 2025-10-15 16:06:44 -03:00
Krrish Dholakia 74bfbeb439 fix(proxy/utils.py): support configuring db schema for non-iam auth db url 2025-10-15 08:43:29 -07:00
Krrish Dholakia 0526334d9c docs: fix url 2025-10-15 08:33:28 -07:00
Krish DholakiaandGitHub ac021161c4 Merge pull request #15540 from FelipeRodriguesGare/fix/gpt-5-codex-params 
change gpt-5-codex support in model_price json
 2025-10-14 16:27:41 -07:00
Krish DholakiaandGitHub 276c00a7f6 Merge pull request #15544 from davizucon/main 
small fix code snippet  custom_prompt_management.md
 2025-10-14 16:23:32 -07:00
Ishaan JaffandGitHub a10425d1ce [Feat] Allow Team Admins to export a report of the team spending (#15542) 
* v0 for export

* v0 for Export

* add types for EntityUsageExportModalProps

* add folder struct

* add summry selector

* add selector for export

* add utils for entity usage export

* refactored buttons

* fixes name

* fix alignment

* test: EntityUsageExportModal

* fix lint
 2025-10-14 15:07:59 -07:00
Davi S. ZuconandGitHub 9d944b1404 small fix code snippet custom_prompt_management.md 
passing parameter: 
prompt_id directly to openai client, raises error: 
TypeError: Completions.create() got an unexpected keyword argument 'prompt_id'

instead use: 
extra_body={
        "prompt_id": "1234"
 }
 2025-10-14 16:37:00 -03:00
Ishaan Jaffer c86c6bc507 v0 for Export 2025-10-14 11:11:37 -07:00
Ishaan Jaffer bda58bc3ed v0 for export 2025-10-14 11:11:24 -07:00
Felipe Gare 0212eb6f04 change gpt-5-codex support in model_price json 2025-10-14 13:37:56 -03:00
Krrish Dholakia 3e193a3542 bump: version 1.78.0 → 1.78.1 2025-10-13 14:26:47 -07:00
Krrish Dholakia 3d7c55516e build: bump version 2025-10-13 14:26:38 -07:00
Ishaan JaffandGitHub f13eb283e1 [Fix] GEMINI - CLI - add google_routes to llm_api_routes (#15500) 
* fix: add google_routes to llm_api_routes

* test: test_virtual_key_llm_api_routes_allows_google_routes
 2025-10-13 10:58:47 -07:00
Krrish Dholakia 0c86c3d791 docs(index.md): bump rc 2025-10-13 10:56:14 -07:00
Krrish Dholakia 611bda94cb docs: fix doc 2025-10-13 09:59:07 -07:00
Krish DholakiaandGitHub 2ea7005c40 Merge pull request #15448 from dhruvyad/main 
Get completion cost directly from OpenRouter
 2025-10-12 22:12:52 -07:00
Krish DholakiaandGitHub d81843070a Merge pull request #15461 from BerriAI/litellm_update_docs 
[Docs] - Update benchmark results
 2025-10-12 22:11:57 -07:00
Krish DholakiaandGitHub 760000e48e Merge pull request #15465 from kowyo/kowyo/fix-ollama-think 
fix(ollama/chat): correctly map reasoning_effort to think in requests
 2025-10-12 22:11:17 -07:00
Krish DholakiaandGitHub b7b16d69bc Merge pull request #15468 from mubashir1osmani/litellm_add_docs 
docs: add ecs deployment guide
 2025-10-12 22:10:00 -07:00
Krish DholakiaandGitHub 176c45d51b Merge pull request #15472 from huangyafei/update_price 
Add anthropic/claude-sonnet-4.5 to OpenRouter cost map
 2025-10-12 22:07:04 -07:00
Krish DholakiaandGitHub ff20f8402a Merge pull request #15456 from BerriAI/litellm_staging_branch_10_11_2025_p1 
Litellm staging branch 10 11 2025 p1
 2025-10-12 22:01:45 -07:00
Krrish Dholakia 0ffc81f010 fix: fix reformatting 2025-10-12 22:01:16 -07:00
Krrish Dholakia 1949436047 test: update test 2025-10-12 21:58:06 -07:00
Krish DholakiaandGitHub 04dc9d091c Merge branch 'main' into litellm_staging_branch_10_11_2025_p1 2025-10-12 21:55:44 -07:00
huangyafei 409299de84 Add anthropic/claude-sonnet-4.5 to OpenRouter cost map 2025-10-13 10:46:37 +08:00
mubashir1osmani 950ee924fc add ecs to docs 2025-10-12 16:13:56 -04:00
Dhruv Yadav 84a65440c5 add tests for openrouter cost tracking 2025-10-12 12:36:24 +05:30
KowyoandGitHub 89aad0e21f Merge branch 'BerriAI:main' into kowyo/fix-ollama-think 2025-10-12 11:54:30 +08:00
Ishaan Jaffer e761665f22 docs fix 2025-10-11 18:21:35 -07:00
AlexsanderHamir 5d1fa76d14 update benchmarks 2025-10-11 18:06:37 -07:00
AlexsanderHamir 2cb1db27cb docs: update benchmark results with improved infrastructure 
- Update to 2 instance baseline (1035 RPS @ 200ms median)
- Add 4 instance results (1170 RPS @ 100ms median)
- Update machine specs to 4 CPU / 8GB RAM
- Update Locust settings to 1000 users
 2025-10-11 18:00:26 -07:00
Imad SaddikandGitHub 133189e191 Fixed a few typos (#15267) 2025-10-11 17:53:42 -07:00