a8be3ae412
[Feat] Add Cost Tracking for /ocr endpoints ( #15678 )
...
* mistral/mistral-ocr-latest
* fix: add _hidden_params to OCRResponses
* test: hidden params exists
* feat: add mistral/mistral-ocr-2505-completion
* fix test
* add ModelInfoBase fields
* fix get OCR cost
* check response cost from OCR
* add handling for OCR costs
* add mistral-document-ai-2505
* docs OCR
* ruff check fix
2025-10-17 15:54:10 -07:00
3ff073c811
UI - add arize on ui, LLMs - clarifai refactor to openai compatible route, added azure ai/grok-4 model family
...
* added oauth mcp to docs
* added azure ai/grok-4 model family
* Revert "added oauth mcp to docs"
This reverts commit 950b7cef44f14b2db1429f6fbd32548a7c95d325.
* fix: arize ui integration
* need to remove a file
This reverts commit d6c877b73ac763464f204b77135f3786342373b7.
* fix: add arize from ui
* updated clarifai functions to openai compatible (#15615 )
* fix: npm build errors
* Snowflake provider support: added embeddings, PAT, account_id (#15372 )
* snowflake support PAT, account_id and embeddings
* format
* test embeddings
* format
* complete test
---------
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com >
* Revert "Snowflake provider support: added embeddings, PAT, account_id (#15372 )" (#15632 )
This reverts commit c6d58e5b4af8493c020fa519d72ec6ebc90c896b.
---------
Co-authored-by: mubashir1osmani <mubashir.osmani777@gmail.com >
Co-authored-by: Mubashir Osmani <ilikewafflesomcuh@gmail.com >
Co-authored-by: mogith-pn <143642606+mogith-pn@users.noreply.github.com >
Co-authored-by: Andrey <elkin.andr@gmail.com >
2025-10-16 20:39:15 -07:00
ea69f4547d
Merge branch 'main' into litellm_oct_staging2
2025-10-16 17:06:29 -07:00
f69f7d101b
Merge pull request #15618 from BerriAI/litellm_bedrock_invoke_support
...
[Feat] Allow calling /invoke, /converse routes through AI Gateway + models on config.yaml
2025-10-16 16:56:23 -07:00
0bef295b15
doc fix
2025-10-16 16:36:24 -07:00
bbf9d6a57b
docs boto3 instructions
2025-10-16 16:34:56 -07:00
79516563a9
docs add /invoke and /converse routes
2025-10-16 16:25:27 -07:00
8c5d6891d4
docs pt
2025-10-16 16:18:13 -07:00
fe5dd23a84
docs boto3 pass thoughs
2025-10-16 16:17:02 -07:00
c2b69e371c
docs pass through
2025-10-16 16:13:08 -07:00
f87c86806c
docs invoke
2025-10-16 16:13:01 -07:00
f27f2d4803
Merge branch 'main' into litellm_sso_add_pkce
2025-10-16 15:48:01 -07:00
f98f299854
Merge pull request #15617 from BerriAI/litellm_october_alexsander_stanging
...
[OCT] Alexsander PERF improvements
2025-10-16 15:10:02 -07:00
220fa3feeb
Add missing env key
2025-10-16 14:42:27 -07:00
1c8b7abddb
GENERIC_CLIENT_USE_PKCE
2025-10-16 13:32:12 -07:00
193fa19552
fix Okta PKCE
2025-10-16 13:26:14 -07:00
3bf32e8e5c
feature: update pillar security integration to support no persistence mode in litellm proxy
...
feature: update pillar security integration to support no persistence mode in litellm proxy
2025-10-16 12:13:37 -07:00
b075cf4a6c
PLR-2400: support no persistence in litellm proxy
2025-10-16 17:22:58 +03:00
55a6dd3a8b
feat(cometapi): Add CometAPI provider support (embeddings, image generation, docs)
...
- Add CometAPI embedding and image generation transformations and configs
- Add image cost calculator and export/init files
- Register provider in constants, utils, main (embedding path) and sidebars
- Add CometAPI docs page and cookbook notebook (Colab) for usage examples
2025-10-16 13:08:14 +08:00
bc26845ec4
[Feat] Native /ocr endpoint support ( #15573 )
...
* [Feat] Add native litellm.ocr() functions (#15567 )
* fix get_supported_ocr_params
* add get_provider_ocr_config
* init OCR
* init ocr functions
* add OCRResponse Base Model
* add ocr to llm http handlers
* add main.py for OCR
* fix linting for OCR
* TestMistralOCR
* update to use DocumentType for Mistral
* fix _prepare_ocr_request
* fix transform
* add main.py for OCR
* add spec to init
* fix OCR
* TestMistralOCR
* ruff fix
* Potential fix for code scanning alert no. 3521: Clear-text logging of sensitive information
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
---------
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
* [Feat] Add /ocr route on LiteLLM AI Gateway - Adds support for native mistral ocr calling (#15571 )
* fix get_supported_ocr_params
* add get_provider_ocr_config
* init OCR
* init ocr functions
* add OCRResponse Base Model
* add ocr to llm http handlers
* add main.py for OCR
* fix linting for OCR
* TestMistralOCR
* update to use DocumentType for Mistral
* fix _prepare_ocr_request
* fix transform
* add main.py for OCR
* add spec to init
* fix OCR
* TestMistralOCR
* ruff fix
* add router.ocr() methods
* add OCR routes
* feat add ocr routes
* add OCR routes
* feat: add OCR routes in proxy server
* working /ocr routes
* test_router_aocr_with_mistral
* docs Mistral OCR
* docs OCR
* [Feat] Add Azure AI Mistral OCR Integration (#15572 )
* fix get_supported_ocr_params
* add get_provider_ocr_config
* init OCR
* init ocr functions
* add OCRResponse Base Model
* add ocr to llm http handlers
* add main.py for OCR
* fix linting for OCR
* TestMistralOCR
* update to use DocumentType for Mistral
* fix _prepare_ocr_request
* fix transform
* add main.py for OCR
* add spec to init
* fix OCR
* TestMistralOCR
* ruff fix
* add router.ocr() methods
* add OCR routes
* feat add ocr routes
* add OCR routes
* feat: add OCR routes in proxy server
* working /ocr routes
* test_router_aocr_with_mistral
* docs Mistral OCR
* docs OCR
* add azure ai to get_provider_ocr_config
* add AzureAIOCRConfig
* TestAzureAIOCR
* TestAzureAIOCR
* test fixes for azure ai ocr
* fix async OCR transform for Azure
* fix transform_ocr_request
---------
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-10-15 17:20:01 -07:00
0526334d9c
docs: fix url
2025-10-15 08:33:28 -07:00
a6c57cb5bd
[Feat] Cost Tracking - specify a global vendor discount for costs. ( #15546 )
...
* fix cost_discount_config
* add CostBreakdown
* fix: set_cost_breakdown
* test_cost_discount_vertex_ai
* docs fix
* docs fix discounts
* docs fix
* docs custom pricing
* docs fix
* fixes for getting cost breakdown in response headers
* test - response headers wth discount
2025-10-14 20:07:04 -07:00
5bffa58ee0
feat(ssl): add configurable ECDH curve for TLS performance
...
Add `ssl_ecdh_curve` setting to configure TLS key exchange curve.
Allows disabling PQC on OpenSSL 3.x for better performance.
Configurable via SDK (litellm.ssl_ecdh_curve), YAML (litellm_settings),
or env var (SSL_ECDH_CURVE). Common curves: X25519, prime256v1, secp384r1.
2025-10-14 13:57:39 -07:00
b0d963cc0c
docs(index.md): bump rc
2025-10-14 13:57:39 -07:00
cb29e33cad
docs: fix doc
2025-10-14 13:57:39 -07:00
2e57d19a55
update benchmarks
2025-10-14 13:57:39 -07:00
6df051e87b
docs: update benchmark results with improved infrastructure
...
- Update to 2 instance baseline (1035 RPS @ 200ms median)
- Add 4 instance results (1170 RPS @ 100ms median)
- Update machine specs to 4 CPU / 8GB RAM
- Update Locust settings to 1000 users
2025-10-14 13:57:39 -07:00
6424480571
add ecs to docs
2025-10-14 13:57:39 -07:00
9d944b1404
small fix code snippet custom_prompt_management.md
...
passing parameter:
prompt_id directly to openai client, raises error:
TypeError: Completions.create() got an unexpected keyword argument 'prompt_id'
instead use:
extra_body={
"prompt_id": "1234"
}
2025-10-14 16:37:00 -03:00
0c86c3d791
docs(index.md): bump rc
2025-10-13 10:56:14 -07:00
611bda94cb
docs: fix doc
2025-10-13 09:59:07 -07:00
d81843070a
Merge pull request #15461 from BerriAI/litellm_update_docs
...
[Docs] - Update benchmark results
2025-10-12 22:11:57 -07:00
950ee924fc
add ecs to docs
2025-10-12 16:13:56 -04:00
e761665f22
docs fix
2025-10-11 18:21:35 -07:00
5d1fa76d14
update benchmarks
2025-10-11 18:06:37 -07:00
2cb1db27cb
docs: update benchmark results with improved infrastructure
...
- Update to 2 instance baseline (1035 RPS @ 200ms median)
- Add 4 instance results (1170 RPS @ 100ms median)
- Update machine specs to 4 CPU / 8GB RAM
- Update Locust settings to 1000 users
2025-10-11 18:00:26 -07:00
133189e191
Fixed a few typos ( #15267 )
2025-10-11 17:53:42 -07:00
300a142926
[Add]: perf summary ( #15458 )
...
* add: perf summary
* update docs
* fix: focus on p99
2025-10-11 17:38:13 -07:00
087bd2d306
docs fix
2025-10-11 16:49:11 -07:00
1ccd949495
docs fix
2025-10-11 16:34:47 -07:00
b9fef02f04
docs v1.78.0
2025-10-11 16:33:46 -07:00
7288f4355f
docs fix
2025-10-11 16:24:21 -07:00
54b8bde60c
docs fix
2025-10-11 16:23:46 -07:00
8d29fc8cdd
docs
2025-10-11 16:12:00 -07:00
8c4c4acda2
Merge pull request #15457 from BerriAI/litellm_docs_10_11_2025
...
Litellm docs 10 11 2025
2025-10-11 15:16:13 -07:00
3f921d8dbe
docs(index.md): document mcp oauth support
2025-10-11 15:14:15 -07:00
9b5943ae50
docs: cleanup docs
2025-10-11 15:09:24 -07:00
fdaa163758
docs(claude_responses_api.md): update docs with mcp server tutorial
2025-10-11 15:07:54 -07:00
e4f3d78579
docs v1.78.0.rc.1
2025-10-11 14:57:28 -07:00
73257be604
docs(index.md): initial commit for github mcp oauth docs
2025-10-11 14:00:50 -07:00
Ishaan Jaff