Commit Graph

5101 Commits

Author SHA1 Message Date
Matt Cowger 9f4a4fd271 Add docs as follow on to #18362 (#18388) 2025-12-25 11:08:47 +05:30
Ishaan Jaff 1123cfa928 [Feat] AI Gateway - Add support for Platform Fee / Margins (#18427)
* init cost_margin_config

* feat: add cost margin

* init types

* LITELLM_SETTINGS_SAFE_DB_OVERRIDES

* feat _apply_cost_margin

* ui endpoint

* ui provider margins

* add margin

* refactored ui

* test cost margins

* refactored ui

* provider discounts

* add cost_breakdown to spendLogs

* add CostBreakdownViewer

* fix cost breakdown

* docs fix

* doc margins

* docs margins
2025-12-25 11:07:27 +05:30
Sameer Kankute 42121ad13b Update minimax docs to be in proper format 2025-12-24 09:25:36 +05:30
YutaSaito 55bfb24ef8 Merge pull request #18324 from BerriAI/litellm_feat_dynamic_env_propagation_for_stdio_MCP_server
feat: support MCP stdio header env overrides
2025-12-24 06:29:53 +09:00
Ishaan Jaff 4f7682f670 [Feat] RAG query endpoint - Add RAG Search / Query endpoint (#18376)
* add rag query to llm api endpoints

* add rag query as a new endpoint

* docs - new endpoint

* ingest+query

* docs add rag query
2025-12-23 22:30:37 +05:30
Ishaan Jaff 0f63cbea59 [Feat] Interactions API - allow using all litellm providers (interactions -> responses api bridge) (#18373)
* add BaseInteractionsTest

* add interactions_api_handler

* init bridge

* init LiteLLMResponsesInteractionsConfig

* LiteLLMResponsesInteractionsHandler

* mv test

* fixes api spec

* docs

* fix transform+iterators

* docs fix

* fix iterator
2025-12-23 22:30:22 +05:30
Sameer Kankute c7e0366925 Add support for minmax tts 2025-12-23 21:53:53 +05:30
Sameer Kankute a2240775c4 correct doc 2025-12-23 21:46:34 +05:30
Sameer Kankute e18cfc0cf6 corrected provider name 2025-12-23 21:42:51 +05:30
Sameer Kankute 26c0396146 Add documentation for chat compeltion minmax 2025-12-23 17:10:06 +05:30
Sameer Kankute af8483b37e Fix: documentation for litellm sdk 2025-12-23 16:27:35 +05:30
Sameer Kankute 0174c56c90 Fix: documentation for litellm sdk 2025-12-23 16:23:53 +05:30
Sameer Kankute 7559869359 Merge branch 'main' into litellm_minmax_anthropic_spec 2025-12-23 16:13:47 +05:30
Sameer Kankute 403875256c Add minmax documentation 2025-12-23 16:11:26 +05:30
Cesar Garcia 40fac60ea7 docs(openai): fix gpt-5-mini reasoning_effort supported values (#18346)
Remove 'none' from gpt-5-mini's supported reasoning_effort values in the documentation table. gpt-5-mini does not support reasoning_effort="none", only minimal, low, medium, and high.
2025-12-23 15:50:57 +05:30
Sameer Kankute c47079ba3a Merge pull request #18062 from Chesars/fix/groq-deprecated-models
fix: remove deprecated Groq models and update model registry
2025-12-23 12:06:27 +05:30
Sameer Kankute f6350aac9b Merge pull request #18349 from prasadkona/feat/databricks-partner-integration
feat(databricks): Add enhanced authentication, security features, and custom user-agent support
2025-12-23 09:45:28 +05:30
Alexsander Hamir 5534038e93 Fix CI: Revert security scan changes and add GitGuardian ignore rules (#18358) 2025-12-22 17:03:53 -08:00
yuneng-jiang 87fc81f3e6 Add cloudzero ui docs 2025-12-22 13:19:03 -08:00
prasadkona d33c54ee0c Merge branch 'main' into feat/databricks-partner-integration 2025-12-22 12:30:03 -08:00
prasadkona 3a1baae45c feat(databricks): Add enhanced authentication, security features, and custom user-agent support
- Add OAuth M2M (Machine-to-Machine) authentication via DATABRICKS_CLIENT_ID and DATABRICKS_CLIENT_SECRET
- Add Databricks SDK auto-auth with automatic credential discovery
- Add sensitive data redaction for secure logging (tokens, API keys, secrets)
- Add custom user_agent parameter for partner attribution in Databricks telemetry
- Support user_agent in LiteLLM Proxy via config.yaml litellm_params
- Add 49 mocked unit tests for all new functionality
- Add 13 E2E tests for real-world validation (skipped in CI)
- Update documentation with new features and examples
2025-12-22 12:02:51 -08:00
Alexsander Hamir 30fa90f70d [Feat] Enable async_post_call_failure_hook to transform error responses (#18348) 2025-12-22 11:24:30 -08:00
Sameer Kankute 6d5eb07496 Merge pull request #18336 from BerriAI/litellm_add_nova_image_embedding_support
fix: request body for image embedding request
2025-12-22 19:11:42 +05:30
Ishaan Jaff 2677d9d30d [Feat] New provider TTS - Add AWS polly API for TTS (#18326)
* add aws_polly as new provider

* init AWSPollyTextToSpeechConfig

* test_aws_polly_tts_with_native_voice

* init aws_polly + AWS polly dispatch

* init AWSPollyTextToSpeechConfig

* fix transform

* add aws_polly as a new provider for TTS API

* add to sidebar

* docs aws polly

* code qa fix

* add AWS Polly Text-to-Speech

* add cost tracking for AWS polly

* docs fix
2025-12-22 18:19:34 +05:30
Sameer Kankute cbc1ac9508 fix: request body for image embedding request 2025-12-22 16:55:04 +05:30
Farhan Aulianda 63c3a6e228 fix: enable JSON-only provider routing + add xiaomi_mimo provider (#18291)
* fix: enable JSON-only provider routing + add xiaomi_mimo provider

* docs: add xiaomi_mimo provider documentation
2025-12-22 12:05:22 +05:30
Yuta Saito 34b500c7f5 feat: support MCP stdio header env overrides 2025-12-22 12:58:31 +09:00
Ishaan Jaffer fe6f0be70f add new providers 2025-12-21 09:27:25 +05:30
yuneng-jiang f28ff1dd79 docs 2025-12-20 12:43:41 -08:00
yuneng-jiang 0bd7c01ca4 Merge branch 'main' into litellm_yuneng_docs_v18011 2025-12-20 12:38:50 -08:00
yuneng-jiang 7e0f360272 docs 2025-12-20 12:36:32 -08:00
Alexsander Hamir 52fc18ec9a performance write up (#18296) 2025-12-20 12:30:17 -08:00
Ishaan Jaffer acadaca7e7 doc review 1 2025-12-21 00:06:06 +05:30
Ishaan Jaffer 01a517a2c6 v 1.80.11 2025-12-20 23:48:10 +05:30
dependabot[bot] a15f30ba7d chore(deps): bump altcha-lib from 1.3.0 to 1.4.1 in /docs/my-website (#18017)
Bumps [altcha-lib](https://github.com/altcha-org/altcha-lib) from 1.3.0 to 1.4.1.
- [Release notes](https://github.com/altcha-org/altcha-lib/releases)
- [Commits](https://github.com/altcha-org/altcha-lib/compare/1.3.0...1.4.1)

---
updated-dependencies:
- dependency-name: altcha-lib
  dependency-version: 1.4.1
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-20 21:24:01 +05:30
Ishaan Jaffer 6112160a16 Revert "[Fix] Security - Remove example API keys with high entropy (#18255)"
This reverts commit 24edbccf5c.
2025-12-20 20:48:11 +05:30
Ishaan Jaffer a38f98057f fix 2025-12-20 15:21:00 +05:30
Krrish Dholakia a3b6c6c0a7 fix: fix doc 2025-12-20 13:28:58 +05:30
Alexsander Hamir 5b1fda02fb Add infrastructure recommendations to benchmarks documentation (#18264)
Added concise PostgreSQL and Redis specifications based on benchmark results and industry standards for API gateway deployments. Includes tiered recommendations for different RPS workloads, configuration best practices, and scaling guidelines.
2025-12-19 13:44:36 -08:00
Sameer Kankute 3761f38e43 Merge pull request #18254 from BerriAI/litellm_add_stability_model_edit_1
Add support for stability model and bedrock stability model
2025-12-20 00:23:15 +05:30
Sameer Kankute d29f4cab59 Merge pull request #17971 from BerriAI/litellm_ocr_deepseek
Add support for ocr for vertex ai deepseek model
2025-12-20 00:13:57 +05:30
Alexsander Hamir 24edbccf5c [Fix] Security - Remove example API keys with high entropy (#18255) 2025-12-19 10:09:50 -08:00
Sameer Kankute f062dbdca6 Merge pull request #18227 from BerriAI/litellm_gemini3_doc_update
Add version requirement in gemini 3 flash blog
2025-12-19 23:30:20 +05:30
Sameer Kankute 86596de193 add vertex ai location note 2025-12-19 23:29:38 +05:30
Sameer Kankute 248eb4ea49 Minor bug fixes: mask list 2025-12-19 23:04:53 +05:30
Ishaan Jaffer 388535003e docs fix 2025-12-19 20:06:56 +05:30
Anil Kodali afba676b2e Add Amazon Nova to sidebar and under supported models in README (#18220) 2025-12-19 19:07:34 +05:30
Sameer Kankute 84e4fc3fab Merge pull request #18226 from Chesars/fix/responses-api-tool-calls-transformation
fix(responses-api): fix tool calls transformation in completion bridge
2025-12-19 13:41:55 +05:30
YutaSaito 369111d186 Merge pull request #18235 from uc4w6c/doc/improve_secret_manager
doc: improve secret manager settings
2025-12-19 17:03:29 +09:00
Sameer Kankute 9e3acdb815 Add version requirement in gemini 3 flash blog 2025-12-19 10:38:06 +05:30