164455ad2f
docs: fix config file description in k8s deployment ( #12230 )
...
Signed-off-by: Yuichiro Utsumi <utsumi.yuichiro@fujitsu.com >
2025-07-02 16:33:28 -07:00
26f6dbdd3d
docs(bedrock_agents.md): show example of passing provider specific params to bedrock agents
...
Closes https://github.com/BerriAI/litellm/issues/12232#issuecomment-3029092079
2025-07-02 14:23:07 -07:00
df49b24bc0
Azure - responses api bridge - respect responses/ + Gemini - generate content bridge - handle kwargs + litellm params containing stream ( #12224 )
...
* fix(main.py): handle router custom azure model name for responses api bridge
* fix(responses/handler): ensure azure model name is stripped before sending to provider
Fixes model name error
* fix(google_genai/main.py): handle stream=true being set in kwargs
* docs: cleanup icons from sidebar
* fix(test-litellm.yml): add google-genai to test litellmyml
* fix(main.py): strip 'responses/' from bridge
* fix(main.py): fix linting errors
* fix(types/openai.py): allow item to be none
handle azure streaming response
* fix(base.py): allow extra fields + handle azure item = none value in response output item added event
* fix(main.py): correctly handle removing responses/
* test(test_main.py): add unit tests
2025-07-02 13:53:52 -07:00
c5e55c0b19
docs(index.md): clarify which rc version fixes the non-root ui issue
2025-07-01 22:32:55 -07:00
22d28f5853
Batches - support batch retrieve with target model Query Param + Anthropic - completion bridge, yield content_block_stop chunk ( #12228 )
...
* fix(batches_endpoints/endpoints.py): support passing target model names for batch list as a query param
Fixes issue where cloud run fails calls because GET can't contain request body
* test(test_openai_batches_endpoints.py): add unit test
* docs(managed_batches.md): update docs
* feat(spend_tracking_utils.py): support STORE_PROMPTS_IN_SPEND_LOGS env var
ensures prompt is stored in spend logs
* fix(streaming_iterator.py): fix anthropic - completion streaming iterator to yield content block stop
ensures claude code renders messages
* test: skip local test
2025-07-01 22:13:48 -07:00
9a2c74c25b
Fix rendering ui on non-root images ( #12226 )
...
* fix(proxy_server.py): only rewrite server_root_path if path set
Fixes UI rendering issue on non-root images
* docs(custom_root_ui.md): clarify custom root path doesn't work on non-root images
2025-07-01 22:08:35 -07:00
66fafa3a7f
[Feat] Polish - add better error validation when users configure prometheus metrics and labels to control cardinality ( #12182 )
...
* self._pretty_print_invalid_metric_error
* docs prometheus.md
* test prom validation checks
* update metric name
* fix _pretty_print_validation_errors
* fix linting
* test prometheus
* test fixes - prometheus
2025-07-01 20:17:17 -07:00
a6527e5010
[Feat] Add litellm-proxy cli login for starting to use litellm proxy ( #12216 )
...
* add handlers for auth commands
* add login, logout, whoami
* refactor auth
* add CLI Authentication Flow
* add SSO sign in constants
* add itellm-session-token
* fixes for managing state with cli
* use locally stored context for cli session
* add litellm banner + interactive shell
* update main.py
* update auth to show commands
* fix ui sso render
* add TestCLISSOCallbackFunction
* update banner.py
* remove file
* fix cli sso success
* TestTokenUtilities
* fix code qa
* fix execute_command
* fix cli_sso_callback
* fix import
* Authentication using CLI
2025-07-01 18:11:19 -07:00
f6589d81ec
Update Vertex Model Garden doc to use SDK for deploy + chat completion ( #12219 )
...
* Update Vertex Model Garden documentation to deploy + use OpenAI Chat Completion tutorial.
* update anchor description
2025-07-01 17:54:44 -07:00
a6922e68fb
add verbose docs
2025-07-01 15:50:30 -07:00
0834ab79cd
add docs changes
2025-07-01 15:25:23 -07:00
69670001de
email_templates
2025-07-01 14:34:15 -07:00
ee9dd158dd
Fix - handle empty config.yaml + Fix gemini /models - replace models/ as expected, instead of using 'strip' ( #12189 )
...
* fix(proxy_server.py): handle empty config yaml
Fixes https://github.com/BerriAI/litellm/issues/12163
* fix(gemini/common_utils.py): replace models/ as expected, instead of using 'strip'
Fixes https://github.com/BerriAI/litellm/issues/12160
* fix(anthropic/experimental_pass_through/messages/transformation.py): check for env var when selecting api key
* docs(config_settings.md): add api key to docs
2025-06-30 21:56:03 -07:00
5188c67c6c
docs: update docs
2025-06-30 21:39:42 -07:00
2e467a6c99
Use the -d flag in docs instead of -D ( #12179 )
2025-06-30 15:25:42 -07:00
d727d63a81
[Feat] Add new AWS SQS Logging Integration ( #12176 )
...
* add aws_sqs
* add sqs controls
* add SQS to registry
* fix url lib parse
* fixes AWS SQS
* test_async_sqs_logger_flush
* fix test
* fix SQS logger auth
* add AWS SQS
* add aws sqs
* docs logging
* test_async_sqs_logger_flush
* test_async_sqs_logger_flush
* add SQS logger
* update SQS logging
* use constants for SQS
2025-06-30 14:02:49 -07:00
4978d7ad00
docs(lakera_ai.md): detail supported params
2025-06-30 13:18:49 -07:00
4bb732d30f
docs slack support
2025-06-30 10:57:10 -07:00
cff0030d05
Update management_cli.md ( #12157 )
...
add quotes to the uv tool install command the current will fail.
2025-06-30 10:54:16 -07:00
b7cb05114c
docs add slack support
2025-06-30 10:45:37 -07:00
f76375b651
docs(index.md): add batch api cost tracking to docs
2025-06-28 22:25:15 -07:00
1df5c160c3
docs(index.md): add more hyperlinks to docs
2025-06-28 22:22:10 -07:00
7cc2ce0cf8
docs: index.md
...
release note cleanup
2025-06-28 22:22:10 -07:00
79ffb8a89e
docs gemini cli x litellm
2025-06-28 22:06:42 -07:00
7da4e2197d
Benefits of using gemini-cli with LiteLLM
2025-06-28 21:59:07 -07:00
50dd9980dc
docs - update release notes
2025-06-28 21:56:58 -07:00
f7af8902b0
/v1/messages - Remove hardcoded model name on streaming + Tags - enable setting custom header tags (#12131 )
...
* fix(anthropic/experimental_pass_through): use given model name when returning streaming chunks
don't harcode model name on streaming
confusing for user
* fix(anthropic/streaming_iterator.py): remove scope of import
* feat(litellm_logging.py): allow admin to specify additional headers for using as spend tags
Closes https://github.com/BerriAI/litellm/issues/12129
* test(test_litellm_logging.py): add unit tests
* feat(openweb_ui.md): add custom tag tutorial to docs
* docs(cost_tracking.md): add tag based usage UI screenshot
* test: update test
* fix: fix import
2025-06-28 21:49:35 -07:00
123631c93d
docs(index.md): update release note with cleaner table for updated models
2025-06-28 21:48:24 -07:00
e77eb82cd6
docs(index.md): initial pre-release note
2025-06-28 13:24:19 -07:00
27849359a9
fix example config.yaml in claude code tutorial ( #12133 )
2025-06-28 11:07:48 -07:00
8b73716a66
add docs
2025-06-28 09:26:12 -07:00
1c68c24358
introduce new environment variable NO_REDOC to opt-out Redoc ( #12092 )
...
Signed-off-by: Youfu Zhang <zhangyoufu@gmail.com >
2025-06-27 21:26:37 -07:00
7465f062c0
add panw guard docs
2025-06-27 21:13:04 -07:00
bb98f68451
docs fix
2025-06-27 21:09:33 -07:00
9ab7d97b85
adds model to metadata to estimated cost is calculated; corrects how to pass metadata in braintrust in the docs ( #12022 )
2025-06-27 18:11:07 -07:00
ebf6395bc1
[Feat] Add Eleven Labs - Speech To Text Support on LiteLLM ( #12119 )
...
* add ELEVENLABS as a provider
* add deepgram to main.py
* add ElevenLabsException
* add ElevenLabsAudioTranscriptionConfig
* add transform_audio_transcription_response
* TestElevenLabsAudioTranscription
* add elevenlabs/scribe_v1 to model cost map
* add ElevenLabsAudioTranscriptionConfig
* add AudioTranscriptionRequestData
* add ElevenLabs transform
* use AudioTranscriptionRequestData
* refactoring fixes
* add ProcessedAudioFile util for reading audio files
* test_elevenlabs_diarize_parameter_passthrough
* docs eleven labs
* docs fixes
* fix code qa checks
* fixes - audio transcription
* ui - add ElevenLabs logo
* add elevenlabs logo
* docs - ElevenLabs
* test fix elevenlabs
2025-06-27 17:50:49 -07:00
b57cfb8bff
Adding Feature: Palo Alto Networks Prisma AIRS Guardrail ( #12116 )
...
* feat: Add PANW Prisma AIRS guardrail integration
- Add PANW_PRISMA_AIRS to SupportedGuardrailIntegrations enum
- Update guardrail registry and initializers
- Add complete documentation with curl examples and response formats
- Support pre_call, post_call, and during_call modes
- Include fail-safe error handling and comprehensive logging
- Integration with official PANW Prisma AIRS API
* feat: Add PANW Prisma AIRS guardrail integration
- Update to test file
- Fail-closed security on API errors
* update fail closed behavior
* fix: Update PANW Prisma AIRS guardrail integration pattern
* fix: Remove unused import
* fix: addressed MyPy error
2025-06-27 15:17:36 -07:00
f85cd9c54a
[Docs] - Show how to use fallbacks with audio transcriptions endpoints ( #12115 )
...
* add overview
* docs audio transcriptions
* docs on fallbacks with audio endpoints
2025-06-27 12:43:55 -07:00
f1c7024e70
[Feat] Add Bridge from generateContent <> /chat/completions ( #12081 )
...
* add GenerateContentToCompletionHandler
* working - non streaming bridge
* add GoogleGenAIAdapter
* add google gen ai adapter
* working streaming bridge
* working streaming usage for adapter
* tool calling transform for generate content to openai
* fixes for accumulating tool calls
* fix code qa checks
* Best Practices for Production
* fix code qa checks
* test_streaming_partial_tool_calls_accumulation
* linting fixes
* add supported_openai_chat_completion_params
* fix translate_generate_content_to_completion
* test_google_genai_adapter.py
2025-06-27 11:08:55 -07:00
60bf3c36bf
fix(docs): Remove unused dotenv dependency from docusaurus config ( #12102 )
...
* fix(docs): Remove unused dotenv dependency from docusaurus config
The dotenv package was being required in docusaurus.config.js but was listed as
a devDependency, causing build failures. Since no environment variables are
actually used in the config, removed the unnecessary import.
* fix(docs): Remove reference to non-existent spending_monitoring doc
The sidebars.js file was referencing proxy/spending_monitoring which was deleted
in commit ba7463b9c
2025-06-27 08:20:44 -07:00
ba7463b9c6
docs - spend monitoring
2025-06-26 17:39:13 -07:00
edf416c24f
docs - Use LiteLLM with Gemini CLI
2025-06-26 17:31:19 -07:00
72ecac8962
docs - user agent
2025-06-26 16:23:59 -07:00
16126f0d6b
docs Gemini Text-to-Speech
2025-06-26 15:59:48 -07:00
80acf6bc97
docs */speech to /chat/completions Bridge**
2025-06-26 15:53:25 -07:00
fc39343599
docs update
2025-06-26 15:32:33 -07:00
e556071544
docs - Use LiteLLM with Gemini CLI
2025-06-26 13:35:33 -07:00
bd0a5f7387
Inkeep searchbar and chat added to the Docs ( #12030 )
...
* inkeep chat added
* add prod key
2025-06-26 10:13:42 -07:00
22ff3da3cf
[Fix] Allow using HTTP_ Proxy settings with trust_env ( #12066 )
...
* allow using trust_env
* add docs on how to use HTTP_PROXY
* docs AIOHTTP_TRUST_ENV
* test_aiohttp_transport_trust_env_setting
* docs fix
2025-06-26 08:37:22 -07:00
327405ffae
Merge pull request #12050 from colesmcintosh/docs/elasticsearch-logging-tutorial
...
Fix Elasticsearch tutorial image rendering
2025-06-26 09:00:00 -06:00
Yuichiro Utsumi