cb8e3936ae
Merge pull request #14216 from mubashir1osmani/fix_all_docs
...
Fix custom callbacks doc
2025-09-04 07:35:38 -07:00
8738f630ac
Merge pull request #14232 from mubashir1osmani/litellm_docs
...
[docs]: added more info to load balancing & pass through endpoints
2025-09-04 07:31:54 -07:00
8878951f16
docs fix: disable_add_user_agent_to_request_tags
2025-09-04 07:30:18 -07:00
b0450d2ddf
docs: added more info to load balancing & passthrough endpoints
2025-09-03 23:58:48 -04:00
23ae7170d1
[Feat] Allow using Veo Video Generation through LiteLLM Pass through routes ( #14228 )
...
* fix: add follow_redirects=True,
* test_pass_through_with_httpbin_redirect
* cook book veo video
* docs Veo Video Generation with Google AI Studio
* add veo-3.0-generate-preview cost tracking details
* track vertex_video_models
2025-09-03 18:25:43 -07:00
19e2bab8c8
[Feat] Add Initial support for Bedrock Batches API ( #14190 )
...
* fix acreate_file with bedrock
* fix routing to bedrock batches api
* fix create_file
* working batch file upload
* fix batches API for file upload
* test: bedrock files and batches API
* add BaseBatchesConfig
* fix get_provider_batches_config
* transform bedrock batches
* fix run create batch through llm http handler
* test_async_file_and_batch
* main.batches creation
* fix: CommonBatchFilesUtils
* fix async_create_batch
* test_async_file_and_batch
* BedrockBatchesConfig
* fix ruff check
* ruff check fix
* fix docs ref
2025-09-03 17:19:58 -07:00
ca43514db4
[Feat] Support reasoning_effort in Groq ( #14207 )
...
* Support reasoning_effort in groq
* add test
2025-09-03 10:43:47 -07:00
d1c376f93e
fix custom callback docs
2025-09-03 12:45:42 -04:00
ecc607257b
fixed prometheus metrics
2025-09-03 02:14:59 -04:00
46655544a4
Merge pull request #14179 from zhirafovod/otel_logs_metrics
2025-09-02 19:50:40 -07:00
212ca20edf
docs fix
2025-09-02 15:19:35 -07:00
128d9a3488
[Feature]: Add header support for spend_logs_metadata ( #14186 )
...
* fix: allow settings spend_logs_metadata
* fix add_litellm_data_for_backend_llm_call
* fix: add add_litellm_metadata_from_request_headers
* fix add_litellm_metadata_from_request_headers
* test_add_litellm_metadata_from_request_headers
* add_litellm_metadata_from_request_headers
* docs Tracking Spend with custom metadata
* add_litellm_metadata_from_request_headers
* add_litellm_metadata_from_request_headers
2025-09-02 15:13:15 -07:00
c821f1ddf1
[Feature]: Support GPT-OSS models on vertex ai ( #14184 )
...
* add VertexAIGPTOSSTransformation
* fix: optional_params
* fix: is_vertex_partner_model
* test_partner_models_httpx
* docs GPT oss docs
* test_vertex_ai_gpt_oss_reasoning_effort
* add vertex ai models
2025-09-02 14:15:26 -07:00
4adfd18bc6
[Feat]Add support for safety_identifier parameter in chat.completions.create ( #14174 )
...
* Add support for safety_identifier parameter in chat.completions.create
* make sure param is getting actually passed to the raw api
2025-09-02 09:37:08 -07:00
5dcdbb35da
add metrics and logs (events) with semconv attributes
2025-09-02 09:20:25 -06:00
e17bed715e
DEFAULT_NUM_WORKERS_LITELLM_PROXY
2025-09-01 17:08:03 -07:00
2331fb45d5
[Bug]: Gemini 2.5 Pro – schema validation fails with OpenAI-style type arrays in tools ( #14154 )
...
* fix: _convert_schema_types
* fix recursive detector
* test_convert_schema_types_type_array_conversion
* fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY
2025-09-01 16:53:20 -07:00
98d57b5d27
[Feat] Allow using x-litellm-stream-timeout header for stream timeout in requests ( #14147 )
...
* fix: allow passing stream_timeout header
* fix: _get_stream_timeout_from_request
* test_add_litellm_data_to_request_with_stream_timeout_header
* docs: LiteLLM Headers
* test_add_litellm_data_to_request_with_stream_timeout_header
2025-09-01 15:59:14 -07:00
58b713d19d
[Bug fix] Misclassified 500 error on invalid image_url in /chat/completions request ( #14149 )
...
* add ImageFetchError
* docs ImageFetchError
* fix ImageFetchError
* test_completion_with_invalid_image_url
2025-09-01 15:26:27 -07:00
0c9051abba
docs(docker_quick_start.md): add docker compose to quick start
2025-08-31 21:24:30 -07:00
ccb7ce03a3
[Docs] v1.76.1-stable ( #14094 )
...
* docs 1.76.1
* fix docs
* docs 1.76.1
* New Model Support
* docs fixes
2025-08-30 14:54:27 -07:00
8b11452d9e
Merge branch 'main' into add-vercel-ai-gateway-provider
2025-08-29 22:27:08 -07:00
6d81d75948
docs: Add documentation for MAX_STRING_LENGTH_PROMPT_IN_DB environment variable ( #14079 )
...
Added documentation for the new MAX_STRING_LENGTH_PROMPT_IN_DB environment variable to the config settings guide. This variable controls the maximum length of strings in spend logs when sanitizing request bodies, with a default value of 1000 characters.
🤖 Generated with [Claude Code](https://claude.ai/code )
Co-authored-by: Claude <noreply@anthropic.com >
2025-08-29 17:38:50 -07:00
38df2500b6
docs: usaged-based routing perf warnings ( #14080 )
2025-08-29 17:31:12 -07:00
e74f1b6b62
Added DataRobot provider to sidebar ( #14074 )
2025-08-29 13:15:33 -07:00
7f5c92ddeb
Update docs for stream_timeout and timeout ( #14073 )
2025-08-29 09:59:07 -07:00
bcd38dde2e
Merge pull request #14036 from gotsysdba/main
...
OCI Provider: add oci_key_file as an optional_parameter
2025-08-29 06:27:09 -07:00
7513bec0e9
Merge pull request #14037 from NoWall57/feature/force-anthropic-custom-api-base-readme
...
docs: add documentation for LITELLM_ANTHROPIC_DISABLE_URL_SUFFIX envi…
2025-08-29 06:26:11 -07:00
f90072b226
Apply suggestions from code review
...
Co-authored-by: Nate Goudreault <50588929+nate-goudreault@users.noreply.github.com >
2025-08-28 23:00:09 -06:00
bf55bf5072
Update datarobot.md
2025-08-28 23:00:09 -06:00
5c73b17387
Add initial docs
2025-08-28 23:00:09 -06:00
f3338bef9f
[MCP] Bug fix - adding SSE MCP tools - fix connection test when adding MCPs ( #14048 )
...
* fix: _execute_with_mcp_client
* add warning for SSE MCP
* docs - MCP videos / guides
2025-08-28 15:16:34 -07:00
323fe8aeac
docs: add documentation for LITELLM_ANTHROPIC_DISABLE_URL_SUFFIX environment variable
...
Added comprehensive documentation for the new LITELLM_ANTHROPIC_DISABLE_URL_SUFFIX configuration option that allows users to disable automatic URL suffix appending when using custom Anthropic API endpoints. This is useful for proxy servers or custom endpoints that don't follow Anthropic's standard URL structure.
Changes:
- Added environment variable to Anthropic provider docs with examples
- Created "Custom API Base" section explaining usage scenarios
- Added entry to environment variables reference table in config settings
2025-08-28 22:21:41 +08:00
87abfc3c11
Adding oci_key_file support for oci provider
2025-08-28 14:37:53 +01:00
f01c7d13e7
Merge pull request #13991 from ikaadil/fix/gemini-imagen-model-name-validation
...
[Bug Fix] Resolve invalid model name error for Gemini Imagen models
2025-08-27 21:56:19 -07:00
d5774d89cc
Update Docker image tag to v1.75.8-stable ( #14014 )
...
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
Co-authored-by: ishaan <ishaan@berri.ai >
2025-08-27 16:44:50 -07:00
04dc1a5351
[Feat] Add support for returning images with gemini/gemini-2.5-flash-image-preview with /chat/completions ( #13983 )
...
* add gemini-2.5-flash-image-preview
* add gemini-2.5-flash-image-preview
* add image in ChatCompletionResponseMessage
* test_gemini_image_generation_async
* Revert "Merge pull request #13394 from Deviad/feature/enhance_logging_for_containers"
This reverts commit 539b94ad4e71af7bcf9c
2025-08-27 16:16:19 -07:00
165242e31f
[Feat] langfuse_otel logger - allow using LANGFUSE_OTEL_HOST for configuring host ( #14013 )
...
* feat - add _get_langfuse_otel_host
* test_get_langfuse_otel_config_with_otel_host_priority
* docs: LANGFUSE_OTEL_HOST
2025-08-27 14:43:47 -07:00
75aeca14b2
Merge branch 'main' into fix/gemini-imagen-model-name-validation
2025-08-27 21:52:47 +02:00
76f78f7b2a
fix: LITELLM_LOG_FILE test
2025-08-27 08:25:24 -07:00
8808f78ba6
Merge branch 'main' into fix/gemini-imagen-model-name-validation
2025-08-27 15:45:59 +02:00
ddec6c69c8
Merge pull request #13534 from cometapi-dev/main
...
docs: Add CometAPI documentation with authentication, usage examples, and error handling
2025-08-26 23:17:04 -07:00
45f465d84f
Merge pull request #13572 from Noma-Security/noma-security-guardrails-support
...
Add Noma Security guardrail support
2025-08-26 23:15:17 -07:00
0f5b31fd78
fix: resolve invalid model name error for Gemini Imagen models ( #13851 )
...
- Fix URL construction in Gemini image generation to strip 'gemini/' prefix
- Google AI API expects base model name without the prefix
- Update model references and pricing information for consistency
- Remove outdated image generation pricing entries
Fixes issue where models like 'gemini/imagen-4.0-fast-generate-preview-06-06'
were being rejected by the Google AI API due to incorrect URL formatting.
2025-08-27 04:17:35 +02:00
ae678a6642
Merge pull request #13573 from Ivy-Interactive/feature/braintrust-span-name-metadata
...
Feature/braintrust span name metadata
2025-08-25 23:19:56 -07:00
3ed1220f75
Merge pull request #13916 from mubashir1osmani/openai-multiple-images
...
feat: multiple images in openai images/edits endpoint
2025-08-25 23:11:13 -07:00
c1ee8c26af
[UI QA] - Allow setting Team Member RPM/TPM limits when creating a team ( #13943 )
...
* allow setting team_member_rpm_limit on creating
* create_team_member_rate_limits
* docs fix
* fix img
2025-08-25 09:12:50 -07:00
7c5e9b666b
update release notes
2025-08-25 08:17:30 -07:00
68aaeb4f4a
Merge pull request #13914 from uc4w6c/docs/fix-custom-guardrail-imports
...
Fix missing and unused imports in custom_guardrail docs example
2025-08-25 00:57:46 -07:00
cca1ea1592
Fix missing and unused imports in custom_guardrail docs example
2025-08-24 08:37:17 +09:00
Krish Dholakia