tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-05 20:23:18 +00:00
Code Issues Packages Projects Releases Wiki Activity
24,388 Commits 2,072 Branches 1,425 Tags
323fe8aeac91da77571257ab67d2bcc8d0e42ffd
Commit Graph
4099 Commits
Author SHA1 Message Date
0x5751 323fe8aeac docs: add documentation for LITELLM_ANTHROPIC_DISABLE_URL_SUFFIX environment variable 
Added comprehensive documentation for the new LITELLM_ANTHROPIC_DISABLE_URL_SUFFIX configuration option that allows users to disable automatic URL suffix appending when using custom Anthropic API endpoints. This is useful for proxy servers or custom endpoints that don't follow Anthropic's standard URL structure.

Changes:
- Added environment variable to Anthropic provider docs with examples
- Created "Custom API Base" section explaining usage scenarios
- Added entry to environment variables reference table in config settings
 2025-08-28 22:21:41 +08:00
Krish DholakiaandGitHub f01c7d13e7 Merge pull request #13991 from ikaadil/fix/gemini-imagen-model-name-validation 
[Bug Fix] Resolve invalid model name error for Gemini Imagen models
 2025-08-27 21:56:19 -07:00
Ishaan JaffGitHubCursor Agentishaan
 		d5774d89cc Update Docker image tag to v1.75.8-stable (#14014) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: ishaan <ishaan@berri.ai>
 2025-08-27 16:44:50 -07:00
Ishaan JaffandGitHub 04dc1a5351 [Feat] Add support for returning images with gemini/gemini-2.5-flash-image-preview with /chat/completions (#13983) 
* add gemini-2.5-flash-image-preview

* add gemini-2.5-flash-image-preview

* add image in ChatCompletionResponseMessage

* test_gemini_image_generation_async

* Revert "Merge pull request #13394 from Deviad/feature/enhance_logging_for_containers"

This reverts commit 539b94ad4e, reversing
changes made to 71af7bcf9c.

* include `image` in Delta

* fix _process_candidates should show the image response

* fix: _handle_special_delta_attributes

* test_gemini_image_generation_async_stream

* image_generation_chat

* UI - allow looking at generated images from /chat/completions

* _create_streaming_choice

* fix import StreamingChoices

* fix ChatCompletionResponseMessage

* test_gemini_image_generation

* add gemini img migration

* fix _extract_candidate_metadata

* ui fix

* fix batch endpoint test
 2025-08-27 16:16:19 -07:00
Ishaan JaffandGitHub 165242e31f [Feat] langfuse_otel logger - allow using LANGFUSE_OTEL_HOST for configuring host (#14013) 
* feat - add _get_langfuse_otel_host

* test_get_langfuse_otel_config_with_otel_host_priority

* docs: LANGFUSE_OTEL_HOST
 2025-08-27 14:43:47 -07:00
Ifta Khairul Alam Adil 75aeca14b2 Merge branch 'main' into fix/gemini-imagen-model-name-validation 2025-08-27 21:52:47 +02:00
Ishaan Jaff 76f78f7b2a fix: LITELLM_LOG_FILE test 2025-08-27 08:25:24 -07:00
Ifta Khairul Alam Adil 8808f78ba6 Merge branch 'main' into fix/gemini-imagen-model-name-validation 2025-08-27 15:45:59 +02:00
Krish DholakiaandGitHub ddec6c69c8 Merge pull request #13534 from cometapi-dev/main 
docs: Add CometAPI documentation with authentication, usage examples, and error handling
 2025-08-26 23:17:04 -07:00
Krish DholakiaandGitHub 45f465d84f Merge pull request #13572 from Noma-Security/noma-security-guardrails-support 
Add Noma Security guardrail support
 2025-08-26 23:15:17 -07:00
Ifta Khairul Alam Adil 0f5b31fd78 fix: resolve invalid model name error for Gemini Imagen models (#13851) 
- Fix URL construction in Gemini image generation to strip 'gemini/' prefix
- Google AI API expects base model name without the prefix
- Update model references and pricing information for consistency
- Remove outdated image generation pricing entries

Fixes issue where models like 'gemini/imagen-4.0-fast-generate-preview-06-06'
were being rejected by the Google AI API due to incorrect URL formatting.
 2025-08-27 04:17:35 +02:00
Krish DholakiaandGitHub ae678a6642 Merge pull request #13573 from Ivy-Interactive/feature/braintrust-span-name-metadata 
Feature/braintrust span name metadata
 2025-08-25 23:19:56 -07:00
Krish DholakiaandGitHub 3ed1220f75 Merge pull request #13916 from mubashir1osmani/openai-multiple-images 
feat: multiple images in openai images/edits endpoint
 2025-08-25 23:11:13 -07:00
Ishaan JaffandGitHub c1ee8c26af [UI QA] - Allow setting Team Member RPM/TPM limits when creating a team (#13943) 
* allow setting team_member_rpm_limit on creating

* create_team_member_rate_limits

* docs fix

* fix img
 2025-08-25 09:12:50 -07:00
Ishaan Jaff 7c5e9b666b update release notes 2025-08-25 08:17:30 -07:00
Krish DholakiaandGitHub 68aaeb4f4a Merge pull request #13914 from uc4w6c/docs/fix-custom-guardrail-imports 
Fix missing and unused imports in custom_guardrail docs example
 2025-08-25 00:57:46 -07:00
Yuta Saito cca1ea1592 Fix missing and unused imports in custom_guardrail docs example 2025-08-24 08:37:17 +09:00
mubashir1osmani 2fa8f971e0 feat: multiple images in openai images/edits endpoint 2025-08-23 19:13:32 -04:00
Krish DholakiaandGitHub 242c06e691 Merge pull request #13784 from mubashir1osmani/docs-deploy 2025-08-23 15:40:34 -07:00
Mubashir OsmaniandGitHub 1a8d3cc2d5 Added FAQ under deployment docs (#13912) 
* updated faq questions

* updated faq

* added faq under deployment
 2025-08-23 13:22:56 -07:00
Ishaan JaffandGitHub 9750374081 [Feat] New LLM API - AI/ML API for Image Gen (#13893) 
* add LlmProviders.AIML

* add AIMLChatConfig

* add aiml

* fix AimlImageGenerationConfig

* add AimlImageGenerationConfig

* add cost_calculator

* fixes for AI ML API

* add known AIML Flux image models

* add AIML Cost Calc

* add AI/ML API

* add aiml_models
 2025-08-23 13:12:44 -07:00
Krish DholakiaandGitHub 9df6f4ef08 Merge branch 'main' into litellm_dev_08_20_2025_p1 2025-08-23 12:09:53 -07:00
mubashir1osmani d664860aa1 added openai models to config 2025-08-23 10:02:49 -04:00
Krish DholakiaandGitHub 867b48a24f Merge pull request #13866 from jinskjoy/Mistral-File-ID 
[Enhancement] Add support for Mistral model file handling and update documentation
 2025-08-22 23:54:17 -07:00
Krish DholakiaandGitHub 28ea6cd35f Merge pull request #13899 from TeddyAmkie/docs/team-rate-limits-update 
docs: clarify prerequisites and env var for team rate limits
 2025-08-22 23:50:24 -07:00
Ishaan Jaff f9e9f8c25e docs AWS_REGION 2025-08-22 17:48:37 -07:00
Ishaan JaffandGitHub 56c16fc6f6 [Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895) 
* fix: litellm.configured_cold_storage_logger

* fix Session Management - Non-OpenAI Models docs

* ruff fix

* test fix
 2025-08-22 16:17:57 -07:00
Teddy Amkie 08d1c96ed1 docs: clarify prerequisites and env var for team rate limits 2025-08-22 18:39:31 +00:00
Sameer KankuteandGitHub 694a9f0f4c [Documentation] Litellm rerank deepinfra endpoint (#13845) 
* Add documentation for deepinfra rerank endpoint

* Add the missed import

* fix supported param
 2025-08-22 09:51:42 -07:00
Krish DholakiaandGitHub 7c2c1c11d9 Merge pull request #13783 from philipkiely-baseten/main 
Update Baseten LiteLLM integration
 2025-08-21 18:34:36 -07:00
jinskjoy d8a33e137d [Enhancement] Add support for Mistral model file handling and update documentation 2025-08-21 20:35:07 +02:00
Krrish Dholakia 5c1b27af99 docs(quick_start.md): add back to navbar 
useful for showing setup via cli
 2025-08-20 15:09:19 -07:00
Krrish Dholakia fb5b2d8d47 docs: remove old doc 
prevent showing up on searches
 2025-08-20 15:01:32 -07:00
Ishaan JaffandGitHub 55dcaded72 [Feat] Add VertexAI qwen API Service (#13828) 
* add support for vertex AI QWEN API

* streaming QWEN API support

* test_partner_models_httpx

* test_partner_models_httpx_streaming

* add cost tracking for vertex_ai/qwen/qwen3-235b-a22b-instruct-2507-maa

* docs qwen models vertexAI
 2025-08-20 15:00:33 -07:00
Ishaan Jaff e229a6a796 security fix 2025-08-20 08:35:59 -07:00
mubashir1osmani ef9e50458d removed faq 2025-08-19 17:01:31 -04:00
mubashir1osmani 2edcc51e57 updated claude-code docs and deployment faq 2025-08-19 16:52:46 -04:00
Philip Kiely 7c3d522435 Update Baseten LiteLLM integration 2025-08-19 12:21:05 -07:00
Krish DholakiaandGitHub 422447b7f1 Responses API - add default api version for openai responses api calls + Openrouter - fix claude-sonnet-4 on openrouter + Azure - Handle openai/v1/responses 
Responses API - add default api version for openai responses api calls + Openrouter - fix claude-sonnet-4 on openrouter + Azure - Handle `openai/v1/responses`
 2025-08-18 18:59:28 -07:00
Krrish Dholakia 0459604721 docs: document new param 2025-08-18 18:56:39 -07:00
Ishaan JaffandGitHub ba0881d728 [Bug Fix] image_edit() function returns APIConnectionError with litellm_proxy - Support for both image edits and image generations (#13735) 
* add image edits litellm proxy on SDK

* add image gen provider

* add IMG Gen support for litellm_proxy provider
 2025-08-18 18:26:32 -07:00
Ishaan Jaff eee93e250a docs v1.75.5-stable 2025-08-18 09:23:18 -07:00
TensorNullandGitHub 159cfe5b4c Merge branch 'BerriAI:main' into main 2025-08-18 09:46:12 +08:00
Krrish Dholakia 21549a3463 docs(index.md): write up on session management 2025-08-16 17:55:18 -07:00
Krrish Dholakia cb95f2d5d7 docs(index.md): clarify risk of upgrade 2025-08-16 17:38:50 -07:00
Krrish Dholakia 788a1d03a1 docs(index.md): cleanup 2025-08-16 17:33:07 -07:00
Krrish Dholakia 235b6b040f docs(index.md): add highlight note on redis latency improvements 2025-08-16 17:32:45 -07:00
Krrish Dholakia 8a75ab8388 docs(index.md): cleanup doc 2025-08-16 17:16:04 -07:00
Ishaan JaffandGitHub 5889311b10 [Docs] v1.75.8-stable (#13676) 
* v1-75-8

* fix responses API docs

* docs fix

* docs fix new models

* docs links

* docs fix links

* docs sambanova

* docs fix
 2025-08-16 09:20:04 -07:00
Krish DholakiaandGitHub f360e0ead2 Merge pull request #13590 from BerriAI/litellm_bedrock_api_header 
[LLM translation] Refactor Anthropic Configurations and Add Support for `anthropic_beta` Headers
 2025-08-14 11:32:18 -07:00