tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-18 00:17:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
24,629 Commits 2,072 Branches 1,425 Tags
b472bf6aef848b804d15db4d60e5fb96ee9df7aa
Commit Graph
4145 Commits
Author SHA1 Message Date
eycjur b472bf6aef update docs 2025-09-06 21:15:59 +09:00
Pierre-Emmanuel MERCIERandGitHub 31f806f7d0 feat: add redis ssl and username support (#11319) 2025-09-05 10:35:11 -07:00
Ishaan JaffandGitHub 982800069c [Bug Fix] x-litellm-tags not routing with Responses API (#14289) 
* fix: get_deployments_for_tag

* fix get_deployments_for_tag

* test_router_tag_routing.py

* test_get_metadata_variable_name_from_kwargs

* fix mapped tests

* docs fix
 2025-09-05 09:40:37 -07:00
Krish DholakiaandGitHub f67339a86c Merge pull request #14028 from onlylhf/volcengine-embedding-support 
Add Volcengine embedding module with handler and transformation logic
 2025-09-04 21:01:25 -07:00
Krish DholakiaandGitHub 5d5c19a302 Merge pull request #14077 from TomeHirata/codex/add-support-for-anthropic-citation-api 
Add support for anthropic citation api in Databricks
 2025-09-04 20:46:11 -07:00
Krish DholakiaandGitHub cb8e3936ae Merge pull request #14216 from mubashir1osmani/fix_all_docs 
Fix custom callbacks doc
 2025-09-04 07:35:38 -07:00
Krish DholakiaandGitHub 8738f630ac Merge pull request #14232 from mubashir1osmani/litellm_docs 
[docs]: added more info to load balancing & pass through endpoints
 2025-09-04 07:31:54 -07:00
Ishaan Jaff 8878951f16 docs fix: disable_add_user_agent_to_request_tags 2025-09-04 07:30:18 -07:00
mubashir1osmani b0450d2ddf docs: added more info to load balancing & passthrough endpoints 2025-09-03 23:58:48 -04:00
Ishaan JaffandGitHub 23ae7170d1 [Feat] Allow using Veo Video Generation through LiteLLM Pass through routes (#14228) 
* fix: add follow_redirects=True,

* test_pass_through_with_httpbin_redirect

* cook book veo video

* docs Veo Video Generation with Google AI Studio

* add veo-3.0-generate-preview cost tracking details

* track vertex_video_models
 2025-09-03 18:25:43 -07:00
Ishaan JaffandGitHub 19e2bab8c8 [Feat] Add Initial support for Bedrock Batches API (#14190) 
* fix acreate_file with bedrock

* fix routing to bedrock batches api

* fix create_file

* working batch file upload

* fix batches API for file upload

* test: bedrock files and batches API

* add BaseBatchesConfig

* fix get_provider_batches_config

* transform bedrock batches

* fix run create batch through llm http handler

* test_async_file_and_batch

* main.batches creation

* fix: CommonBatchFilesUtils

* fix async_create_batch

* test_async_file_and_batch

* BedrockBatchesConfig

* fix ruff check

* ruff check fix

* fix docs ref
 2025-09-03 17:19:58 -07:00
katsuhiro mutoandGitHub ca43514db4 [Feat] Support reasoning_effort in Groq (#14207) 
* Support reasoning_effort in groq

* add test
 2025-09-03 10:43:47 -07:00
mubashir1osmani d1c376f93e fix custom callback docs 2025-09-03 12:45:42 -04:00
mubashir1osmani ecc607257b fixed prometheus metrics 2025-09-03 02:14:59 -04:00
Krish DholakiaandGitHub 46655544a4 Merge pull request #14179 from zhirafovod/otel_logs_metrics 2025-09-02 19:50:40 -07:00
Ishaan Jaff 212ca20edf docs fix 2025-09-02 15:19:35 -07:00
Ishaan JaffandGitHub 128d9a3488 [Feature]: Add header support for spend_logs_metadata (#14186) 
* fix: allow settings spend_logs_metadata

* fix add_litellm_data_for_backend_llm_call

* fix: add add_litellm_metadata_from_request_headers

* fix add_litellm_metadata_from_request_headers

* test_add_litellm_metadata_from_request_headers

* add_litellm_metadata_from_request_headers

* docs Tracking Spend with custom metadata

* add_litellm_metadata_from_request_headers

* add_litellm_metadata_from_request_headers
 2025-09-02 15:13:15 -07:00
Ishaan JaffandGitHub c821f1ddf1 [Feature]: Support GPT-OSS models on vertex ai (#14184) 
* add VertexAIGPTOSSTransformation

* fix: optional_params

* fix: is_vertex_partner_model

* test_partner_models_httpx

* docs GPT oss docs

* test_vertex_ai_gpt_oss_reasoning_effort

* add vertex ai models
 2025-09-02 14:15:26 -07:00
Sameer KankuteandGitHub 4adfd18bc6 [Feat]Add support for safety_identifier parameter in chat.completions.create (#14174) 
* Add support for safety_identifier parameter in chat.completions.create

* make sure param is getting actually passed to the raw api
 2025-09-02 09:37:08 -07:00
Keith Decker 5dcdbb35da add metrics and logs (events) with semconv attributes 2025-09-02 09:20:25 -06:00
Ishaan Jaff e17bed715e DEFAULT_NUM_WORKERS_LITELLM_PROXY 2025-09-01 17:08:03 -07:00
Ishaan JaffandGitHub 2331fb45d5 [Bug]: Gemini 2.5 Pro – schema validation fails with OpenAI-style type arrays in tools (#14154) 
* fix: _convert_schema_types

* fix recursive detector

* test_convert_schema_types_type_array_conversion

* fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY
 2025-09-01 16:53:20 -07:00
Ishaan JaffandGitHub 98d57b5d27 [Feat] Allow using x-litellm-stream-timeout header for stream timeout in requests (#14147) 
* fix: allow passing stream_timeout header

* fix: _get_stream_timeout_from_request

* test_add_litellm_data_to_request_with_stream_timeout_header

* docs: LiteLLM Headers

* test_add_litellm_data_to_request_with_stream_timeout_header
 2025-09-01 15:59:14 -07:00
Ishaan JaffandGitHub 58b713d19d [Bug fix] Misclassified 500 error on invalid image_url in /chat/completions request (#14149) 
* add ImageFetchError

* docs ImageFetchError

* fix ImageFetchError

* test_completion_with_invalid_image_url
 2025-09-01 15:26:27 -07:00
Krrish Dholakia 0c9051abba docs(docker_quick_start.md): add docker compose to quick start 2025-08-31 21:24:30 -07:00
Ishaan JaffandGitHub ccb7ce03a3 [Docs] v1.76.1-stable (#14094) 
* docs 1.76.1

* fix docs

* docs 1.76.1

* New Model Support

* docs fixes
 2025-08-30 14:54:27 -07:00
Krish DholakiaandGitHub 8b11452d9e Merge branch 'main' into add-vercel-ai-gateway-provider 2025-08-29 22:27:08 -07:00
WilsonSunBrittenGitHubClaude
 		6d81d75948 docs: Add documentation for MAX_STRING_LENGTH_PROMPT_IN_DB environment variable (#14079) 
Added documentation for the new MAX_STRING_LENGTH_PROMPT_IN_DB environment variable to the config settings guide. This variable controls the maximum length of strings in spend logs when sanitizing request bodies, with a default value of 1000 characters.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-authored-by: Claude <noreply@anthropic.com>
 2025-08-29 17:38:50 -07:00
Mubashir OsmaniandGitHub 38df2500b6 docs: usaged-based routing perf warnings (#14080) 2025-08-29 17:31:12 -07:00
Carson GeeandGitHub e74f1b6b62 Added DataRobot provider to sidebar (#14074) 2025-08-29 13:15:33 -07:00
Teddy AmkieandGitHub 7f5c92ddeb Update docs for stream_timeout and timeout (#14073) 2025-08-29 09:59:07 -07:00
Krish DholakiaandGitHub bcd38dde2e Merge pull request #14036 from gotsysdba/main 
OCI Provider: add oci_key_file as an optional_parameter
 2025-08-29 06:27:09 -07:00
Krish DholakiaandGitHub 7513bec0e9 Merge pull request #14037 from NoWall57/feature/force-anthropic-custom-api-base-readme 
docs: add documentation for LITELLM_ANTHROPIC_DISABLE_URL_SUFFIX envi…
 2025-08-29 06:26:11 -07:00
Carson GeeandNate Goudreault f90072b226 Apply suggestions from code review 
Co-authored-by: Nate Goudreault <50588929+nate-goudreault@users.noreply.github.com>
 2025-08-28 23:00:09 -06:00
Carson Gee bf55bf5072 Update datarobot.md 2025-08-28 23:00:09 -06:00
mjnitz02andCarson Gee 5c73b17387 Add initial docs 2025-08-28 23:00:09 -06:00
Ishaan JaffandGitHub f3338bef9f [MCP] Bug fix - adding SSE MCP tools - fix connection test when adding MCPs (#14048) 
* fix: _execute_with_mcp_client

* add warning for SSE MCP

* docs - MCP videos / guides
 2025-08-28 15:16:34 -07:00
0x5751 323fe8aeac docs: add documentation for LITELLM_ANTHROPIC_DISABLE_URL_SUFFIX environment variable 
Added comprehensive documentation for the new LITELLM_ANTHROPIC_DISABLE_URL_SUFFIX configuration option that allows users to disable automatic URL suffix appending when using custom Anthropic API endpoints. This is useful for proxy servers or custom endpoints that don't follow Anthropic's standard URL structure.

Changes:
- Added environment variable to Anthropic provider docs with examples
- Created "Custom API Base" section explaining usage scenarios
- Added entry to environment variables reference table in config settings
 2025-08-28 22:21:41 +08:00
gotsysdba 87abfc3c11 Adding oci_key_file support for oci provider 2025-08-28 14:37:53 +01:00
TomuHirata 7333060fb0 feat(databricks): add anthropic citation support 2025-08-28 18:43:43 +09:00
李海峰 2d0a57a719 Add Volcengine embedding module with handler and transformation logic 
- Implemented VolcEngineEmbeddingHandler for synchronous and asynchronous embedding requests.
- Created VolcEngineEmbeddingConfig for transforming requests and responses to/from Volcengine format.
- Added integration tests for embedding functionality, covering various scenarios including error handling and parameter validation.
- Established test structure for Volcengine embedding, ensuring compliance with LiteLLM testing patterns.
- Included comprehensive tests for parameter mapping, request transformation, and response handling.
 2025-08-28 15:05:11 +08:00
Krish DholakiaandGitHub f01c7d13e7 Merge pull request #13991 from ikaadil/fix/gemini-imagen-model-name-validation 
[Bug Fix] Resolve invalid model name error for Gemini Imagen models
 2025-08-27 21:56:19 -07:00
Ishaan JaffGitHubCursor Agentishaan
 		d5774d89cc Update Docker image tag to v1.75.8-stable (#14014) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: ishaan <ishaan@berri.ai>
 2025-08-27 16:44:50 -07:00
Ishaan JaffandGitHub 04dc1a5351 [Feat] Add support for returning images with gemini/gemini-2.5-flash-image-preview with /chat/completions (#13983) 
* add gemini-2.5-flash-image-preview

* add gemini-2.5-flash-image-preview

* add image in ChatCompletionResponseMessage

* test_gemini_image_generation_async

* Revert "Merge pull request #13394 from Deviad/feature/enhance_logging_for_containers"

This reverts commit 539b94ad4e, reversing
changes made to 71af7bcf9c.

* include `image` in Delta

* fix _process_candidates should show the image response

* fix: _handle_special_delta_attributes

* test_gemini_image_generation_async_stream

* image_generation_chat

* UI - allow looking at generated images from /chat/completions

* _create_streaming_choice

* fix import StreamingChoices

* fix ChatCompletionResponseMessage

* test_gemini_image_generation

* add gemini img migration

* fix _extract_candidate_metadata

* ui fix

* fix batch endpoint test
 2025-08-27 16:16:19 -07:00
Ishaan JaffandGitHub 165242e31f [Feat] langfuse_otel logger - allow using LANGFUSE_OTEL_HOST for configuring host (#14013) 
* feat - add _get_langfuse_otel_host

* test_get_langfuse_otel_config_with_otel_host_priority

* docs: LANGFUSE_OTEL_HOST
 2025-08-27 14:43:47 -07:00
Ifta Khairul Alam Adil 75aeca14b2 Merge branch 'main' into fix/gemini-imagen-model-name-validation 2025-08-27 21:52:47 +02:00
Ishaan Jaff 76f78f7b2a fix: LITELLM_LOG_FILE test 2025-08-27 08:25:24 -07:00
Ifta Khairul Alam Adil 8808f78ba6 Merge branch 'main' into fix/gemini-imagen-model-name-validation 2025-08-27 15:45:59 +02:00
Krish DholakiaandGitHub ddec6c69c8 Merge pull request #13534 from cometapi-dev/main 
docs: Add CometAPI documentation with authentication, usage examples, and error handling
 2025-08-26 23:17:04 -07:00
Krish DholakiaandGitHub 45f465d84f Merge pull request #13572 from Noma-Security/noma-security-guardrails-support 
Add Noma Security guardrail support
 2025-08-26 23:15:17 -07:00