Commit Graph

4209 Commits

Author SHA1 Message Date
Zhengyi Lai 8a77fb4da1 Update docker_quick_start.md (#14322) 2025-09-08 12:58:13 -07:00
Krish Dholakia ba10173ec7 Merge branch 'main' into heroku-llms 2025-09-06 22:10:20 -07:00
Krish Dholakia d2f02a55b9 Merge pull request #14308 from mubashir1osmani/main
docs: moved custom spend tags
2025-09-06 21:58:20 -07:00
mubashir1osmani b9be68cc45 spend tracking details 2025-09-06 22:24:49 -04:00
mubashir1osmani 2095fe3c98 moved custom spend tags 2025-09-06 22:14:52 -04:00
mubashir1osmani 976967f1e0 Revert "docs: moved custom spend tags metadata to spend tracking"
This reverts commit d1eb87a1e6.
2025-09-06 22:12:16 -04:00
mubashir1osmani d1eb87a1e6 docs: moved custom spend tags metadata to spend tracking 2025-09-06 22:09:03 -04:00
mubashir1osmani 2674c49283 added spend tags 2025-09-06 21:59:45 -04:00
Krish Dholakia a3ffc3060e Merge branch 'main' into litellm_dev_09_01_2025_p1 2025-09-06 18:50:49 -07:00
Krish Dholakia b8fdbd479b Merge pull request #13931 from BerriAI/litellm_release_notes_08_23_2025
docs(index.md): initial commit with release notes
2025-09-06 18:48:44 -07:00
Krish Dholakia f7810eec79 Merge pull request #14299 from TeddyAmkie/docs-update-clean
Doc Updates 9-5-25
2025-09-06 18:47:18 -07:00
Krrish Dholakia 05dfad8837 docs: add basic setup to ui contribution doc 2025-09-06 18:03:17 -07:00
Ishaan Jaff 71ce338b24 docs fix 2025-09-06 16:07:02 -07:00
Ishaan Jaff 0754ad9e02 docs fix 2025-09-06 16:01:03 -07:00
Ishaan Jaff 6533ce45a5 docs fix 2025-09-06 16:00:46 -07:00
Ishaan Jaff 0d5bc894f2 fixes 2025-09-06 15:59:35 -07:00
Ishaan Jaff 2d5868b18d 1.76.3 2025-09-06 15:49:10 -07:00
berri-teddy 3268f1cac6 fix: correct tabs in load_balancing.md 2025-09-06 15:20:40 -07:00
Ishaan Jaff 66860efd5d docs config settings 2025-09-06 14:24:18 -07:00
Ishaan Jaff 8920a645e9 Revert "feat: add redis ssl and username support (#11319)" (#14303)
This reverts commit 31f806f7d0.
2025-09-06 14:01:00 -07:00
Krrish Dholakia 7a083750ce refactor: remove 'input_fidelity' from image gen -> it's a image_edit param 2025-09-06 12:14:27 -07:00
Krish Dholakia 943f6a38ed Merge pull request #14300 from eycjur/gpt-oss-reasoning-effort-mapping
Bug fix for openai.gpt-oss when using reasoning_effort parameter
2025-09-06 09:13:03 -07:00
Ishaan Jaff 29e410b04c docs Video Walkthrough claude code 2025-09-06 09:12:30 -07:00
Mubashir Osmani cb117647fc [docs]: added loom for claude code (#14223)
* added loom for claude code

* docs: add web search models

* added new loom
2025-09-06 09:09:22 -07:00
eycjur b472bf6aef update docs 2025-09-06 21:15:59 +09:00
Teddy Amkie 28545966f5 docs: update access control and load balancing documentation 2025-09-05 22:17:06 -07:00
Teddy Amkie 72b8db6484 docs: update admin UI branding section and add admin settings UI images 2025-09-05 22:15:25 -07:00
Teddy Amkie 3d7ee67aaa docs: clarify and improve logo customization section in admin UI docs (side-by-side images, explanation) 2025-09-05 22:15:25 -07:00
Teddy Amkie e73c558533 docs: clarify users can be on many teams 2025-09-05 22:15:25 -07:00
Ishaan Jaff 5310bba35b [Feat] Litellm x CloudZero Integration - Cost Tracking (#14296)
* fix: just pull LiteLLM_DailyUserSpend

* get the team_id from user daily spend table

* cloudzero_dry_run_export

* fix CZ endpoints

* trace entity_id

* fix: get_usage_data

* fix get_usage_data

* fix _create_cbf_record

* fix get_usage_data

* ensure start and end time is used for exporting data

* fix init_cloudzero_background_job

* fix CloudZeroExportRequest

* fix initialize_cloudzero_export_job

* fix initialize_cloudzero_export_job

* allow init with env + config.yaml for cloudzero

* fix: init CZ through config.yaml

* fix DRY run on CZ

* TestCloudZeroDryRunEndpoint

* fix: CLOUDZERO_EXPORT_INTERVAL_MINUTES

* fix init_cloudzero_background_job

* fix exporting data

* fix transform

* stash cloudzero docs

* docs: CloudZero

* ruff fix

* fix rendering key alias

* fix polars
2025-09-05 21:29:41 -07:00
Pierre-Emmanuel MERCIER 31f806f7d0 feat: add redis ssl and username support (#11319) 2025-09-05 10:35:11 -07:00
Ishaan Jaff 982800069c [Bug Fix] x-litellm-tags not routing with Responses API (#14289)
* fix: get_deployments_for_tag

* fix get_deployments_for_tag

* test_router_tag_routing.py

* test_get_metadata_variable_name_from_kwargs

* fix mapped tests

* docs fix
2025-09-05 09:40:37 -07:00
Krish Dholakia f67339a86c Merge pull request #14028 from onlylhf/volcengine-embedding-support
Add Volcengine embedding module with handler and transformation logic
2025-09-04 21:01:25 -07:00
Krish Dholakia 5d5c19a302 Merge pull request #14077 from TomeHirata/codex/add-support-for-anthropic-citation-api
Add support for anthropic citation api in Databricks
2025-09-04 20:46:11 -07:00
Krish Dholakia cb8e3936ae Merge pull request #14216 from mubashir1osmani/fix_all_docs
Fix custom callbacks doc
2025-09-04 07:35:38 -07:00
Krish Dholakia 8738f630ac Merge pull request #14232 from mubashir1osmani/litellm_docs
[docs]: added more info to load balancing & pass through endpoints
2025-09-04 07:31:54 -07:00
Ishaan Jaff 8878951f16 docs fix: disable_add_user_agent_to_request_tags 2025-09-04 07:30:18 -07:00
mubashir1osmani b0450d2ddf docs: added more info to load balancing & passthrough endpoints 2025-09-03 23:58:48 -04:00
Ishaan Jaff 23ae7170d1 [Feat] Allow using Veo Video Generation through LiteLLM Pass through routes (#14228)
* fix: add follow_redirects=True,

* test_pass_through_with_httpbin_redirect

* cook book veo video

* docs Veo Video Generation with Google AI Studio

* add veo-3.0-generate-preview cost tracking details

* track vertex_video_models
2025-09-03 18:25:43 -07:00
Ishaan Jaff 19e2bab8c8 [Feat] Add Initial support for Bedrock Batches API (#14190)
* fix acreate_file with bedrock

* fix routing to bedrock batches api

* fix create_file

* working batch file upload

* fix batches API for file upload

* test: bedrock files and batches API

* add BaseBatchesConfig

* fix get_provider_batches_config

* transform bedrock batches

* fix run create batch through llm http handler

* test_async_file_and_batch

* main.batches creation

* fix: CommonBatchFilesUtils

* fix async_create_batch

* test_async_file_and_batch

* BedrockBatchesConfig

* fix ruff check

* ruff check fix

* fix docs ref
2025-09-03 17:19:58 -07:00
katsuhiro muto ca43514db4 [Feat] Support reasoning_effort in Groq (#14207)
* Support reasoning_effort in groq

* add test
2025-09-03 10:43:47 -07:00
mubashir1osmani d1c376f93e fix custom callback docs 2025-09-03 12:45:42 -04:00
mubashir1osmani ecc607257b fixed prometheus metrics 2025-09-03 02:14:59 -04:00
Krish Dholakia 46655544a4 Merge pull request #14179 from zhirafovod/otel_logs_metrics 2025-09-02 19:50:40 -07:00
Ishaan Jaff 212ca20edf docs fix 2025-09-02 15:19:35 -07:00
Ishaan Jaff 128d9a3488 [Feature]: Add header support for spend_logs_metadata (#14186)
* fix: allow settings spend_logs_metadata

* fix add_litellm_data_for_backend_llm_call

* fix: add add_litellm_metadata_from_request_headers

* fix add_litellm_metadata_from_request_headers

* test_add_litellm_metadata_from_request_headers

* add_litellm_metadata_from_request_headers

* docs Tracking Spend with custom metadata

* add_litellm_metadata_from_request_headers

* add_litellm_metadata_from_request_headers
2025-09-02 15:13:15 -07:00
Ishaan Jaff c821f1ddf1 [Feature]: Support GPT-OSS models on vertex ai (#14184)
* add VertexAIGPTOSSTransformation

* fix: optional_params

* fix: is_vertex_partner_model

* test_partner_models_httpx

* docs GPT oss docs

* test_vertex_ai_gpt_oss_reasoning_effort

* add vertex ai models
2025-09-02 14:15:26 -07:00
Sameer Kankute 4adfd18bc6 [Feat]Add support for safety_identifier parameter in chat.completions.create (#14174)
* Add support for safety_identifier parameter in chat.completions.create

* make sure param is getting actually passed to the raw api
2025-09-02 09:37:08 -07:00
Keith Decker 5dcdbb35da add metrics and logs (events) with semconv attributes 2025-09-02 09:20:25 -06:00
Krrish Dholakia d4cc748b40 feat(openrouter.py): add image generation via google on openrouter support
Closes https://github.com/BerriAI/litellm/pull/14151
2025-09-01 18:39:41 -07:00