Commit Graph

123 Commits

Author SHA1 Message Date
CHANGE 87d7e86479 feat(helm): add tpl support to extraContainers and extraInitContainers
Wrap toYaml with tpl in deployment and migration job templates so
users can reference Helm values (e.g. {{ .Values.image.repository }})
inside extraContainers and extraInitContainers definitions.
2026-04-10 09:41:33 -04:00
Yuneng Jiang 5f63873dca [Infra] Pin all Docker build dependencies to exact versions
Pin every dependency across all Docker builds so upgrades are intentional.
Verified by building all 3 production images and diffing pip freeze against
known-good v1.83.0-nightly baselines — zero version drift.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-01 00:05:39 -07:00
Chesars 1be6b31e2f merge: resolve conflicts between main and litellm_oss_staging_03_11_2026 2026-03-12 09:38:31 -03:00
RJ Duffner 0c95d415e1 Add Abilty To Set minReadySeconds From values Files (#23173)
* Add Abilty To Set minReadySeconds From values Files

* typo

* uppercase Min as it comes after deployment

* Don't use defaults, just omit
2026-03-11 23:29:15 +05:30
Harshit28j 3127d79da8 feat: add strategy to deployment for helmchart 2026-03-10 05:49:46 +05:30
Sean Marsh Glover 4652c73259 feat(proxy): limit concurrent health checks with health_check_concurrency (#20584)
* staged first pass

* black

* Update litellm/proxy/health_check.py

Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>

* simpler

* restore cached logo

* fix tests for perform_health_check max_concurrency arg

* implement pr suggestion

* and the helm chart

* add configureable resources and probes to the deployment in the helm chart

* more helm chart unittests

* move some background healthcheck loggin to debug

---------

Co-authored-by: Sean Glover <sglover@athenahealth.com>
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2026-02-24 08:16:59 -08:00
Cesar Garcia 622983cf89 fix(helm): add OCI annotations so GHCR shows helm pull instead of docker pull (#20617)
The Helm chart on GHCR displays a `docker pull` command instead of
the correct `helm pull oci://` command. This is because the OCI artifact
is missing the `org.opencontainers.image.source` annotation that GHCR
uses to identify and properly display Helm charts.

Changes:
- Add OCI annotations to Chart.yaml (source + url) which Helm 3.10+
  propagates to the OCI manifest on push
- Install explicit Helm v3.20.0 via azure/setup-helm@v4 for reproducible
  builds and proper OCI annotation support
- Remove deprecated HELM_EXPERIMENTAL_OCI env var (OCI is GA since Helm 3.8)
2026-02-12 19:58:16 +05:30
Pragya Sardana b4a27712a1 Add Init Containers in the community helm chart (#19816) 2026-01-27 18:10:47 -08:00
Harshit Jain 9084c1d1bd feat(helm): Enable PreStop hook configuration in values.yaml (#19613) 2026-01-22 19:28:52 -08:00
R.Sicart 608979c7e9 feat: add support for keda in helm chart (#19337)
* feat: add support for keda in helm chart

Signed-off-by: R.Sicart <roger.sicart@gmail.com>

* chore: bump chart version

---------

Signed-off-by: R.Sicart <roger.sicart@gmail.com>
2026-01-19 10:38:41 -08:00
Harshit Jain 3ad8fa5422 fix: mount config.yaml as single file in Helm chart (#19146) 2026-01-15 21:21:13 +05:30
Cesar Garcia 46dd420833 fix: sync Helm chart versioning with production standards and Docker versions (#18868)
* fix: sync Helm chart versioning with production standards and Docker versions

- Update Chart.yaml version from 0.4.10 to 1.0.0 (SemVer 0.x is for development, 1.0+ for production)
- Update appVersion from v1.50.2 to v1.80.12 to match current Docker image version
- Update workflow defaults from 0.1.0 to 1.0.0 for new chart version scheme
- Maintain independent chart versioning per Helm best practices

This ensures:
- Helm chart follows SemVer production standards (1.x instead of 0.x)
- appVersion stays synchronized with Docker/application version
- Chart version remains independent for flexibility (can update chart without waiting for app releases)

* fix: sync Helm chart appVersion with Docker image tags in release workflow

Updates the GitHub workflow to ensure Helm chart appVersion matches the
Docker image tags that are actually published:

- For stable/rc releases: Uses the workflow input tag (e.g., v1.80.12)
- For latest/dev releases: Uses the release_type to match main-{type} tags
- Makes 'tag' input required to prevent accidental releases with wrong versions
- Simplifies fallback logic by removing git-describe dependency

This ensures the chart's appVersion correctly references Docker images
that exist, preventing deployment failures from missing image tags.

* Update ghcr_deploy.yml
2026-01-12 17:04:59 +05:30
Alexsander Hamir 1544e8f971 feat: Add line_profiler support for performance analysis and fix Windows CRLF issues in Docker builds (#18773) 2026-01-07 11:36:57 -08:00
Mehmet Can Şakiroğlu a3503e59c2 Litellm feat helm lifecycle support (#18517)
* feat(helm): add lifecycle hook support for helm

* add tests
2026-01-04 00:22:50 +05:30
Krrish Dholakia 7c2478b70e docs: replace ghcr link with docker.litellm.ai 2025-12-16 08:35:45 +05:30
expruc 2d112fc8b2 add option to include additional resources to chart (#17627) 2025-12-07 23:25:57 -08:00
Lukas de Boer 3b8a6ec888 Helm Chart: Add possibility to override command, args and add deployment labels (#17535)
* Helm Chart: Add possibility to override command, args and also add deployment labels

* Helm Chart: Fix helm lint issue

* Helm Chart: Fix helm unit tests
2025-12-06 14:01:09 -08:00
Fabian Reinold c173a4a275 Helm Chart: add ingress-only labels (#17348)
* feat(helm): add ingress-only labels

* feat(helm): add ingress configuration tests

* chore(helm): bump chart version
2025-12-02 22:30:54 -08:00
Saar wintrov 777ef628d2 Enhancement(helm): ServiceMonitor template rendering (#17038)
* Metadata: fix 401 when audio/transcriptions

* check if str, CR fixes

* Added new helmchart functionality

* .

* .

* adding new tests
2025-11-24 20:53:02 -08:00
tushar8408 5f94b372f8 Migration job labels (#16831)
* Add dynamic pod labels and annotations to migrations job

* Bump chart version to 0.4.8
2025-11-19 09:53:21 -08:00
YutaSaito 645f84c02e fix: add imagePullSecrets to migrations-job (#15681) 2025-10-18 13:56:31 -07:00
Krish Dholakia cf3c18a420 Merge pull request #13855 from edify42/allow-no-db-url
feat(helm): Allow no DATABASE_URL to be set on migration job to keep the behaviour same as deployment
2025-09-06 22:02:01 -07:00
Abhinav b6c26c3365 helm(chart): add optional PodDisruptionBudget for litellm proxy (#14062) (#14093) 2025-09-01 12:21:44 -07:00
Const-antine f8d1e03450 rework tests 2025-08-28 13:39:09 -04:00
Const-antine 1350336515 fix tests 2025-08-28 13:30:11 -04:00
Const-antine d3b526041f better formatting 2025-08-28 13:18:36 -04:00
Const-antine 730e9c90a2 fix formatting 2025-08-28 13:18:33 -04:00
Const-antine 5d973ea06e update readme 2025-08-28 13:18:26 -04:00
Const-antine 409429ddd6 add new tests 2025-08-28 13:18:23 -04:00
Const-antine ff4040bbe1 add functionality to mount existing configmap if needed 2025-08-28 13:18:05 -04:00
Jugal D. Bhatt d63f5f99e9 Enhance database configuration: add support for optional endpointKey in values.yaml and update deployment/migrations job templates to conditionally source DATABASE_HOST from the secret if endpointKey is set. (#13763) 2025-08-21 14:58:50 -07:00
Ishaan Jaff f498cf4901 Fix - Ensure Helm chart auto generated master keys follow sk-xxxx format (#13871)
* docs - master key

* fix - auto generate sk-xxx prefixed key

* test master key fix

* fix master key gen
2025-08-21 14:34:21 -07:00
Ed Kim c88a13c58b add unit test which confirms the removal of DATABASE_URL
Signed-off-by: Ed Kim <edward.kim@lendi.com.au>
2025-08-21 21:08:18 +10:00
edward kim 418b70b38e fixes
Signed-off-by: edward kim <edward.kim@lendi.com.au>
2025-08-21 17:44:54 +10:00
edward kim 2bd3daa742 fixes the mounting of this only when deployStandalone is true
Signed-off-by: edward kim <edward.kim@lendi.com.au>
2025-08-21 17:39:31 +10:00
Mattias Andersson 89f71af4cd Add possibility to configure resources for migrations-job in Helm chart 2025-08-14 17:08:26 +02:00
unique-jakub f58807ff6e Add labels to migrations job template (#13343)
* set labels on the migration job

* update comment to retrigger the pipeline
2025-08-07 09:41:24 -07:00
Jugal D. Bhatt 7cf3b4682a [Separate Health App] Update Helm Deployment.yaml (#13162)
* add helm deployment fix

* clean deployment
2025-08-01 16:50:23 -07:00
unique-jakub 3edb71e617 allow helm hooks for migrations job (#13174) 2025-07-31 21:51:07 -07:00
Marvin Huetter d23a6e3ea4 fix: best practices suggest this to set to true (#12809)
The order of the specification is important here, k8s will take the last value as truth. Push down to be sure schema update is done by migration job
2025-07-29 15:40:12 -07:00
Anton f05ec34e11 feat: Add envVars and extraEnvVars support to Helm migrations job (#12591)
- Add support for envVars (simple key-value pairs) in migrations job
- Add support for extraEnvVars (complex environment variable configurations)
- Include comprehensive test coverage for both envVars and extraEnvVars
- Ensure backward compatibility with existing configurations
- Tests verify proper rendering of environment variables in container spec
2025-07-14 22:24:13 -07:00
Victor Krylov 1d58fc5429 Add deployment annotations (#11849)
* Add deployment annotations

* Correct the indent and simplify if 0 annotations
2025-06-19 20:11:31 -07:00
Steven Aldinger b8bdf98a4b feat(helm): [BerriAI/litellm#11648] support extraContainers in migrations-job.yaml (#11649) 2025-06-11 23:16:06 -07:00
Gunjan Solanki f1cc2d544e feat(helm): Add loadBalancerClass support for LoadBalancer services (#11064)
* feat(helm): Add loadBalancerClass support for LoadBalancer services

Adds the ability to specify a loadBalancerClass when using LoadBalancer service type.
This enables integration with custom load balancer implementations like Tailscale.

* fixup! feat(helm): Add loadBalancerClass support for LoadBalancer services
2025-05-22 22:45:14 -07:00
Ishaan Jaff f3291bde4d fix for serviceAccountName on migration job (#10258) 2025-04-23 20:56:31 -07:00
Manuel Cañete c4ea1ab61b feat: add extraEnvVars to the helm deployment (#9292) 2025-04-11 10:32:16 -07:00
Marcus Hynfield cc7d59a11e Add service annotations to litellm-helm chart (#9840) 2025-04-08 21:42:09 -07:00
Krish Dholakia 1604f87663 install prisma migration files - connects litellm proxy to litellm's prisma migration files (#9637)
* build(README.md): initial commit adding a separate folder for additional proxy files. Meant to reduce size of core package

* build(litellm-proxy-extras/): new pip package for storing migration files

allows litellm proxy to use migration files, without adding them to core repo

* build(litellm-proxy-extras/): cleanup pyproject.toml

* build: move prisma migration files inside new proxy extras package

* build(run_migration.py): update script to write to correct folder

* build(proxy_cli.py): load in migration files from litellm-proxy-extras

Closes https://github.com/BerriAI/litellm/issues/9558

* build: add MIT license to litellm-proxy-extras

* test: update test

* fix: fix schema

* bump: version 0.1.0 → 0.1.1

* build(publish-proxy-extras.sh): add script for publishing new proxy-extras version

* build(liccheck.ini): add litellm-proxy-extras to authorized packages

* fix(litellm-proxy-extras/utils.py): move prisma migrate logic inside extra proxy pkg

easier since migrations folder already there

* build(pre-commit-config.yaml): add litellm_proxy_extras to ci tests

* docs(config_settings.md): document new env var

* build(pyproject.toml): bump relevant files when litellm-proxy-extras version changed

* build(pre-commit-config.yaml): run poetry check on litellm-proxy-extras as well
2025-03-29 15:27:09 -07:00
Krrish Dholakia 95e5dfae5a build(ci_cd/): add migration script 2025-03-29 08:48:48 -07:00
Dbzman 7c85054bad fix: wrong indentation for ttlSecondsAfterFinished (#9611) 2025-03-28 13:20:12 -07:00