Commit Graph

112 Commits

Author SHA1 Message Date
Krish Dholakia 74ba18df55 Litellm chainguard fixes 12 02 2025 p1 (#17406)
* build: update dockerfile non root

* build: update build

* build: update non root

* build: dockerfile fixes

* build: ensure dockerfile + dockerfile.database also work
2025-12-02 22:50:13 -08:00
Dmitriy Alergant 90850bf6d5 fix: add nodejs and npm to runtime dependencies for prisma generate (#16903)
Fixes cross-platform Docker build issue where `prisma generate` fails
when building for amd64 platform from macOS. The Prisma CLI requires
Node.js and npm to be available in the runtime environment.

The Python prisma package (v0.11.0) uses nodeenv to bootstrap Node.js
if not found. However, the downloaded npm v10 fails with a
"sizeCalculation" error in minimal Chainguard environments during
cross-platform builds. Providing system nodejs/npm resolves this.

Changes:
- Added nodejs and npm to runtime dependencies (Dockerfile:51)
- This enables prisma generate to run successfully during the build

Error without fix:
npm error cannot set sizeCalculation without setting maxSize or maxEntrySize
subprocess.CalledProcessError: Command '[...nodeenv/bin/npm', 'install',
'prisma@5.4.2']' returned non-zero exit status 1.

Testing:
docker buildx build --platform linux/amd64 -t litellm:test .

Co-authored-by: Claude <noreply@anthropic.com>
2025-11-22 19:27:06 -08:00
Ishaan Jaff 9288c8543c fix docker (#16342) 2025-11-07 14:38:20 -08:00
Ishaan Jaffer 03e73c9b7c fix security 2025-09-26 19:31:56 -07:00
Ishaan Jaffer f5d04c15e6 security fix 2025-09-26 19:21:06 -07:00
Mritunjay Kumar Sharma 8b0e3c14ff chore(docker): remove redundant Admin UI build step
The Admin UI is already built before packaging, so the second invocation of docker/build_admin_ui.sh after PyJWT adjustments was unnecessary. Removing it speeds up the builder stage, reduces cache invalidation, and doesn’t change the resulting wheel or runtime image.
2025-09-18 11:09:20 -05:00
Ishaan Jaff a328ad56e3 [Bug Fix] Fixes for using Auto Router with LiteLLM Docker Image (#13788)
* fix install auto router.sh

* fixes for Docker IMG
2025-08-19 18:36:30 -07:00
Ishaan Jaff 106a298f0a [Feat] UI - Allow Adding LiteLLM Auto Router on UI (#12960)
* add router.json

* test_router_auto_router

* async_pre_routing_hook

* fixes for auto router

* add async_pre_routing_hook

* add LiteLLMRouterEncoder

* update test auto_router_embedding_model

* add auto_router_embedding_model

* add AutoRouter

* fix async_pre_routing_hook

* update async_pre_routing_hook

* fix auto router

* fix router.json

* working router init

* working embedding encoder

* working auto router

* test_router_auto_router

* test auto router

* add semantic-router as optional for litellm

* add extras

* semantic_router==0.1.10

* ruff fix

* use aiohttp==3.10.11

* python-dotenv==1.0.1

* test auto router

* test_router_auto_router

* semantic_router

* test_is_auto_router_deployment

* fix check

* fix docker build step

* add semantic_router

* UI  - Add auto router on litellm

* working utterances config

* fix route config builder

* kind of working add automodel router

* move loc of add deployment

* fixes for AutoRouter

* add auto_router_config in types.py

* fixes for init_auto_router_deployment

* fix adding auto router models

* working auto-router with dB

* Revert "add semantic_router"

This reverts commit 537b67288798731a119d811f643b682086377ee9.

* TestAutoRouter

* fix linting

* add semantic router to docker

* test fix

* fix router config builder

* remove export button
2025-07-24 19:58:49 -07:00
Jugal D. Bhatt a112ec5b02 Health check app on separate port (#12718)
* add separate health app

* add new docs

* refactor

* fix colons

* Update config_settings.md

* refactor

* docs

* add unit test

* added supervisord

* remove app

* add supervisor conf

* Add markdown

* add video to md

* remove test

* docs build failure

* add to all docker files, change prod.md and add tests

* change dockerfiles

* remove extra file

* remove extra file

* remove extra file

* change apt->apk

* remove rdb file

* add fixed file
2025-07-18 11:17:15 -07:00
Krish Dholakia 64f325b92e adds tzdata (#10796) (#11052)
With tzdata installed, the environment variable `TZ` will be respected by Python's datetime module. This means that users can specify the timezone they want LiteLLM to use.

Co-authored-by: Simon Stone <sipreuss@gmail.com>
2025-05-22 22:36:19 -07:00
Peter Dave Hello 6b67006b0c Remove redundant apk update in Dockerfiles (cc #5016) (#9055)
The `apk` commands can utilize the `--no-cache` option, making the
`update` step superfluous and ensuring the latest packages are used
without maintaining a local cache. An additional `apk update` in the
Dockerfile will just make the image larger with no benefits.
2025-04-08 09:03:25 -07:00
Tyler Hutcherson 7864cd1f76 update redisvl dependency 2025-03-24 08:42:11 -04:00
Ishaan Jaff 60c89a3e8a (Fix) security of base image (#7620)
* fix security of base images

* fix dockerfile
2025-01-07 20:35:57 -08:00
Ishaan Jaff 6125ba1e2b (Feat) - allow including dd-trace in litellm base image (#7587)
* introduce USE_DDTRACE=true

* update dd tracer

* update

* bump dd trace

* use og slim image

* DD tracing

* fix _init_dd_tracer
2025-01-06 17:27:09 -08:00
Krish Dholakia e332e93786 Litellm security fixes (#7282)
* build(Dockerfile): bump node version

* build(Dockerfile): bump python version

fix critical errors

* build(requirements.txt): fix snyk errors
2024-12-18 09:38:52 -08:00
Ishaan Jaff d1760b1b04 (fix) clean up root repo - move entrypoint.sh and build_admin_ui to /docker (#6110)
* fix move docker files to docker folders

* move check file length

* fix docker hub deploy

* fix clean up root

* fix circle ci config
2024-10-08 11:34:43 +05:30
Ishaan Jaff 5de69cb1b2 fix using Dockerfile 2024-10-08 08:45:40 +05:30
Ishaan Jaff d742e8cb43 (clean up) move docker files from root to docker folder (#6109)
* fix move docker files to docker folders

* move check file length

* fix docker hub deploy
2024-10-08 08:23:52 +05:30
Jacob Hagstedt P Suorra 9ec3365ba6 Upgrade dependencies in dockerfile (#5862)
* Upgrade dependencies in dockerfile

* Change apt-get to apk for alpine image

* Set requirements file to same as dockerfile

---------

Co-authored-by: Jacob Hagstedt <wcgs@novonordisk.com>
2024-09-27 07:51:20 -07:00
Ishaan Jaff 4f9f505ebe docker - handle debian issue on docker builds (#5752) 2024-09-23 17:58:22 -07:00
superpoussin22 acfb060bf1 Correct casing (#5817)
* Update Dockerfile

correct casing

* Update Dockerfile.database

correct casing

* Update Dockerfile.alpine

correct casing

* Update Dockerfile.non_root

correct casing
2024-09-21 08:21:11 -07:00
Ishaan Jaff 143bbe32cb fix dockerfile 2024-08-20 15:38:11 -07:00
Ishaan Jaff fef6f50e23 fic docker file to run in non root model 2024-08-13 19:29:40 -07:00
Krrish Dholakia 3c6bc031de build(dockerfile): remove --config proxy_server_config.yaml from docker run
prevents startup errors with dockerfile
2024-04-08 13:23:56 -07:00
Ishaan Jaff 19a1d999ec (feat) update docs to not include gunicorn usage 2024-03-23 17:40:22 -07:00
Ishaan Jaff ff57887b70 (feat) bump to python 3.11 2024-03-22 14:44:41 -07:00
Krrish Dholakia 8c91156842 build: build fixes 2024-03-19 16:59:59 -07:00
Krish Dholakia 88152c77c5 Update Dockerfile 2024-03-15 21:47:13 -07:00
ishaan-jaff dd6138ecbf (fix) run prisma generate in default dockerfile 2024-03-14 09:10:56 -07:00
ishaan-jaff 60f34066a5 (fix) default dockerfile use num_workers = 1 2024-03-13 15:23:53 -07:00
ishaan-jaff c50b0e315a (feat) don't use --detailed_debug on all default litellm images 2024-03-06 16:31:32 -08:00
ishaan-jaff 9ba2fa44aa (fix) admin ui allow custom ui theme 2024-02-21 21:28:58 -08:00
ishaan-jaff d07846646c (ui) fix build command 2024-02-21 21:02:46 -08:00
ishaan-jaff c69eaebfd8 (fix) dockerfile for semantic caching 2024-02-06 19:23:27 -08:00
Krrish Dholakia 8e9197b5b4 build(proxy_cli.py): make running gunicorn an optional cli arg
when running proxy locally, running with uvicorn is much better for debugging
2024-01-29 15:32:34 -08:00
ishaan-jaff 308351458b Revert "Merge branch 'main' into main"
This reverts commit a92461caa5, reversing
changes made to 9dd857e0a6.
2024-01-27 16:47:10 -08:00
Ishaan Jaff 6b0024a7d3 Update Dockerfile 2024-01-27 15:01:02 -08:00
Ishaan Jaff 7f2e4036d6 Update Dockerfile 2024-01-27 14:59:36 -08:00
Ishaan Jaff 18906e6aff Update Dockerfile 2024-01-27 14:57:41 -08:00
Ishaan Jaff 4a98104af3 Update Dockerfile 2024-01-27 14:43:50 -08:00
Ishaan Jaff ad6607b530 Update Dockerfile 2024-01-27 14:37:38 -08:00
Ishaan Jaff 8d3e818fb1 Update Dockerfile 2024-01-27 14:36:30 -08:00
Krrish Dholakia e2831e9c80 fix: fix proxy logging 2024-01-20 18:22:45 -08:00
Krrish Dholakia 6b8e6497f6 build(Dockerfile): set dockerfile to always use config 2024-01-20 17:46:52 -08:00
Krrish Dholakia 09b7235b31 fix: support info level logging on pkg + proxy 2024-01-20 17:45:47 -08:00
ishaan-jaff 0d56115336 (fix) Dockerfile use same entrypoint as Dockerfile.database 2024-01-10 21:56:34 +05:30
ishaan-jaff 95efde1cb6 (fix) main Dockerfile 2024-01-10 16:27:15 +05:30
ishaan-jaff b4d85cbecc (fix) dockerfile - use litellm as entrypoint 2024-01-10 15:44:21 +05:30
ishaan-jaff a7e25912b8 (docker) conditional use ./entrypoint.sh 2024-01-09 14:50:05 +05:30
ishaan-jaff 872a36b7e5 (fix) minimize dockerfile changes 2024-01-09 14:32:09 +05:30