tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-09 14:22:12 +00:00
Code Issues Packages Projects Releases Wiki Activity

Fix - Ensure Helm chart auto generated master keys follow sk-xxxx format (#13871)

Browse Source 
* docs - master key

* fix - auto generate sk-xxx prefixed key

* test master key fix

* fix master key gen
This commit is contained in:
Ishaan Jaff
2025-08-21 14:34:21 -07:00
committed by GitHub
parent 0e6e8af1c3
commit f498cf4901
4 changed files with 10 additions and 34 deletions
Download Patch File Download Diff File Expand all files Collapse all files
deploy/charts/litellm-helm/README.md
+2 -2
View File
@@ -24,7 +24,7 @@ If `db.useStackgresOperator` is used (not yet implemented):
| `replicaCount` | The number of LiteLLM Proxy pods to be deployed | `1` |
| `masterkeySecretName` | The name of the Kubernetes Secret that contains the Master API Key for LiteLLM. If not specified, use the generated secret name. | N/A |
| `masterkeySecretKey` | The key within the Kubernetes Secret that contains the Master API Key for LiteLLM. If not specified, use `masterkey` as the key. | N/A |
| `masterkey` | The Master API Key for LiteLLM. If not specified, a random key is generated. | N/A |
| `masterkey` | The Master API Key for LiteLLM. If not specified, a random key in the `sk-...` format is generated. | N/A |
| `environmentSecrets` | An optional array of Secret object names. The keys and values in these secrets will be presented to the LiteLLM proxy pod as environment variables. See below for an example Secret object. | `[]` |
| `environmentConfigMaps` | An optional array of ConfigMap object names. The keys and values in these configmaps will be presented to the LiteLLM proxy pod as environment variables. See below for an example Secret object. | `[]` |
| `image.repository` | LiteLLM Proxy image repository | `ghcr.io/berriai/litellm` |
@@ -135,7 +135,7 @@ service, the **Proxy Endpoint** should be set to `http://<RELEASE>-litellm:4000`
The **Proxy Key** is the value specified for `masterkey` or, if a `masterkey`
was not provided to the helm command line, the `masterkey` is a randomly
generated string stored in the `<RELEASE>-litellm-masterkey` Kubernetes Secret.
generated string in the `sk-...` format stored in the `<RELEASE>-litellm-masterkey` Kubernetes Secret.
```bash
kubectl -n litellm get secret <RELEASE>-litellm-masterkey -o jsonpath="{.data.masterkey}"
deploy/charts/litellm-helm/templates/secret-masterkey.yaml
+1 -1
View File
@@ -1,5 +1,5 @@
{{- if not .Values.masterkeySecretName }}
{{ $masterkey := (.Values.masterkey | default (randAlphaNum 17)) }}
{{ $masterkey := (.Values.masterkey | default (printf "sk-%s" (randAlphaNum 18))) }}
apiVersion: v1
kind: Secret
metadata:
deploy/charts/litellm-helm/tests/masterkey-secret_tests.yaml
+7 -1
View File
@@ -2,13 +2,19 @@ suite: test masterkey secret
templates:
- secret-masterkey.yaml
tests:
- it: should create a secret if masterkeySecretName is not set
- it: should create a secret if masterkeySecretName is not set. should start with sk-xxxx (base64 encoded as c2st*)
template: secret-masterkey.yaml
set:
masterkeySecretName: ""
asserts:
- isKind:
of: Secret
- matchRegex:
path: data.masterkey
pattern: ^c2st
# Note: The masterkey is generated as "sk-<18-random-chars>" in plain text,
# but stored as base64 encoded in Kubernetes secret (requirement).
# "sk-" base64 encodes to "c2st", so we check for "^c2st" pattern.
- it: should not create a secret if masterkeySecretName is set
template: secret-masterkey.yaml
set:
litellm/model_prices_and_context_window_backup.json
-30
View File
@@ -15253,36 +15253,6 @@
"mode": "chat",
"supports_tool_choice": true
},
"deepinfra/Qwen/Qwen3-Reranker-8B": {
"max_tokens": 32768,
"max_input_tokens": 32768,
"max_output_tokens": 32768,
"input_cost_per_token": 5e-8,
"output_cost_per_token": 5e-8,
"litellm_provider": "deepinfra",
"mode": "rerank",
"supports_tool_choice": true
},
"deepinfra/Qwen/Qwen3-Reranker-4B": {
"max_tokens": 32768,
"max_input_tokens": 32768,
"max_output_tokens": 32768,
"input_cost_per_token": 2.5e-8,
"output_cost_per_token": 2.5e-8,
"litellm_provider": "deepinfra",
"mode": "rerank",
"supports_tool_choice": true
},
"deepinfra/Qwen/Qwen3-Reranker-0.6B": {
"max_tokens": 32768,
"max_input_tokens": 32768,
"max_output_tokens": 32768,
"input_cost_per_token": 1e-8,
"output_cost_per_token": 1e-8,
"litellm_provider": "deepinfra",
"mode": "rerank",
"supports_tool_choice": true
},
"perplexity/codellama-34b-instruct": {
"max_tokens": 16384,
"max_input_tokens": 16384,