Commit Graph

3972 Commits

Author SHA1 Message Date
Krrish Dholakia 5a4c054eef fix(proxy_server.py): add testing for model info being added to /model/new 2023-12-02 14:15:45 -08:00
ishaan-jaff 278ef6bd83 (docs) refactor litellm proxy docs to use a hierarchy 2023-12-02 14:09:39 -08:00
Krish Dholakia 132218e0ed Merge pull request #977 from Manouchehri/patch-2
Mention Neon as a database option in docs
2023-12-02 13:26:10 -08:00
David Manouchehri 7c974bdc57 (docs) Mention Neon as a database option. 2023-12-02 15:15:54 -05:00
ishaan-jaff da78fd617c (docs) proxy: OTEL 2023-12-02 11:56:02 -08:00
ishaan-jaff b9e1c66ebe (fix) general proxy config yaml 2023-12-02 11:32:29 -08:00
ishaan-jaff 59b36a6f9c (feat) proxy: add proxy_otel deps 2023-12-02 11:32:15 -08:00
ishaan-jaff 89cd54094c (docs) proxy: add example OTEL config yaml 2023-12-02 11:22:40 -08:00
ishaan-jaff 067e4e7057 (docs) proxy: add example config.yaml 2023-12-02 11:11:39 -08:00
ishaan-jaff 30e34e62d0 (docs) proxy otel 2023-12-02 11:11:16 -08:00
ishaan-jaff 6866895a27 (fix) proxy: config reading error 2023-12-02 11:09:38 -08:00
ishaan-jaff 54c5736f81 (fix) otel - make it optional 2023-12-02 11:02:03 -08:00
ishaan-jaff f897d5e849 (ci/cd) HF embedding 2023-12-02 10:57:33 -08:00
ishaan-jaff 7f28333ad8 (docs) simple proxy 2023-12-02 10:42:12 -08:00
ishaan-jaff 5edb529891 (feat) proxy: embedding add OTEL collector 2023-12-02 09:41:29 -08:00
ishaan-jaff 4830aa08ee (fix) linting error 2023-12-02 09:39:26 -08:00
ishaan-jaff 6a0ebc1bb3 (chore) cleanup proxy 2023-12-02 09:37:14 -08:00
ishaan-jaff 278ab7dcab (docs) otel collector 2023-12-01 21:46:37 -08:00
ishaan-jaff dd8c1b0458 (feat) allow users to set OTEL_ENDPOINT as env 2023-12-01 21:29:26 -08:00
ishaan-jaff 8b6c4918fd (docs) OTEL simple proxy 2023-12-01 21:28:46 -08:00
ishaan-jaff 2a25d9c15d (feat) proxy: name OTEL logger 2023-12-01 21:08:25 -08:00
ishaan-jaff c431bf8daa (feat) proxy: otel logging 2023-12-01 21:04:08 -08:00
ishaan-jaff 3e62f90b43 (feat) proxy: add OTEL logging input/output 2023-12-01 21:04:07 -08:00
ishaan-jaff 848acdf28e (feat) proxy: add otel config 2023-12-01 21:04:07 -08:00
Krrish Dholakia 60af976aac fix(proxy_server.py): expose model_info as part of pydantic model params object 2023-12-01 20:55:26 -08:00
Krrish Dholakia 41afe48bf8 bump: version 1.9.5 → 1.10.0 2023-12-01 20:47:40 -08:00
Krrish Dholakia bb687cb96f fix(proxy_server.py): redact api keys from proxy load 2023-12-01 20:47:13 -08:00
Krrish Dholakia 47730da262 fix(proxy_server.py): fix linting errors 2023-12-01 20:40:49 -08:00
Krrish Dholakia 72381c3cc2 feat(proxy_server.py): dynamic reloading config.yaml with new models 2023-12-01 20:32:24 -08:00
Krrish Dholakia eae5b3ce50 fix(__init__.py): fix linting error 2023-12-01 20:08:08 -08:00
Krrish Dholakia ccd10b07a8 docs(secret.md): add azure key vault support to docs 2023-12-01 20:07:20 -08:00
Krrish Dholakia 328113a28e fix(proxy_server.py): fix linting errors 2023-12-01 19:45:09 -08:00
Krrish Dholakia 368fee224e feat: support for azure key vault 2023-12-01 19:36:06 -08:00
Krrish Dholakia cac7ecf840 fix(proxy_server.py): check if bearer token passed in 2023-12-01 17:06:29 -08:00
ishaan-jaff a971d78d6c bump: version 1.9.4 → 1.9.5 2023-12-01 16:47:14 -08:00
ishaan-jaff 6c6add2a3c (fix) ci/cd 2023-12-01 16:06:22 -08:00
ishaan-jaff 61f902347f (proxy) fix types 2023-12-01 16:05:29 -08:00
ishaan-jaff 80e2ffbfa6 (feat) proxy: use dict 2023-12-01 16:00:00 -08:00
Krrish Dholakia 2c1103247d test: fix flaky test 2023-12-01 15:46:39 -08:00
Krrish Dholakia 4da20ac0b9 fix(proxy_server.py): accept max tokens as int 2023-12-01 15:19:34 -08:00
Krrish Dholakia ac4429c35f test(test_completion.py): commenting out flaky test 2023-12-01 15:06:54 -08:00
Krrish Dholakia 8c1439e910 fix: linting errors 2023-12-01 15:02:22 -08:00
ishaan-jaff fc40e83783 (fix) linting 2023-12-01 14:51:44 -08:00
ishaan-jaff 455c915b70 (linting) fix 2023-12-01 14:34:15 -08:00
ishaan-jaff 73eb5a7718 (fix) linting 2023-12-01 14:08:19 -08:00
ishaan-jaff 24386c05aa (fix) proxy: pydantic 2023-12-01 13:58:28 -08:00
ishaan-jaff e8ae347681 (feat) proxy-pydantic,swagger for chat/completion 2023-12-01 13:50:51 -08:00
ishaan-jaff e77b7e5a50 (docs) proxy: add tags=chat/completions + add response type 2023-12-01 10:00:48 -08:00
ishaan-jaff 2977d04f56 (fix) proxy: raise exceptions 2023-12-01 09:21:06 -08:00
ishaan-jaff 1e9aa69268 (fix) proxy: use orjson.loads() 2023-11-30 20:24:31 -08:00