Commit Graph

3245 Commits

Author SHA1 Message Date
ishaan-jaff e9dfea887c (docs) using litellm proxy + Langfuse 2023-11-15 13:52:47 -08:00
ishaan-jaff 11872e0d45 (fix) proxy safe access router model names 2023-11-15 13:44:17 -08:00
ishaan-jaff b7859f0dd1 (docs) show how to debug proxy logs 2023-11-15 13:44:17 -08:00
Krrish Dholakia 60d2dff74a fix(utils.py): check for none params 2023-11-15 13:39:09 -08:00
ishaan-jaff 8cced8eabc (docs) proxy cli settings 2023-11-15 13:33:29 -08:00
Krrish Dholakia 4348fd6435 fix(utils.py): azure streaming initial format 2023-11-15 13:30:08 -08:00
ishaan-jaff ae7731b4dc (docs) using litellm with curl, OpenAI v1.0.0+ 2023-11-15 13:29:20 -08:00
Krrish Dholakia 33d823a18d docs(routing.md): add contributor s/o 2023-11-15 13:20:02 -08:00
Krrish Dholakia 8c104e9c6a fix(azure.py-+-proxy_server.py): fix function calling response object + support router on proxy 2023-11-15 13:15:16 -08:00
ishaan-jaff 8f8b35eb34 add ollama/zephyr to config 2023-11-15 13:04:34 -08:00
ishaan-jaff f3bbedbbbc (docs) proxy add example on using local hf llm 2023-11-15 13:00:43 -08:00
ishaan-jaff 6f923ea813 (fix) remove bloat from ci/cid 2023-11-15 12:39:51 -08:00
Krrish Dholakia 563a3d3016 refactor(router.py): renaming variable 2023-11-15 12:31:29 -08:00
Krrish Dholakia 03303033e5 feat(router.py): enable passing chat completion params for Router.chat.completion.create 2023-11-15 12:28:16 -08:00
Krish Dholakia 95f9c6779d Merge pull request #820 from kfsone/main
need to re-attempt backoff and yaml imports if the first import attempt fails
2023-11-15 11:28:34 -08:00
Oliver Smith 8e4349d3dc Correct pypi package name for yaml 2023-11-15 10:46:26 -08:00
Oliver Smith 7cf1846654 Ensure the imports needed by proxy_server are in requirements.txt to start with 2023-11-15 10:38:05 -08:00
Oliver Smith 4c980cb161 need to re-attempt backoff and yaml imports if the first import attempt fails. not sure which import is missing from requirements 2023-11-15 00:10:22 -08:00
Krrish Dholakia f5abde775b test(test_completion.py): fix palm test 2023-11-14 22:28:56 -08:00
Krrish Dholakia aafd8a50d2 bump: version 1.0.2 → 1.0.3.dev1 2023-11-14 22:20:17 -08:00
Krrish Dholakia e07bf0a8de fix(utils.py): await async function in client wrapper 2023-11-14 22:07:28 -08:00
Krrish Dholakia efe81032f4 fix: fix linting errors 2023-11-14 21:51:39 -08:00
Krrish Dholakia 59eaeba92a fix(router.py): enabling retrying with expo backoff (without tenacity) for router 2023-11-14 20:57:51 -08:00
Krrish Dholakia 98c45f1b4e bump: version 1.0.1 → 1.0.2 2023-11-14 18:55:20 -08:00
Krrish Dholakia 1738341dcb fix(main.py): misrouting ollama models to nlp cloud 2023-11-14 18:55:08 -08:00
ishaan-jaff 465f427465 (feat) debug POST logs 2023-11-14 18:16:45 -08:00
ishaan-jaff c7780cbc40 (fix) debugging with POST request 2023-11-14 18:05:34 -08:00
ishaan-jaff f650be4fee (feat) completion debug view HF POST request 2023-11-14 17:57:41 -08:00
ishaan-jaff cb5669f679 (feat) improve logging of raw POST curl command 2023-11-14 17:54:09 -08:00
ishaan-jaff e82b8ed7e2 (feat) debug ollama POST request 2023-11-14 17:53:48 -08:00
ishaan-jaff 7c317b78eb (feat) add ability to view POST requests from litellm.completion() 2023-11-14 17:27:20 -08:00
Krrish Dholakia a7222f257c fix(main.py): keep client consistent across calls + exponential backoff retry on ratelimit errors 2023-11-14 16:26:05 -08:00
ishaan-jaff 5963d9d283 (docs) config for azure ad 2023-11-14 15:47:37 -08:00
ishaan-jaff 0e9446f213 (docs) proxy 2023-11-14 15:42:23 -08:00
ishaan-jaff 255c0fab1d (docs) passing azure_ad_token to config 2023-11-14 15:27:59 -08:00
ishaan-jaff df156c7392 (fix) linting error 2023-11-14 15:07:43 -08:00
ishaan-jaff d80e2310ed (test) AI21 test 2023-11-14 15:01:50 -08:00
ishaan-jaff 75cf3b3555 (fix) AI21 exception mapping - raise error when status !=200 2023-11-14 15:01:22 -08:00
ishaan-jaff 30d52a26db (fix) APIError set body=None 2023-11-14 14:50:22 -08:00
ishaan-jaff 72755125fc (fix) linting fix 2023-11-14 14:40:59 -08:00
ishaan-jaff 952ab1a401 (docs) azure ad 2023-11-14 14:38:33 -08:00
ishaan-jaff 1a73913766 (docs) azure passing azure_ad_token 2023-11-14 13:49:39 -08:00
ishaan-jaff ede03af21d (docs) pass azure_ad_token 2023-11-14 13:44:03 -08:00
ishaan-jaff 59d217f373 (test) completion azure_ad_token 2023-11-14 12:48:31 -08:00
ishaan-jaff 53ed8f3b7e (feat) pass azure_ad_token to embedding 2023-11-14 12:48:31 -08:00
ishaan-jaff 78f42921b9 (feat) pass azure_ad_token to completion 2023-11-14 12:48:31 -08:00
Krrish Dholakia 7ef8611952 fix(simple_proxy.md): enable setting a master key to protect proxy endpoints 2023-11-14 12:44:33 -08:00
ishaan-jaff 0779dfbbd6 (fix) azure_ad_token 2023-11-14 12:20:14 -08:00
ishaan-jaff dd50aeddbb (test) azure_ad_token 2023-11-14 12:12:14 -08:00
ishaan-jaff ed56f280d9 (feat) add azure_ad_token 2023-11-14 12:12:14 -08:00