Commit Graph

3452 Commits

Author SHA1 Message Date
ishaan-jaff 6b14c8d2de (test) langfuse logger 2023-11-16 10:45:35 -08:00
ishaan-jaff c84fe1af5e (fix) langfuse logging + openai streaming when chunk = [DONE} 2023-11-16 10:45:35 -08:00
Krrish Dholakia bb51216846 fix(openai.py): supporting openai client sdk for handling sync + async calls (incl. for openai-compatible apis) 2023-11-16 10:35:03 -08:00
ishaan-jaff b8c64f16cd (chore) linting fix 2023-11-16 09:57:40 -08:00
ishaan-jaff d9fb4d494c (feat) raise exception on proxy server 2023-11-16 09:51:17 -08:00
ishaan-jaff b283dd2a07 (test) add proxy cli testing 2023-11-16 09:51:17 -08:00
Krrish Dholakia fcc250b312 docs(simple_proxy.md): add tutorial on handling multiple instances of 1 model 2023-11-16 09:14:15 -08:00
Ishaan Jaff d6ad62d793 Merge pull request #811 from dchristian3188/bedrock-llama
Bedrock llama
2023-11-16 07:57:50 -08:00
Ishaan Jaff 3f95fd2da5 Merge pull request #826 from rodneyxr/ollama-fixes
Fix typo for initial_prompt_value and too many values to unpack error
2023-11-16 07:55:53 -08:00
David Christian 45ae4a76e4 updated utils for bedrock.meta streaming 2023-11-16 07:12:27 -08:00
Krrish Dholakia 791a3877d9 bump: version 1.0.3.dev1 → 1.0.3 2023-11-15 20:46:48 -08:00
Krrish Dholakia 93aae8669d fix(openai.py): using openai sdk for completion calls 2023-11-15 20:25:27 -08:00
Krrish Dholakia da68e1ea81 perf(openai.py): extending request timeout 2023-11-15 18:45:45 -08:00
Krrish Dholakia a575ff867f fix(openai.py): fix linting errors 2023-11-15 18:33:01 -08:00
Krrish Dholakia d090562dc1 fix(openai.py): move chat completions post call to requests 2023-11-15 18:29:07 -08:00
ishaan-jaff 15439a6aa9 (chore) testing reset callbacks 2023-11-15 18:29:03 -08:00
Krrish Dholakia fc8b54eb73 fix(openai.py): switch back to using requests instead of httpx 2023-11-15 18:25:21 -08:00
ishaan-jaff 5990d046c4 (chore) ci/cd testing 2023-11-15 18:07:04 -08:00
ishaan-jaff f061c775d0 (chore) ci/cd show durations of slowest tests 2023-11-15 18:07:04 -08:00
Krrish Dholakia 2750a26633 fix(openai.py): fix timeout errors 2023-11-15 18:03:14 -08:00
ishaan-jaff 3945bfadb7 (chore) remove bloat caching tests 2023-11-15 17:58:58 -08:00
Krrish Dholakia a3d280baa3 test: cleanup testing 2023-11-15 17:57:14 -08:00
ishaan-jaff a48445c11c (chore) speed up testing 2023-11-15 17:56:03 -08:00
ishaan-jaff 985220cc09 (chore) remove bloat 2023-11-15 17:52:57 -08:00
Krrish Dholakia 9fd7c5b343 test: set request timeout at request level 2023-11-15 17:42:31 -08:00
ishaan-jaff eda4401c71 (chore) clean ci cd pipeline 2023-11-15 17:42:02 -08:00
ishaan-jaff eeec8a1765 (chore) remove bloat testing 2023-11-15 17:40:24 -08:00
ishaan-jaff a7c31d54fa (fix) testing model alias map 2023-11-15 17:40:15 -08:00
ishaan-jaff 6f0b34c771 (chore) remvoe bloat testing 2023-11-15 17:33:15 -08:00
ishaan-jaff 63b2b6c9a2 (docs) remove bloat gpt cache 2023-11-15 17:30:47 -08:00
ishaan-jaff bcc9ebb78f (chore) clean up ci/cd testing requirements 2023-11-15 17:28:37 -08:00
Rodney Rodriguez 5d39279ac0 bugfixes for ollama 2023-11-15 19:27:06 -06:00
ishaan-jaff 8aea256a53 (chore) linting fixes 2023-11-15 17:25:06 -08:00
ishaan-jaff bba0a2dcf7 (chore) remove bloat 2023-11-15 17:16:14 -08:00
ishaan-jaff 60c1ef7929 (chore) fix config yaml 2023-11-15 17:12:28 -08:00
ishaan-jaff 2a81cc567d (chore) removing bloat 2023-11-15 17:11:56 -08:00
ishaan-jaff 1d5e68197e (chore) litellm_server rename utils -> server utils 2023-11-15 17:05:50 -08:00
Krrish Dholakia d6e142428b fix(openai-+-azure): async calling 2023-11-15 17:03:02 -08:00
ishaan-jaff eaa55ac6fd (chore) remove bloat deprecated config.json 2023-11-15 17:00:14 -08:00
ishaan-jaff 717d3995b5 (chore) remove bloat - deprecated gpt cache integration 2023-11-15 16:59:31 -08:00
ishaan-jaff 6d9d79d12b (chore) remove bloat old testing.py file 2023-11-15 16:58:54 -08:00
ishaan-jaff 5b79abdfb6 (chore) rename litellm server 2023-11-15 16:57:42 -08:00
ishaan-jaff 08c182c57c (chore) move litellm_server inside litellm 2023-11-15 16:56:35 -08:00
Krrish Dholakia 03efc9185e fix(huggingface_restapi.py): async implementation 2023-11-15 16:54:15 -08:00
ishaan-jaff cc955fca89 (docs) config 2023-11-15 16:48:01 -08:00
ishaan-jaff 9493aeff68 (docs) add example configs to proxy 2023-11-15 16:41:26 -08:00
ishaan-jaff a18fe5a1fd (fix) proxy raise exceptions from litellm.completion() 2023-11-15 16:26:04 -08:00
ishaan-jaff e698f8218f (feat) proxy - show loaded config for users 2023-11-15 16:26:04 -08:00
Krrish Dholakia bcea28e2e4 fix(utils): fixing exception mapping 2023-11-15 15:51:17 -08:00
Krrish Dholakia a59494571f fix(huggingface_restapi.py): fix linting errors 2023-11-15 15:34:21 -08:00