Commit Graph

3452 Commits

Author SHA1 Message Date
ishaan-jaff 5da6fb84fa (docs) simple proxy 2023-11-10 15:59:12 -08:00
ishaan-jaff 9b78bbc6ea (fix) ssl changes 2023-11-10 15:57:59 -08:00
ishaan-jaff f9d4505ea0 (fix) ssl for acompletion with openai 2023-11-10 15:55:04 -08:00
Krrish Dholakia 41c94d50e2 fix(text_completion.py): fix routing logic 2023-11-10 15:46:37 -08:00
Krrish Dholakia 697497cdfa test(test_streaming.py): set cache to none 2023-11-10 15:24:17 -08:00
ishaan-jaff 2c32f4a588 (test) fix caching 2023-11-10 15:23:56 -08:00
Krrish Dholakia 91dc9a34e5 test(test_langfuse.py): add retries to langfuse test 2023-11-10 15:09:21 -08:00
Krrish Dholakia 40edb546dc test(test_streaming.py): set cache to none 2023-11-10 15:04:01 -08:00
Krrish Dholakia abee5a0e05 fix(utils.py): caching for embedding 2023-11-10 14:33:17 -08:00
ishaan-jaff 5fcf9fc799 (docs) proxy setting default models 2023-11-10 13:06:22 -08:00
ishaan-jaff ebcd29b1ec (docs) proxy pass headers 2023-11-10 12:59:34 -08:00
ishaan-jaff 9d4cbf1d22 (docs) pass headers in config 2023-11-10 12:56:53 -08:00
ishaan-jaff af98f74c82 (feat) replicate add exception mapping for streaming + better logging when polling 2023-11-10 12:46:33 -08:00
ishaan-jaff 1c1a260065 (test) replicate with streaming, num retries 2023-11-10 12:46:33 -08:00
ishaan-jaff 49c8c8a74f (fix) streaming replicate 2023-11-10 12:46:33 -08:00
ishaan-jaff bf2cb91841 (docs) add replicate cold boots info 2023-11-10 12:46:33 -08:00
ishaan-jaff 4c3765119b (fix) replicate print verbose 2023-11-10 12:46:33 -08:00
ishaan-jaff 49c7c851a8 (feat) replicate exception mapping 2023-11-10 12:46:33 -08:00
ishaan-jaff 00e1b46e68 (feat) replicate exception mapping 2023-11-10 12:46:33 -08:00
Krrish Dholakia 62290ec5d9 fix(utils.py): fix exception raised 2023-11-10 11:28:17 -08:00
Krrish Dholakia 18a8bd5543 fix(utils.py): return function call as part of response object 2023-11-10 11:02:10 -08:00
Krrish Dholakia a4c9e6bd46 fix(utils.py): fix cached responses - translate dict to objects 2023-11-10 10:38:20 -08:00
Krrish Dholakia 84460b8222 docs(input.md): adding anyscale supported params 2023-11-10 09:26:57 -08:00
Krish Dholakia 271238536f Merge pull request #790 from nathankim7/standardize-available-deployments
Fix bad returns in get_available_deployment
2023-11-10 08:59:48 -08:00
ishaan-jaff 2f07460333 (feat) completion ollama raise exception when ollama resp != 200 2023-11-10 08:54:05 -08:00
Nathan Kim f7dc2bf545 first commit 2023-11-09 22:12:39 -08:00
Nathan Kim ee92c9c8b6 first commit 2023-11-09 22:07:19 -08:00
Ishaan Jaff 8f10d1a3e3 Merge pull request #789 from PrathamSoni/psoni2002/fix_async
add custom open ai models to asyncio call
2023-11-09 21:12:22 -08:00
Pratham Soni 2f37baa690 add custom open ai models to asyncio call 2023-11-09 20:47:46 -08:00
Krrish Dholakia 86f9bb0af6 test(test_completion.py): fix openai testing 2023-11-09 19:05:34 -08:00
Krrish Dholakia 7769abe432 fix(test_caching.py): flaky test 2023-11-09 18:54:21 -08:00
Krrish Dholakia 3d4c5e10a7 fix(utils.py): fix sync streaming 2023-11-09 18:47:20 -08:00
ishaan-jaff 76d8ea674e (docs) replicate 2023-11-09 18:16:21 -08:00
Krrish Dholakia 249cde3d40 fix(main.py): accepting azure deployment_id 2023-11-09 18:16:02 -08:00
ishaan-jaff 523c540051 (replicate) deployments 2023-11-09 18:10:38 -08:00
ishaan-jaff 6f639f30c5 (docs) replicate deployments 2023-11-09 18:10:38 -08:00
ishaan-jaff d0c9bfd14a (feat) completion - replicate custom deployments 2023-11-09 18:10:38 -08:00
Krrish Dholakia 62e83ce75a test(test_completion.py): fix test case 2023-11-09 17:43:18 -08:00
ishaan-jaff e355a0674f (docs) using auto evals 2023-11-09 17:31:50 -08:00
ishaan-jaff 7ddd29da93 (docs) litellm eval suites 2023-11-09 17:22:42 -08:00
ishaan-jaff 108336aeef (docs) using proxy with mlfow eval 2023-11-09 17:21:43 -08:00
ishaan-jaff 953593e137 (docs) add mlflow 2023-11-09 17:18:32 -08:00
ishaan-jaff 88111fbb36 (docs) auto evals 2023-11-09 17:18:32 -08:00
Krrish Dholakia b19e7dcc5a fix(utils.py): fix logging integrations 2023-11-09 17:09:49 -08:00
Krrish Dholakia b9e6989e41 test: fix linting issues 2023-11-09 16:50:43 -08:00
Krrish Dholakia e12bff6d7f refactor(azure.py): enabling async streaming with aiohttp 2023-11-09 16:41:06 -08:00
Krrish Dholakia c053782d96 refactor(openai.py): support aiohttp streaming 2023-11-09 16:15:30 -08:00
ishaan-jaff bba62b56d3 (docs) auto eval tutorial 2023-11-09 15:43:55 -08:00
ishaan-jaff 87328a973e (docs) add tutorial on using litellm with autoeval 2023-11-09 15:42:12 -08:00
ishaan-jaff 40e7e2ce48 (docs) cleanup 2023-11-09 13:24:13 -08:00