Commit Graph
3734 Commits
Author SHA1 Message Date
ishaan-jaff 589cdce8d3 (fix) request_timeout mapped to timeout for openai 2023-11-21 13:22:21 -08:00
ishaan-jaff 20b129b7ad (docs) update timeout variable name 2023-11-21 13:14:55 -08:00
ishaan-jaff b98d9199f6 (test) load test queing 2023-11-21 12:51:58 -08:00
Krrish Dholakia 015c7de549 fix(proxy_server.py): defaulting status to queued 2023-11-21 12:40:30 -08:00
ishaan-jaff b2c35bbd50 (test) load test proxy 2023-11-21 12:38:46 -08:00
Krrish Dholakia 331fe86c8f refactor(proxy_server.py): experimental endpoint - defined job status 2023-11-21 12:37:00 -08:00
ishaan-jaff 4e06b4a26f (test) add load test queuing 2023-11-21 12:14:20 -08:00
ishaan-jaff 78f90cd0d0 (test) load test litelm proxy 2023-11-21 12:14:20 -08:00
Krrish Dholakia d0f228e53f refactor(proxy_server.py): refactoring experimental endpoint names 2023-11-21 12:12:15 -08:00
Krrish Dholakia c6a4744947 feat(proxy_server.py): EXPERIMENTAL: adding queuing endpoints to openai proxy server 2023-11-21 12:06:23 -08:00
ishaan-jaff 5dabcc21c9 (docs) update migration 2023-11-21 11:22:54 -08:00
ishaan-jaff 3aebc46ebf (docs) update streaming 2023-11-21 11:20:53 -08:00
ishaan-jaff f29a353796 (docs) update how to use litellm streaming 2023-11-21 11:19:32 -08:00
Krrish Dholakia 37187e8e88 test(test_completion.py): fix replicate streaming test 2023-11-21 10:38:05 -08:00
Krrish Dholakia 1218121e47 fix(huggingface_restapi.pyu): fix linting errors 2023-11-21 10:05:35 -08:00
Krrish Dholakia c23d42305d test(test_rules.py): refactor testing 2023-11-21 10:01:06 -08:00
ishaan-jaff bb44fc8f9d (docs) anthropic 2023-11-21 09:58:02 -08:00
Krrish Dholakia ccdb2f051f bump: version 1.3.3.dev3 → 1.3.3 2023-11-21 09:57:26 -08:00
Krrish Dholakia 41483d2660 feat(factory.py): add support for anthropic system prompts for claude 2.1 2023-11-21 09:57:26 -08:00
Krrish Dholakia f6bdbaee5d bump: version 1.3.3.dev2 → 1.3.3.dev3 2023-11-21 09:57:26 -08:00
Krrish Dholakia 846a32ca87 fix(huggingface_restapi.py): fixing formatting 2023-11-21 09:57:26 -08:00
Krrish Dholakia d1c0343fe1 bump: version 1.3.3.dev1 → 1.3.3.dev2 2023-11-21 09:57:26 -08:00
Krrish Dholakia 6892fd8b51 fix(huggingface_restapi.py): fix huggingface response format 2023-11-21 09:57:26 -08:00
Krrish Dholakia a534928337 bump: version 1.3.2 → 1.3.3.dev1 2023-11-21 09:57:26 -08:00
Krrish Dholakia a89b8f55e3 fix(huggingface_restapi.py): handle generate text output 2023-11-21 09:57:26 -08:00
ishaan-jaff f4dcff2864 (docs) add claude2.1 2023-11-21 09:54:32 -08:00
ishaan-jaff 219470ed68 (test) add claude-2.1 2023-11-21 09:53:47 -08:00
ishaan-jaff 07bca4dcb1 (feat) add claude2.1 2023-11-21 09:44:19 -08:00
ishaan-jaff 2a35ff88a7 (fix) proxy server LiteLLM warning 2023-11-21 08:50:31 -08:00
ishaan-jaff 8969c5f769 (docs) proxy starting config.yaml 2023-11-21 08:36:34 -08:00
ishaan-jaff 6898840218 (fix) proxy server - raise 500 on exceptions 2023-11-21 08:36:34 -08:00
Krrish Dholakia 6ddefc778a bump: version 1.3.1 → 1.3.2 2023-11-21 08:36:18 -08:00
Krrish Dholakia 846a824c47 fix(proxy_server.py): run ollama serve when ollama in config.yaml 2023-11-21 08:35:04 -08:00
ishaan-jaff c4f9ef86c9 (fix) fix anyscale context window 2023-11-21 08:22:21 -08:00
Krrish Dholakia 8534bf96d5 test(test_rules.py): clear rules after test completes 2023-11-21 08:18:04 -08:00
Krrish Dholakia 2a681c1874 fix(utils.py): fix pre call rules 2023-11-21 07:10:04 -08:00
Krrish Dholakia b991a35ebe fix(main.py): revert model alias map change 2023-11-20 21:07:52 -08:00
Krrish Dholakia ab2986290e fix(utils.py): fix rules calling 2023-11-20 21:06:36 -08:00
Krrish Dholakia b2e52eedf8 fix(main.py): fix model alias map logic 2023-11-20 20:49:10 -08:00
ishaan-jaff b752ba8a46 (docs) router 2023-11-20 19:29:58 -08:00
Krrish Dholakia 1306addfe8 fix(openai.py-+-azure.py): fix linting issues 2023-11-20 19:29:23 -08:00
Krrish Dholakia 311b4f9d2c docs(rules.md): adding rules to docs 2023-11-20 19:14:07 -08:00
ishaan-jaff d4caa918d5 (test) wandb logger 2023-11-20 19:08:53 -08:00
ishaan-jaff 80884e9cb3 (fix) using callbacks with router 2023-11-20 19:08:53 -08:00
Krrish Dholakia 668d45393c bump: version 1.3.0 → 1.3.1 2023-11-20 18:58:22 -08:00
Krrish Dholakia cb5c02888b bump: version 1.2.0 → 1.3.0 2023-11-20 18:58:15 -08:00
Krrish Dholakia 855964ed45 fix(utils.py): adding support for rules + mythomax/alpaca prompt template 2023-11-20 18:58:15 -08:00
ishaan-jaff 4f46ac4ab5 (fix) linting error 2023-11-20 18:32:43 -08:00
ishaan-jaff 50f883a2fb (fix) pydantic errors with response.time 2023-11-20 18:28:19 -08:00
ishaan-jaff 3f30f93516 (fix) pydantic errors openai usage 2023-11-20 18:28:19 -08:00