Commit Graph

3371 Commits

Author SHA1 Message Date
Krrish Dholakia 8e430fcfbe test(test_async_fn.py): catch timeouts 2023-11-17 18:01:52 -08:00
Krrish Dholakia 9f51462933 bump: version 1.0.4 → 1.1.0 2023-11-17 17:56:26 -08:00
Krrish Dholakia 478bd7def6 fix(router.py): introducing usage-based-routing 2023-11-17 17:56:26 -08:00
ishaan-jaff a6a862dc5a (ci/cd) fix timeout error 2023-11-17 17:46:49 -08:00
ishaan-jaff e006cbbc73 (docs) update readme proxy server 2023-11-17 17:40:44 -08:00
ishaan-jaff a08b8581f8 (docs) new dockerfile for litellm proxy 2023-11-17 17:39:07 -08:00
Ishaan Jaff 7544d1925c Update requirements.txt 2023-11-17 17:37:27 -08:00
ishaan-jaff fd7f17b11b (chore) remove old dockerfile 2023-11-17 17:37:00 -08:00
ishaan-jaff d1af0af7bf (docs) load balancer 2023-11-17 17:25:46 -08:00
ishaan-jaff 42432bedaa (docs) add example load balancer 2023-11-17 17:25:12 -08:00
Krrish Dholakia 7376e57e9c refactor(router.py): code cleanup 2023-11-17 17:05:46 -08:00
Krrish Dholakia 5cddab9e54 test(test_langfuse.py): handle timeouts 2023-11-17 17:05:46 -08:00
ishaan-jaff d2bac07b48 (test) parallel tool calling 2023-11-17 17:03:24 -08:00
ishaan-jaff fdbaceab8e (docs) input params 2023-11-17 16:07:25 -08:00
Krrish Dholakia 985583023a test(test_completion.py): change tgai model 2023-11-17 16:06:42 -08:00
ishaan-jaff 30a95a7823 (docs) input params 2023-11-17 16:06:12 -08:00
ishaan-jaff 65ae7127be (docs) optional fields - tools, tool_choice 2023-11-17 16:04:40 -08:00
Krrish Dholakia a99efc544e fix(test_router.py): catch timeouts 2023-11-17 15:56:06 -08:00
ishaan-jaff bb9e7c65e9 (test) parallel function calling 2023-11-17 15:51:27 -08:00
ishaan-jaff 88200432b0 (feat) support parallel function calling 2023-11-17 15:51:27 -08:00
ishaan-jaff 32f22adf8b (feat) openai improve logging post_call 2023-11-17 15:51:27 -08:00
ishaan-jaff 7de87c845b (feat) improve logging - show model_call_details 2023-11-17 15:51:27 -08:00
Krrish Dholakia 17bb1184bd fix(main.py): fix linting issue 2023-11-17 15:45:00 -08:00
Krrish Dholakia 0ab6b2451d fix(acompletion): support client side timeouts + raise exceptions correctly for async calls 2023-11-17 15:39:47 -08:00
Krish Dholakia c4e53aa77b Updated config.yml 2023-11-17 14:24:04 -08:00
ishaan-jaff f026ed4772 (test) test seed, response format, for gpt-3.5-turbo 2023-11-17 14:00:42 -08:00
ishaan-jaff 7abb65d53f (feat) completion: add response_format, seed, tools, tool_choice 2023-11-17 13:59:57 -08:00
ishaan-jaff 3c03e82f98 (docs) update migration guide 2023-11-17 10:48:21 -08:00
ishaan-jaff aa2a9fff99 (docs) get_max_tokens returns int not dict now 2023-11-17 10:39:13 -08:00
ishaan-jaff bd82559553 (v1.0+ breaking change) get_max_tokens -> return int 2023-11-17 10:38:50 -08:00
ishaan-jaff c162f8b4b0 (docs) test proxy 2023-11-17 10:19:12 -08:00
ishaan-jaff 54b6a767f4 (docs) using proxy 2023-11-17 10:19:01 -08:00
ishaan-jaff 79e93ee7aa (docs) proxy - aws sagemaker jumpstart 2023-11-17 10:04:35 -08:00
Krish Dholakia 107edc631c Update README.md 2023-11-17 09:39:06 -08:00
Krish Dholakia 85b987741f Update README.md 2023-11-17 09:38:26 -08:00
Ishaan Jaff 1a09b93214 Merge pull request #832 from BerriAI/dependabot/npm_and_yarn/docs/my-website/sharp-0.32.6
build(deps): bump sharp from 0.32.5 to 0.32.6 in /docs/my-website
2023-11-17 09:05:34 -08:00
Krrish Dholakia 3d45d8a58c test: load test router 2023-11-17 08:23:44 -08:00
ishaan-jaff c7aba49d83 (ci/cd) re run pipeline 2023-11-17 08:07:02 -08:00
Krrish Dholakia a27c2961dc docs(migration.md): new base case exception - apiconnectionerror 2023-11-16 22:04:14 -08:00
Krrish Dholakia 9bd1f4ebd0 fix(utils.py): improve exception mapping for vertex ai 2023-11-16 22:02:26 -08:00
ishaan-jaff 3e2750ffb9 (ci/cd) re run pipeline 2023-11-16 21:55:10 -08:00
Krrish Dholakia 75ef1d7eb4 fix(router.py): check if async response is coroutine 2023-11-16 21:53:35 -08:00
Krrish Dholakia 7456c26940 docs(routing.md): update tutorial on deploying router 2023-11-16 21:46:43 -08:00
Ishaan Jaff 61705f3467 (ci/cd) run again 2023-11-16 21:29:18 -08:00
Krrish Dholakia 7ef1014e59 fix(factory.py): for ollama models check if it's instruct or not before applying prompt template 2023-11-16 15:45:08 -08:00
ishaan-jaff 25b2bc6da9 (test) add --debug to cli tool 2023-11-16 14:46:26 -08:00
Krrish Dholakia 51bf637656 feat: global client for sync + async calls (openai + Azure only) 2023-11-16 14:44:13 -08:00
ishaan-jaff 5fd4376802 (docs) lm harness 2023-11-16 14:30:33 -08:00
ishaan-jaff 8d0f4bfc74 (docs) lm harness 2023-11-16 14:21:37 -08:00
Krrish Dholakia d7f7694848 fix(openai.py): fix linting issues 2023-11-16 12:57:53 -08:00