Commit Graph
3734 Commits
Author SHA1 Message Date
Krish DholakiaandGitHub d898b1c412 Merge pull request #734 from morgendigital/patch-1
Docker Hub image is built for ARM64 only
2023-11-01 08:21:45 -07:00
Ishaan JaffandGitHub 66850479cd Merge pull request #741 from stanfea/main
Use supplied headers
2023-11-01 08:08:12 -07:00
stefan bbc82f3afa Use supplied headers 2023-11-01 20:31:16 +07:00
ishaan-jaff f6983223f9 (test) track usage in custom callback streaming 2023-10-31 23:05:42 -07:00
ishaan-jaff d1f2593dc0 (fix) add usage tracking in callback 2023-10-31 23:02:54 -07:00
ishaan-jaff 522f1ac7c8 (docs) bedrock 2023-10-31 22:32:41 -07:00
Krrish Dholakia 7762ae7762 feat(utils.py): accept context window fallback dictionary 2023-10-31 22:32:36 -07:00
ishaan-jaff 2f6fed30ad (test) bedrock.cohere testing 2023-10-31 22:26:43 -07:00
ishaan-jaff fa7e063198 (feat) add bedrock.cohere streaming 2023-10-31 22:26:43 -07:00
Krrish Dholakia 0ffb1dcc38 test(test_completion_with_retries.py): cleanup tests 2023-10-31 21:49:33 -07:00
Krrish Dholakia f3efd566c9 style(main.py): fix linting issues 2023-10-31 19:23:14 -07:00
Krrish Dholakia 125642563c feat(completion()): adding num_retries
https://github.com/BerriAI/litellm/issues/728
2023-10-31 19:14:55 -07:00
ishaan-jaff cedc756d2e (docs) hf viewing log probs 2023-10-31 18:37:18 -07:00
Krrish Dholakia 6ead8d8c18 fix(caching.py): fixing pr issues 2023-10-31 18:32:40 -07:00
ishaan-jaff c0e6596395 (docs) hf 2023-10-31 18:25:44 -07:00
ishaan-jaff f016234cbf (test) text_completion add echo for hf 2023-10-31 18:20:59 -07:00
ishaan-jaff ce462824be (feat) add support for echo for HF logprobs 2023-10-31 18:20:59 -07:00
Krrish Dholakia 847de09308 docs(simple_proxy.md): add model alias to docs 2023-10-31 17:30:02 -07:00
Krish DholakiaandGitHub 5a2a9baa78 Update README.md 2023-10-31 17:19:56 -07:00
ishaan-jaff e180bba541 (test) text completion add logprobs to test 2023-10-31 17:15:35 -07:00
ishaan-jaff 9223f7cc7a (feat) textcompletion - transform hf log probs to openai text completion 2023-10-31 17:15:35 -07:00
ishaan-jaff b32cedeb28 (docs) function calling for non openai llms 2023-10-31 17:15:35 -07:00
Krrish Dholakia 4d95756432 test(test_completion.py): re-add bedrock + sagemaker testing 2023-10-31 16:49:13 -07:00
Krish DholakiaandGitHub 523c08a646 Merge pull request #717 from canada4663/main
support for custom bedrock runtime endpoint
2023-10-31 16:47:33 -07:00
Krish DholakiaandGitHub 9bef396d04 Merge pull request #722 from karvetskiy/fix-router-caching
Fix caching for Router
2023-10-31 16:39:18 -07:00
ishaan-jaff 85692398c1 (test) add support for returning logprobs 2023-10-31 15:33:45 -07:00
ishaan-jaff 1ada3a13d4 (feat) text_completion return raw response for davinci003 2023-10-31 15:32:04 -07:00
ishaan-jaff de47058e32 (feat) text_completion return raw openai response for text_completion requests 2023-10-31 15:31:24 -07:00
MorgendigitalandGitHub 3c49949e0b Docker Hub image is built for ARM64 only
When trying to run it on a x64 Linux machine, I get the following error:

```
WARNING: The requested image's platform (linux/arm64) does not match the detected host platform (linux/amd64/v3) and no specific platform was requested
```

The Docker image was apparently built for ARM64 only.
2023-10-31 23:28:38 +01:00
ishaan-jaff 4875af17a1 (fix) linting errors 2023-10-31 14:43:10 -07:00
ishaan-jaff b301e4ead7 (test) text_completion pass prompt as array 2023-10-31 14:29:43 -07:00
ishaan-jaff b4e14aed6b (feat) text_completion add support for passing prompt as array 2023-10-31 14:29:43 -07:00
Krish DholakiaandGitHub 730fd28286 Merge pull request #729 from mc-marcocheng/router/empty_str
Router.get_available_deployment: Handle empty input edge case
2023-10-31 08:01:37 -07:00
mc-marcocheng 0a2cb9555c Handle empty input edge case 2023-10-31 14:38:04 +08:00
Krrish Dholakia caa199d851 test: removing unstable tests 2023-10-30 21:10:36 -07:00
Krrish Dholakia 9a0c785741 test(test_async_fn.py): fix import issues 2023-10-30 20:57:24 -07:00
Krrish Dholakia 3743893e76 fix(main.py): removing print_verbose 2023-10-30 20:37:12 -07:00
Krrish Dholakia c04cad208c test(test_sentry.py): fix testing 2023-10-30 20:21:40 -07:00
ishaan-jaff 0089442341 (test) add func to prompt 2023-10-30 20:06:06 -07:00
ishaan-jaff ad2b75a8cc (test) fix test test_exception_tracking 2023-10-30 20:05:37 -07:00
Krrish Dholakia 9c70da56df test(test_async_fn.py): test logging 2023-10-30 19:59:36 -07:00
Krrish Dholakia 1cd43419b8 test(test_async_fn.py): debugging circle ci issue 2023-10-30 19:50:35 -07:00
Krrish Dholakia a30fca4f60 test(test_async_fn.py): addding sync test 2023-10-30 19:38:31 -07:00
Krrish Dholakia 6b715597e9 test(test_async_fn.py): more logging 2023-10-30 19:29:37 -07:00
Krrish Dholakia 75736cb852 test(test_async_fn.py): adding more logging 2023-10-30 19:11:07 -07:00
Krrish Dholakia b798d7de89 test(test_async_fn.py): more logging 2023-10-30 18:39:10 -07:00
Krrish Dholakia 0c032d7b60 test(test_api_key_param.py): cleanup 2023-10-30 18:27:42 -07:00
Krrish Dholakia 844ab5f1e5 test(test_async_fn.py): add better error logging 2023-10-30 18:18:11 -07:00
ishaan-jaff 7578716adc (docs) openai set - org + api base 2023-10-30 18:03:53 -07:00
ishaan-jaff 5f47c8d310 (docs) update calling ft gpt3.5 2023-10-30 17:56:01 -07:00