Commit Graph
17054 Commits
Author SHA1 Message Date
Victor Mustar b2d62f00a3 update cookbook
simplify
2024-08-28 17:19:48 +02:00
Ishaan JaffandGitHub 3df1186d72 Merge pull request #5402 from ajeetdsouza/patch-1
docs: add time.sleep() between streaming calls
2024-08-28 07:38:15 -07:00
Ajeet D'SouzaandGitHub 0533f77138 docs: add time.sleep() between streaming calls
LiteLLM's cache appears to be updated in the background. Without this `time.sleep()` call, both responses take `0.8s` to return, but after adding it, the second response returns in `0.006s`.
2024-08-28 17:59:07 +05:30
Ishaan Jaff f1147696a3 ci/cd run again 2024-08-27 22:59:21 -07:00
Ishaan Jaff c8fc5c44e1 ci/cd run again 2024-08-27 22:53:18 -07:00
Ishaan Jaff 5f025390bb test test_image_generation_azure_dall_e_3 2024-08-27 22:52:11 -07:00
Ishaan Jaff 3966c545b4 fix flaky tests 2024-08-27 22:47:11 -07:00
Ishaan Jaff bcf7f3e437 handle flaky pytests 2024-08-27 22:44:49 -07:00
Krrish Dholakia 640e5d0dc9 test: fix test 2024-08-27 22:44:29 -07:00
Ishaan Jaff 1ee0e8a9c3 undo chage on config.yaml 2024-08-27 22:24:21 -07:00
Ishaan Jaff 01987388c2 allow running contributor PRs 2024-08-27 22:17:01 -07:00
Ishaan Jaff 3d71e2228f def test_get_bearer_token():
fix
2024-08-27 22:03:54 -07:00
Ishaan Jaff f9c93c3adf skip litellm.Timeout error 2024-08-27 21:32:27 -07:00
Ishaan Jaff e396895288 update doc on palm provider 2024-08-27 21:11:24 -07:00
Ishaan Jaff 1b04380540 fix palm api is deactivated by google 2024-08-27 21:08:49 -07:00
Krrish Dholakia f4fbe75af3 test: fix test 2024-08-27 19:33:14 -07:00
Ishaan Jaff a420c5ba6e fix test_completion_vllm 2024-08-27 18:40:39 -07:00
Ishaan Jaff 647504b462 add test for rerank on custom api base 2024-08-27 18:25:51 -07:00
Ishaan JaffandGitHub be1bc99b60 Merge pull request #5395 from BerriAI/dependabot/npm_and_yarn/docs/my-website/webpack-5.94.0
build(deps): bump webpack from 5.93.0 to 5.94.0 in /docs/my-website
2024-08-27 18:16:36 -07:00
Ishaan Jaff 12693e94f1 docs add tg ai rerank docs 2024-08-27 18:14:40 -07:00
Ishaan Jaff 6ce5ba9694 add rerank on cohere docs 2024-08-27 18:11:42 -07:00
dependabot[bot]andGitHub 491847b15e build(deps): bump webpack from 5.93.0 to 5.94.0 in /docs/my-website
Bumps [webpack](https://github.com/webpack/webpack) from 5.93.0 to 5.94.0.
- [Release notes](https://github.com/webpack/webpack/releases)
- [Commits](https://github.com/webpack/webpack/compare/v5.93.0...v5.94.0)

---
updated-dependencies:
- dependency-name: webpack
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-08-28 01:08:57 +00:00
Ishaan Jaff 218fb5fa34 bump: version 1.44.7 → 1.44.8 2024-08-27 18:07:22 -07:00
Ishaan Jaff a5a17c120b docs add rerank api to docs 2024-08-27 18:06:59 -07:00
Ishaan Jaff afe62c4808 fix linting 2024-08-27 17:53:20 -07:00
Ishaan JaffandGitHub ec7c9768c1 Merge pull request #5394 from BerriAI/litellm_add_rerank_on_proxy
feat - add rerank on litellm proxy / gateway
2024-08-27 17:52:12 -07:00
Ishaan Jaff c27640e6e4 add /rerank test 2024-08-27 17:50:37 -07:00
Krrish Dholakia 834e204c73 test(test_exceptions.py): loosen test 2024-08-27 17:39:53 -07:00
Ishaan Jaff 5f2f7aa754 feat - add rerank on proxy 2024-08-27 17:36:40 -07:00
Ishaan JaffandGitHub 06529f19df Merge pull request #5392 from BerriAI/litellm_add_native_cohere_rerank
[Feat] Add cohere rerank and together ai rerank
2024-08-27 17:29:37 -07:00
Ishaan Jaff fb5be57bb8 v0 add rerank on litellm proxy 2024-08-27 17:28:39 -07:00
Ishaan Jaff 37ed201c50 fix install on 3.8 2024-08-27 17:09:16 -07:00
Krrish Dholakia 5b06ea136c fix(openai.py): fix error re-raising 2024-08-27 17:06:25 -07:00
Ishaan Jaff b3892b871d add async support for rerank 2024-08-27 17:02:48 -07:00
Ishaan Jaff f33dfe0b95 add rerank params 2024-08-27 16:45:39 -07:00
Ishaan Jaff 255ad865cd add rerank api tests 2024-08-27 16:27:55 -07:00
Ishaan Jaff dc42ad0021 add tg ai rerank support 2024-08-27 16:25:54 -07:00
Krrish Dholakia bd3057e495 test(test_proxy_exception_mapping): loosen assert 2024-08-27 16:14:30 -07:00
Krrish Dholakia 6431af0678 fix(bedrock_httpx.py): support 'Auth' header as extra_header
Fixes https://github.com/BerriAI/litellm/issues/5389#issuecomment-2313677977
2024-08-27 16:08:54 -07:00
Ishaan Jaff b8bc185bd5 add main cohere ai rerank handler + test 2024-08-27 15:57:36 -07:00
Ishaan Jaff 3a82334762 add basic cohere rerank 2024-08-27 15:55:43 -07:00
Krrish Dholakia 1b2f73c220 fix(azure_text.py): fix streaming parsing 2024-08-27 15:52:55 -07:00
Ishaan JaffandGitHub 6ab8cbc105 Merge pull request #5391 from BerriAI/litellm_add_ai21_support
[Feat] Add Vertex  AI21 support
2024-08-27 15:06:26 -07:00
Krrish Dholakia d2239e3c52 test(test_router_debug_logs.py): simplify test 2024-08-27 14:47:43 -07:00
Ishaan Jaff 33a3a01949 add mock test for ai21 2024-08-27 14:42:13 -07:00
Krrish Dholakia deff357c92 fix(router.py): fix aembedding type hints
Fixes https://github.com/BerriAI/litellm/issues/5383
2024-08-27 14:29:18 -07:00
Krrish Dholakia b91e5d3887 fix(openai.py): fix post call error logging for aembedding calls 2024-08-27 14:26:06 -07:00
Ishaan Jaff 3dee98dc47 add jamba-1.5 2024-08-27 14:20:06 -07:00
Krrish Dholakia d2464052ec docs(bedrock.md): add doc on passing extra headers + custom api endpoints to bedrock
Closes https://github.com/BerriAI/litellm/issues/5389
2024-08-27 14:18:41 -07:00
Ishaan Jaff 3c8a19e343 use cost per token for jamba 2024-08-27 14:18:04 -07:00