Commit Graph
12286 Commits
Author SHA1 Message Date
Ishaan JaffandGitHub 098df3dcd6 Merge pull request #3901 from BerriAI/admin_ui_add_logout_sso
[Feat] Implement Logout Admin UI
2024-05-29 14:36:12 -07:00
Ishaan Jaff 9ae6eb1388 feat - implement logout sso 2024-05-29 14:19:31 -07:00
Ishaan JaffandGitHub 56233e6819 Merge pull request #3900 from BerriAI/revert-3895-litellm_triton_chatcompletion_support
Revert "Added support for Triton chat completion using trtlllm generate endpo…"
2024-05-29 13:42:59 -07:00
Ishaan JaffandGitHub 99e506525c Revert "Added support for Triton chat completion using trtlllm generate endpo…" 2024-05-29 13:42:49 -07:00
Ishaan JaffandGitHub e8c1e87ac9 Merge pull request #3895 from giritatavarty-8451/litellm_triton_chatcompletion_support
Added support for Triton chat completion using trtlllm generate endpo…
2024-05-29 12:50:31 -07:00
Krish DholakiaandGitHub c76deb8f76 Merge pull request #3846 from nirga/revert-3831-revert-3780-traceloop-failures
fix: Log errors in Traceloop Integration (reverts previous revert)
2024-05-29 08:54:01 -07:00
Ishaan Jaff dc8480a5e9 test_batch_completion_multiple_models_multiple_messages 2024-05-28 22:54:54 -07:00
Krrish Dholakia 19551efdd3 bump: version 1.39.1 → 1.39.2 v1.39.2 2024-05-28 22:39:25 -07:00
Krish DholakiaandGitHub 0114207b2e Merge pull request #3887 from BerriAI/litellm_batch_completions
feat(router.py): support fastest response batch completion call
2024-05-28 22:38:12 -07:00
Krish DholakiaandGitHub e838bd1c79 Merge branch 'main' into litellm_batch_completions 2024-05-28 22:38:05 -07:00
Ishaan JaffandGitHub 6e9cc26ca1 Merge pull request #3888 from BerriAI/litellm_add_files_proxy
[Feat] LiteLLM Proxy Add `POST /v1/files` and `GET /v1/files`
2024-05-28 22:36:33 -07:00
Ishaan Jaff 7671a65f1b bump: version 1.39.0 → 1.39.1 2024-05-28 22:35:00 -07:00
Ishaan JaffandGitHub 1b53a1e98d Merge pull request #3889 from BerriAI/litellm_router_batch_n_models_m_messages
feat - router add abatch_completion - N Models, M Messages
2024-05-28 22:29:34 -07:00
Ishaan Jaff 9ab96e12ed fix - update abatch_completion docstring 2024-05-28 22:27:09 -07:00
Ishaan Jaff 473ec66b84 feat - router add abatch_completion 2024-05-28 22:19:33 -07:00
Krrish Dholakia 3db30ecb4c docs(batching.md): add batch completion fastest response on proxy to docs 2024-05-28 22:14:22 -07:00
Krrish Dholakia 2ee599b848 docs(batching.md): add batch completion to docs 2024-05-28 22:08:06 -07:00
Krrish Dholakia e3000504f9 fix(router.py): support batch completions fastest response streaming 2024-05-28 21:51:09 -07:00
Krrish Dholakia f168e35629 build(config.yml): add pillow to ci/cd 2024-05-28 21:39:09 -07:00
Krrish Dholakia 1ebae6e7b0 fix(router.py): support comma-separated model list for batch completion fastest response 2024-05-28 21:34:37 -07:00
Ishaan Jaff ca8163bbba feat - add afile_content, file_content 2024-05-28 20:58:22 -07:00
Krrish Dholakia 20106715d5 feat(proxy_server.py): enable batch completion fastest response calls on proxy
introduces new `fastest_response` flag for enabling the call
2024-05-28 20:09:31 -07:00
Ishaan Jaff 37e18a42fc feat - add file endpoints proxy 2024-05-28 20:03:13 -07:00
Krrish Dholakia ecd182eb6a feat(router.py): support fastest response batch completion call
returns fastest response. cancels others.
2024-05-28 19:44:41 -07:00
Ishaan JaffandGitHub 6bf6059b3e Merge pull request #3882 from BerriAI/litellm_add_batches_sdk
[BETA-Feature] Add OpenAI `v1/batches` Support on LiteLLM SDK
2024-05-28 19:38:12 -07:00
Krish DholakiaandGitHub 9e88a2cabb Merge pull request #3886 from BerriAI/litellm_time_to_first_token_2
feat(proxy_server.py): Time to first token Request-level breakdown
2024-05-28 18:36:57 -07:00
Krrish Dholakia bffa79a8c5 feat(proxy_server.py): give request-level breakdown if ttft metric is selected for ju
st that day
2024-05-28 18:09:22 -07:00
Ishaan Jaff 0020672c19 fear support GET /v1/batches{batch_id} 2024-05-28 17:58:34 -07:00
Ishaan Jaff c2e24b4ed8 feat add v1/batches 2024-05-28 17:49:36 -07:00
Ishaan Jaff 37d350b466 add batches, files to routes 2024-05-28 17:39:17 -07:00
Ishaan Jaff 5e9d024c2c fix - test openai batches 2024-05-28 17:29:13 -07:00
Krrish Dholakia 3558f06de2 fix(model_dashboard.tsx): fix adding model on ui 2024-05-28 17:29:02 -07:00
Ishaan Jaff 215f19440c fix python3.8 error 2024-05-28 17:25:08 -07:00
Ishaan Jaff c6eb004ed1 fix python 3.8 error 2024-05-28 17:21:59 -07:00
Krish DholakiaandGitHub b5c89a249a Merge pull request #3883 from BerriAI/litellm_anthropic_parallel_streaming_fix
fix(anthropic.py): fix parallel streaming on anthropic.py
2024-05-28 17:21:57 -07:00
Ishaan Jaff 6688215c18 feat - add aretrieve_batch 2024-05-28 17:12:41 -07:00
Ishaan Jaff 1ef7cd923c feat - add acreate_batch 2024-05-28 17:03:29 -07:00
Ishaan Jaff 758ed9e923 feat - add litellm.acreate_file 2024-05-28 16:47:27 -07:00
Krrish Dholakia 324bf027f5 fix(anthropic.py): fix parallel streaming on anthropic.py
prevent parallel requests from cancelling each other

Fixes https://github.com/BerriAI/litellm/issues/3881
2024-05-28 16:29:09 -07:00
Ishaan Jaff 938f4703c3 feat- add retrieve_batch() 2024-05-28 15:55:32 -07:00
Ishaan Jaff 38285e53c3 working create_batch 2024-05-28 15:45:23 -07:00
Ishaan Jaff d5dbf084ed feat - import batches in __init__ 2024-05-28 15:35:11 -07:00
Ishaan Jaff 0af4c9206f test - openai batches file 2024-05-28 14:54:58 -07:00
Ishaan Jaff b9515c3b96 feat - add batches types 2024-05-28 12:53:46 -07:00
Krish DholakiaandGitHub 77e9008eb0 Merge pull request #2888 from rick-github/ollama-image-handling
Update ollama.py for image handling
2024-05-28 10:25:06 -07:00
Ishaan Jaff 6a6f163d51 ui - mount 2024-05-28 08:55:01 -07:00
Ishaan Jaff ddd0005ed1 bump: version 1.38.12 → 1.39.0 2024-05-28 08:15:37 -07:00
Ishaan Jaff e6789a0150 fix app mounting ui v1.38.12 2024-05-28 08:14:15 -07:00
Ishaan Jaff 83d381bdb2 ui - new build, release 2024-05-28 08:10:34 -07:00
Ishaan Jaff cea10e21e7 bump: version 1.38.11 → 1.38.12 2024-05-28 08:10:34 -07:00