Commit Graph
11296 Commits
Author SHA1 Message Date
Ishaan Jaff e1f94fcbbb test batch completions on litellm proxy 2024-05-11 13:32:30 -07:00
Ishaan Jaff 31cb1be279 edit dev config.yaml 2024-05-11 13:24:59 -07:00
Ishaan Jaff b8c7bbcb9f support batch /chat/completions on proxy 2024-05-11 13:24:25 -07:00
Ishaan Jaff 6561e0838e test - router.batch_acompletion 2024-05-11 13:09:17 -07:00
Ishaan Jaff 9156b7448a feat - router async batch acompletion 2024-05-11 13:08:16 -07:00
Krrish Dholakia c12af219af fix: fix linting 2024-05-10 20:23:33 -07:00
Krrish Dholakia cd1a470b9a refactor(main.py): trigger new build 2024-05-10 20:17:39 -07:00
Krrish Dholakia 6f2fb7f340 ci(config.yml): add google protobuf stubs v1.37.3-stable 2024-05-10 20:16:44 -07:00
Krrish Dholakia 7a45c613a4 bump: version 1.37.3 → 1.37.4 2024-05-10 20:07:31 -07:00
Krrish Dholakia 94f3d361b0 fix(vertex_ai.py): fix list tool call responses
Closes https://github.com/BerriAI/litellm/issues/3147
2024-05-10 20:05:58 -07:00
Krish DholakiaandGitHub 363cdb1a0c Merge pull request #3576 from BerriAI/litellm_langfuse_fix
fix(langfuse.py): fix logging user_id in trace param on new trace creation
v1.37.3
2024-05-10 19:27:34 -07:00
Ishaan Jaff 2c4604d90f (ci/cd) run again 2024-05-10 19:22:13 -07:00
Ishaan Jaff 5874a1675b bump: version 1.37.2 → 1.37.3 2024-05-10 19:20:57 -07:00
Ishaan JaffandGitHub b09075da53 Merge pull request #3577 from BerriAI/litellm_add_triton_server
[Feat] Add Triton Embeddings to LiteLLM
2024-05-10 19:20:23 -07:00
Ishaan Jaff ed2c05d10d fix triton params 2024-05-10 19:14:48 -07:00
Ishaan Jaff b913620997 docs triton embeddings support 2024-05-10 19:08:15 -07:00
Ishaan Jaff d3550379b0 feat - triton embeddings 2024-05-10 18:57:06 -07:00
Ishaan Jaff 0cde9473c9 test triton embeddings 2024-05-10 18:50:34 -07:00
Ishaan Jaff 18ed87edc4 add triton embedding to _init 2024-05-10 18:46:25 -07:00
Krrish Dholakia 0115c79222 fix(langfuse.py): fix logging user_id in trace param on new trace creation
Closes https://github.com/BerriAI/litellm/issues/3560
2024-05-10 18:25:07 -07:00
Krish DholakiaandGitHub 1aa567f3b5 Merge pull request #3571 from BerriAI/litellm_hf_classifier_support
Huggingface classifier support
2024-05-10 17:54:27 -07:00
Krish DholakiaandGitHub 69068f9577 Merge pull request #3572 from powerhouseofthecell/feature/enforce-unique-key-and-team-aliases
enforce unique key and team aliases in the ui
2024-05-10 17:53:26 -07:00
Ishaan JaffandGitHub 2c0c9e1fa4 Merge pull request #3573 from BerriAI/litellm_team_based_failure_callback
[Feat] Use Team based callbacks with litellm.failure_callbacks
2024-05-10 17:53:15 -07:00
Ishaan Jaff 1d25be0ca8 fix langfuse logger re-initialized on all failure callbacks 2024-05-10 17:48:44 -07:00
Ishaan Jaff a4695c3010 test - using langfuse as a failure callback 2024-05-10 17:37:32 -07:00
Ishaan Jaff 4584989a31 fix - langfuse copy metadata 2024-05-10 17:33:29 -07:00
Ishaan Jaff ce8523808b fix langfuse failure logging 2024-05-10 17:02:38 -07:00
Ishaan JaffandGitHub db0db5c62c Merge pull request #3570 from BerriAI/litellm_test_model_openai_client
[Test] Proxy - uses the same OpenAI Client after 1 min
2024-05-10 16:54:45 -07:00
Ishaan JaffandGitHub e3848abdfe Merge pull request #3569 from BerriAI/litellm_fix_bug_upsert_deployments
[Fix] Upsert deployment bug
2024-05-10 16:53:59 -07:00
Ishaan Jaff 92b86056cf fix langfuse team based logging tests 2024-05-10 16:39:49 -07:00
Ishaan Jaff 53f9d8280f fix - support dynamic failure callbacks 2024-05-10 16:37:01 -07:00
Ishaan Jaff 1a8e853817 (ci/cd) run again 2024-05-10 16:19:03 -07:00
Ishaan Jaff b6e0f00ed8 fix - using failure callbacks with team based logging 2024-05-10 16:18:13 -07:00
Ishaan Jaff 7d96272d52 fix auto inferring region 2024-05-10 16:08:05 -07:00
Krrish Dholakia 30d2df8940 docs(enterprise.md): add aws marketplace notice on docs 2024-05-10 15:54:29 -07:00
Krrish Dholakia 6a400a6200 test: fix test 2024-05-10 15:49:20 -07:00
Nick Wong 759ff3f750 added code to enforce unique key and team aliases in the ui 2024-05-10 15:42:07 -07:00
Krrish Dholakia 500995696a test: fix linting 2024-05-10 14:42:06 -07:00
Krrish Dholakia d4d175030f docs(huggingface.md): add text-classification to huggingface docs 2024-05-10 14:39:14 -07:00
Krrish Dholakia 50be25d11a test(test_optional_params.py): fix optional params 2024-05-10 14:08:47 -07:00
Ishaan Jaff c744851d13 fix AUTO_INFER_REGION 2024-05-10 14:08:38 -07:00
Krrish Dholakia c17f221b89 test(test_completion.py): reintegrate testing for huggingface tgi + non-tgi 2024-05-10 14:07:01 -07:00
Ishaan Jaff 9bbb13c373 fix bug upsert_deployment 2024-05-10 13:54:52 -07:00
Ishaan Jaff 933f8ed16b fix - proxy_server.py 2024-05-10 13:47:35 -07:00
Ishaan Jaff 414af64343 test - OpenAI client is re-used for Azure, OpenAI 2024-05-10 13:43:19 -07:00
Ishaan Jaff 5c69515a13 fix - upsert_deployment logic 2024-05-10 13:41:51 -07:00
Ishaan Jaff 547976448f fix feature flag logic 2024-05-10 12:50:46 -07:00
Ishaan Jaff 75d6658bbc fix - explain why behind feature flag 2024-05-10 12:39:19 -07:00
Ishaan Jaff 6fd6490d63 fix hide - _auto_infer_region behind a feature flag 2024-05-10 12:38:06 -07:00
Ishaan Jaff 9d3f01c6ae fix - router add model logic 2024-05-10 12:32:16 -07:00