Commit Graph
8747 Commits
Author SHA1 Message Date
Ishaan Jaff fe200cfb07 (fix) re-include deployment.yaml 2024-03-16 10:51:32 -07:00
Ishaan JaffandGitHub e3523561f8 Merge pull request #2145 from ShaunMaher/update_helm_chart_deployment_2024-02-22
Update helm chart to accomodate recent project changes
2024-03-16 10:50:40 -07:00
Ishaan Jaff 14215ad52a Merge branch 'update_helm_chart_deployment_2024-02-22' of https://github.com/ShaunMaher/litellm into pr/2145 2024-03-16 10:50:10 -07:00
Ishaan Jaff 73a95e0d25 (fix) ghcr_deploy.yaml 2024-03-16 10:48:02 -07:00
Shaun MaherandIshaan Jaff 5e4b0d1f5a Don't fail if there is no existing helm chart to get the version from 2024-03-16 10:47:43 -07:00
Shaun MaherandIshaan Jaff f52f1f40e6 Remove --run_gunicorn from proxy command line arguments 2024-03-16 10:47:25 -07:00
Shaun MaherandIshaan Jaff c838b2853c Copy helm chart build and deploy job from ghcr_helm_deploy to ghcr_deploy. 2024-03-16 10:47:16 -07:00
Ishaan Jaff 4436cdc621 (fix) ghcr_deploy.yaml 2024-03-16 10:41:44 -07:00
Ishaan Jaff 5665234b86 (fix) rename chart 2024-03-16 10:40:49 -07:00
Krrish Dholakia 48f96dd563 fix(caching.py): close redis connection pool upon proxy shutdown 2024-03-16 10:39:58 -07:00
ishaan-jaff a8ad99cf76 (fix) deploy litellm helm 2024-03-16 10:15:38 -07:00
ishaan-jaff 01aa7b3e6e (fix) deploy litellm-helm 2024-03-16 10:10:47 -07:00
ishaan-jaff 54dceea4b0 (fix) releasing litellm helm as "litellm-helm" 2024-03-16 10:06:14 -07:00
ishaan-jaff 919fe14257 (fix) release helm chart as litellm-helm 2024-03-16 10:03:29 -07:00
Krish DholakiaandGitHub c1495c0d1c Merge pull request #2527 from lazyhope/support_anthropic_function_result
Add function call result submission support for Claude 3 models
2024-03-16 09:58:33 -07:00
Krish DholakiaandGitHub 0368a335e6 Merge branch 'main' into support_anthropic_function_result 2024-03-16 09:58:08 -07:00
ishaan-jaff 5a87ac8047 (feat) publish litellm helm charts 2024-03-16 09:53:41 -07:00
ishaan-jaff 177571bea3 (fix) backoff import 2024-03-16 08:53:06 -07:00
Krrish Dholakia 2d2731c3b5 docs(caching.md): add batch redis requests to docs 2024-03-15 23:01:08 -07:00
Krish DholakiaandGitHub f3cf1ec71f Update proxy_server_config.yaml 2024-03-15 22:40:39 -07:00
Krish DholakiaandGitHub 24e673dd6d Update proxy_server_config.yaml 2024-03-15 22:19:37 -07:00
ishaan-jaff 2d7ca36ec4 (fix) errant print saying "Error importing .." msg 2024-03-15 21:47:52 -07:00
Krish DholakiaandGitHub 88152c77c5 Update Dockerfile 2024-03-15 21:47:13 -07:00
Krish DholakiaandGitHub 961c3548f5 Update proxy_server_config.yaml v1.31.16 2024-03-15 19:06:06 -07:00
Krrish Dholakia a12e55932e bump: version 1.31.15 → 1.31.16 2024-03-15 19:03:15 -07:00
Krish DholakiaandGitHub 4969ae0e9d Merge pull request #2542 from BerriAI/litellm_redis_perf_improvements
89% Caching improvement - Async Redis completion calls + batch redis GET requests for a given key + call type
2024-03-15 18:58:36 -07:00
Krrish Dholakia 909341c4f2 fix(utils.py): async add to cache - for streaming 2024-03-15 18:25:40 -07:00
Krrish Dholakia 4912ad5cf4 test(test_custom_logger.py): fix async streaming test 2024-03-15 18:18:54 -07:00
Krrish Dholakia 3072137739 test(test_caching.py): fix async tests 2024-03-15 18:09:25 -07:00
ishaan-jaff 92b198f6c5 (docs) litellm + helm chart 2024-03-15 17:04:51 -07:00
Ishaan JaffandGitHub 8cfa0b64ce Merge pull request #2541 from udit-001/docs/chatlitellm-langfuse
docs(langfuse): add chatlitellm section
latest test
2024-03-15 16:32:01 -07:00
Ishaan JaffandGitHub 5169fe9836 Merge pull request #2544 from BerriAI/litellm_helm_chart_fixes
[Docs+Fixes] Litellm helm chart use k8 1.21
2024-03-15 16:30:38 -07:00
ishaan-jaff d24eb263f2 (ci/cd) dispatch to run load test 2024-03-15 16:27:47 -07:00
ishaan-jaff a2a6c474e0 (ci/cd) dispatch to run load test 2024-03-15 16:27:34 -07:00
ishaan-jaff 974d654189 (fix) clean up litellm helm chart 2024-03-15 16:20:41 -07:00
ishaan-jaff 3108c91ebd (docs) using litellm + helm charts 2024-03-15 16:20:26 -07:00
ishaan-jaff fb4fa5af72 (docs) using litellm helm 2024-03-15 16:09:27 -07:00
ishaan-jaff 4a33c53619 (fix) docs litellm helm chart 2024-03-15 16:07:43 -07:00
Ishaan JaffandGitHub eb071d8101 Merge pull request #2540 from BerriAI/litellm_fix_error_message_on_bad_key
(fix) Proxy - fix error message raised on passing invalid tokens
v1.31.15
2024-03-15 15:49:39 -07:00
ishaan-jaff 21202a397f (ci/cd) final working load test / benchmark 2024-03-15 15:46:59 -07:00
ishaan-jaff 0552679a58 (ci/cd) load test 2024-03-15 15:30:53 -07:00
ishaan-jaff 06e319fceb (ci/cd) run load test 2024-03-15 15:25:33 -07:00
ishaan-jaff a98c5fdbeb (ci/cd) load test 2024-03-15 15:14:26 -07:00
Udit 4a232f4ab3 docs(langfuse): update langfuse casing 2024-03-16 03:34:47 +05:30
Udit b8dbcd7ac3 docs(langfuse): update section titles 2024-03-16 03:33:14 +05:30
Udit 31fb2d0219 docs(langfuse): fix missing litellm import 2024-03-16 03:30:01 +05:30
Udit 1220eb3c7a docs(langfuse): update chatlitellm section 2024-03-16 03:28:19 +05:30
ishaan-jaff 4153b74157 (fix) run load test on new releases, workflow dispatches 2024-03-15 14:56:49 -07:00
ishaan-jaff 82b8fbabcb (fix) run prod load tests for 5 mins 2024-03-15 14:55:26 -07:00
Krrish Dholakia 8a20ea795b feat(batch_redis_get.py): batch redis GET requests for a given key + call type
reduces number of redis requests. 85ms latency improvement over 3 minutes of load (19k requests).
2024-03-15 14:54:16 -07:00