Commit Graph
6761 Commits
Author SHA1 Message Date
ishaan-jaff c4e73768cf (fix) add redisvl==0.0.7 2024-02-06 09:30:45 -08:00
ishaan-jaff 70a895329e (feat) working semantic cache on proxy 2024-02-06 08:55:25 -08:00
ishaan-jaff a3b1e3bc84 (feat) redis-semantic cache 2024-02-06 08:54:36 -08:00
ishaan-jaff 6249a97098 (feat) working semantic-cache on litellm proxy 2024-02-06 08:52:57 -08:00
ishaan-jaff a125ffe190 (test) async semantic cache 2024-02-06 08:14:54 -08:00
ishaan-jaff 76def20ffe (feat) RedisSemanticCache - async 2024-02-06 08:13:12 -08:00
ishaan-jaff ccc94128d3 (fix) semantic cache 2024-02-05 18:25:22 -08:00
ishaan-jaff 81f8ac00b2 (test) semantic caching 2024-02-05 18:22:50 -08:00
ishaan-jaff cf4bd1cf4e (test) semantic cache 2024-02-05 17:58:32 -08:00
ishaan-jaff 1b39454a08 (feat) working - sync semantic caching 2024-02-05 17:58:12 -08:00
ishaan-jaff d4a799a3ca (feat )add semantic cache 2024-02-05 12:28:21 -08:00
Krish DholakiaandGitHub 646764f1d4 Merge pull request #1826 from promptmetheus/update-perplexity-model-info
Update Perplexity models in model_prices_and_context_window.json
2024-02-05 08:53:16 -08:00
Krrish Dholakia 031bc96f88 bump: version 1.22.3 → 1.22.4 2024-02-05 08:47:10 -08:00
Krrish Dholakia 1bdb332454 fix(utils.py): handle count response tokens false case token counting 2024-02-05 08:47:10 -08:00
Toni EngelhardtandGitHub e832492423 Update Perplexity models in model_prices_and_context_window.json
According to https://docs.perplexity.ai/docs/model-cards
2024-02-05 16:46:10 +00:00
Ishaan JaffandGitHub 109ccf4cef Merge pull request #1602 from ShaunMaher/add_helm_chart
Add a Helm chart for deploying LiteLLM Proxy
2024-02-05 08:12:58 -08:00
Ishaan JaffandGitHub 14c9e239a1 Merge pull request #1750 from vanpelt/patch-2
Re-raise exception in async ollama streaming
2024-02-05 08:12:17 -08:00
Krrish Dholakia d1f9165af1 bump: version 1.22.2 → 1.22.3 v1.22.3 2024-02-03 22:23:43 -08:00
Krish DholakiaandGitHub 640572647a Merge pull request #1805 from BerriAI/litellm_cost_tracking_image_gen
feat(utils.py): support cost tracking for openai/azure image gen models
2024-02-03 22:23:22 -08:00
Krrish Dholakia 49b2dc4180 test(test_completion_cost.py): fix test 2024-02-03 22:00:49 -08:00
Krrish Dholakia 66565f96b1 test(test_completion.py): fix test 2024-02-03 21:44:57 -08:00
Krrish Dholakia d2d57ecf1c test(test_parallel_request_limiter.py): fix test 2024-02-03 21:31:29 -08:00
Krrish Dholakia 3a19c8b600 test(test_completion.py): fix test 2024-02-03 21:30:45 -08:00
Krish DholakiaandGitHub 7ee5d2e0d9 Update model_prices_and_context_window.json v1.22.2 2024-02-03 21:12:26 -08:00
Krish DholakiaandGitHub 6eed51607a Update model_prices_and_context_window.json 2024-02-03 21:09:00 -08:00
Krish DholakiaandGitHub 28df60b609 Merge pull request #1809 from BerriAI/litellm_embedding_caching_updates
Support caching individual items in embedding list (Async embedding only)
2024-02-03 21:04:23 -08:00
ishaan-jaff c353161456 (fix) test_parallel limiter fix 2024-02-03 21:03:15 -08:00
Ishaan JaffandGitHub 24aa304061 Update README.md 2024-02-03 20:54:14 -08:00
Ishaan JaffandGitHub 254a5e8533 Update README.md 2024-02-03 20:51:43 -08:00
Ishaan JaffandGitHub fc8811a5e7 Update ghcr_deploy.yml 2024-02-03 20:50:18 -08:00
ishaan-jaff 7e43d22da4 (docs) update ui 2024-02-03 20:43:43 -08:00
Ishaan JaffandGitHub f3ec2efa21 Update README.md 2024-02-03 20:40:10 -08:00
Krrish Dholakia 3e35041758 test(test_parallel_request_limiter.py): fix test to handle minute changes 2024-02-03 20:39:31 -08:00
ishaan-jaff 1155025e6a (ci/cd) run again 2024-02-03 20:36:35 -08:00
Krrish Dholakia b47b2837eb test(test_parallel_request_limiter.py): fix test 2024-02-03 20:34:05 -08:00
Krrish Dholakia 10822ded76 bump: version 1.22.1 → 1.22.2 2024-02-03 20:23:55 -08:00
Krrish Dholakia 312c7462c8 refactor(ollama.py): trigger rebuild 2024-02-03 20:23:43 -08:00
Krrish Dholakia 01cef1fe9e fix(ollama.py): fix api connection error
https://github.com/BerriAI/litellm/issues/1735
2024-02-03 20:22:33 -08:00
ishaan-jaff dc506e3df1 bump: version 1.22.0 → 1.22.1 2024-02-03 20:01:05 -08:00
ishaan-jaff 774cbbde52 (test) tgai is unstable 2024-02-03 20:00:40 -08:00
Krrish Dholakia 25a0e15727 fix(utils.py): support time based pricing for openai-compatible together ai 2024-02-03 19:59:32 -08:00
Krrish Dholakia efb6123d28 fix(utils.py): support get_secret("TOGETHER_AI_TOKEN") 2024-02-03 19:35:09 -08:00
Krrish Dholakia c49c88c8e5 fix(utils.py): route together ai calls to openai client
together ai is now openai-compatible

n
2024-02-03 19:22:48 -08:00
Krrish Dholakia c2f674ebe0 fix(utils.py): fix conditional check 2024-02-03 18:58:58 -08:00
ishaan-jaff c6aadcbd34 (feat) new ui build 2024-02-03 18:53:05 -08:00
ishaan-jaff 650fa0e0ff (ui) fix build issues 2024-02-03 18:37:50 -08:00
ishaan-jaff c26892d201 (ui) fix button color 2024-02-03 18:37:13 -08:00
ishaan-jaff bc3b0eec07 (ui) use indigo theme 2024-02-03 18:35:32 -08:00
Krish DholakiaandGitHub 9ab59045a3 Merge branch 'main' into litellm_embedding_caching_updates 2024-02-03 18:08:47 -08:00
ishaan-jaff 9cdf4a5aa8 (fix) ui - npm run build fix 2024-02-03 18:03:34 -08:00