Commit Graph
6132 Commits
Author SHA1 Message Date
Krrish Dholakia 554f1a090d test(test_keys.py): add delay for test check
n
2024-01-25 18:31:07 -08:00
Krrish Dholakia 39aec43b86 test(main.py): adding more logging 2024-01-25 18:15:24 -08:00
Krrish Dholakia 13776b1df7 bump: version 1.19.3 → 1.19.4 2024-01-25 16:40:23 -08:00
Krrish Dholakia 1ae22ea16d refactor: trigger new bump 2024-01-25 16:40:23 -08:00
Krrish Dholakia 014f83c847 fix(main.py): allow vertex ai project and location to be set in completion() call 2024-01-25 16:40:23 -08:00
ishaan-jaffandKrrish Dholakia 5e7c43ebf7 bump: version 1.19.2 → 1.19.3 2024-01-25 16:40:23 -08:00
ishaan-jaffandKrrish Dholakia 8ff00ad8d5 (docs) new gpt-4-0125-preview 2024-01-25 16:40:23 -08:00
ishaan-jaffandKrrish Dholakia e00f46a6e9 (test) gpt-4-0125-preview 2024-01-25 16:40:23 -08:00
ishaan-jaffandKrrish Dholakia c6a6deaa41 (feat) add gpt-4-0125-preview 2024-01-25 16:40:23 -08:00
ishaan-jaffandKrrish Dholakia 53961d641e (docs) new OpenAI embedding models 2024-01-25 16:40:23 -08:00
ishaan-jaffandKrrish Dholakia c10bda3d30 (chore) cleanup testing file 2024-01-25 16:40:23 -08:00
ishaan-jaffandKrrish Dholakia 4b15ae41f4 (feat) add new OpenAI text-embedding-3 2024-01-25 16:40:23 -08:00
ishaan-jaffandKrrish Dholakia 7e1b9158fe (test) embedding models 2024-01-25 16:40:23 -08:00
ishaan-jaffandKrrish Dholakia 5264a3eb53 (fix) do nothing if alerting is not switched on 2024-01-25 16:40:23 -08:00
ishaan-jaffandKrrish Dholakia 1c9b02ad99 (fix) alerting debug statements 2024-01-25 16:40:23 -08:00
ishaan-jaffandKrrish Dholakia b8f917624f (docs) config.yaml 2024-01-25 16:40:23 -08:00
ishaan-jaffandKrrish Dholakia 3a1c8f453f (docs) track max_budget on proxy config.yaml 2024-01-25 16:40:23 -08:00
ishaan-jaffandKrrish Dholakia 229e4920df (fix) better alert message on budgets 2024-01-25 16:40:23 -08:00
ishaan-jaffandKrrish Dholakia 81c528f6ce (fix) raise correct error when proxy crossed budget 2024-01-25 16:40:23 -08:00
ishaan-jaffandKrrish Dholakia 56f49a87ba (fix) raise exception budget_duration is set and max_budget is Not 2024-01-25 16:40:23 -08:00
ishaan-jaffandKrrish Dholakia 7a2a7e047f (feat) slack alerting budgets 2024-01-25 16:40:23 -08:00
ishaan-jaffandKrrish Dholakia 55115a75b0 (feat) alerts proxy budgets 2024-01-25 16:40:23 -08:00
ishaan-jaffandKrrish Dholakia 565531fe9e v0 basic structure 2024-01-25 16:40:23 -08:00
Krrish Dholakia 72275ad8cb fix(main.py): fix logging event loop for async logging but sync streaming 2024-01-25 15:59:53 -08:00
Krrish Dholakia bbe6a92eb9 fix(main.py): fix order of assembly for streaming chunks 2024-01-25 14:51:08 -08:00
Krrish Dholakia 09ec6d6458 fix(utils.py): fix sagemaker async logging for sync streaming
https://github.com/BerriAI/litellm/issues/1592
2024-01-25 12:49:45 -08:00
Krrish Dholakia 39d5407e67 fix(proxy_server.py): don't set tpm/rpm limits unless set
https://github.com/BerriAI/litellm/issues/1594
2024-01-25 09:53:10 -08:00
Krrish Dholakia fdb28407bc docs(custom_pricing.md): fix tutorial 2024-01-25 09:36:15 -08:00
Krrish Dholakia 01a84837a7 docs(vertex.md): add vertex ai proxy tutorial to docs 2024-01-25 09:11:11 -08:00
Krrish Dholakia 389347250f docs(users.md): add proxy budget to docs 2024-01-25 09:04:23 -08:00
ishaan-jaff 5b151c8566 (ghcr deploy) use platform v1.19.2 2024-01-25 08:43:38 -08:00
Krrish Dholakia 7e06944d80 test(test_dynamodb_logs.py): skip flaky test 2024-01-24 23:18:45 -08:00
Krrish Dholakia 34154dde02 bump: version 1.19.1 → 1.19.2 2024-01-24 22:19:07 -08:00
Krrish Dholakia 81846ffdec fix(proxy/utils.py): handle item not existing during batch updates 2024-01-24 21:49:47 -08:00
Krrish Dholakia 0752048b81 fix(dynamo_db.py): fix update bug 2024-01-24 21:29:56 -08:00
Krrish Dholakia 8e1157fc92 test(test_keys.py): reset proxy spend 2024-01-24 21:08:09 -08:00
Krrish Dholakia 34c4532e7e fix(proxy_server.py): fix handling none value for existing spend object pt.2 2024-01-24 20:39:00 -08:00
Krrish Dholakia 12b2ad9ed1 fix(proxy_server.py): fix handling none value for existing spend object 2024-01-24 20:37:56 -08:00
Krish DholakiaandGitHub fe592aa7ec Merge pull request #1603 from BerriAI/litellm_global_spend_updates
Litellm global spend updates
2024-01-24 20:20:27 -08:00
Krish DholakiaandGitHub 6501fdb76e Merge branch 'main' into litellm_global_spend_updates 2024-01-24 20:20:15 -08:00
Krrish Dholakia 30d615f442 build(proxy_server_config.yaml): add proxy budget to default yaml 2024-01-24 20:12:03 -08:00
Krrish Dholakia b1864c3d11 bump: version 1.19.0 → 1.19.1 2024-01-24 20:10:14 -08:00
Krrish Dholakia 43f139fafd fix(ollama_chat.py): fix default token counting for ollama chat 2024-01-24 20:09:17 -08:00
Krrish Dholakia 05b4d49882 ci(config.yml): add debug logs 2024-01-24 19:54:37 -08:00
ishaan-jaff 3e59a02dfb (test) test /key/gen with max_budget=None 2024-01-24 19:27:53 -08:00
Ishaan JaffandGitHub cf58ecf5c3 Merge pull request #1604 from BerriAI/litellm_view_cache_key_in_spend_logs
[Feat] Add cache_key in SpendLogs Table
2024-01-24 19:13:13 -08:00
ishaan-jaff 6bc715cf85 (test) logging cache_key in spendLogs 2024-01-24 18:54:23 -08:00
ishaan-jaff 2f3765a03f (fix) log cache hits on SpendLogs table 2024-01-24 18:51:39 -08:00
ishaan-jaff bf851ef19a (fix) use litellm.cache for getting key 2024-01-24 18:34:22 -08:00
ishaan-jaff 2130a61b6e (feat) add cache_key in spend_log 2024-01-24 17:56:00 -08:00