 ishaan-jaff
|
c10bda3d30
|
(chore) cleanup testing file
|
2024-01-25 16:40:23 -08:00 |
|
|
ishaan-jaff
|
4b15ae41f4
|
(feat) add new OpenAI text-embedding-3
|
2024-01-25 16:40:23 -08:00 |
|
|
ishaan-jaff
|
7e1b9158fe
|
(test) embedding models
|
2024-01-25 16:40:23 -08:00 |
|
|
ishaan-jaff
|
5264a3eb53
|
(fix) do nothing if alerting is not switched on
|
2024-01-25 16:40:23 -08:00 |
|
|
ishaan-jaff
|
1c9b02ad99
|
(fix) alerting debug statements
|
2024-01-25 16:40:23 -08:00 |
|
|
ishaan-jaff
|
b8f917624f
|
(docs) config.yaml
|
2024-01-25 16:40:23 -08:00 |
|
|
ishaan-jaff
|
3a1c8f453f
|
(docs) track max_budget on proxy config.yaml
|
2024-01-25 16:40:23 -08:00 |
|
|
ishaan-jaff
|
229e4920df
|
(fix) better alert message on budgets
|
2024-01-25 16:40:23 -08:00 |
|
|
ishaan-jaff
|
81c528f6ce
|
(fix) raise correct error when proxy crossed budget
|
2024-01-25 16:40:23 -08:00 |
|
|
ishaan-jaff
|
56f49a87ba
|
(fix) raise exception budget_duration is set and max_budget is Not
|
2024-01-25 16:40:23 -08:00 |
|
|
ishaan-jaff
|
7a2a7e047f
|
(feat) slack alerting budgets
|
2024-01-25 16:40:23 -08:00 |
|
|
ishaan-jaff
|
55115a75b0
|
(feat) alerts proxy budgets
|
2024-01-25 16:40:23 -08:00 |
|
|
ishaan-jaff
|
565531fe9e
|
v0 basic structure
|
2024-01-25 16:40:23 -08:00 |
|
|
Krrish Dholakia
|
72275ad8cb
|
fix(main.py): fix logging event loop for async logging but sync streaming
|
2024-01-25 15:59:53 -08:00 |
|
|
Krrish Dholakia
|
bbe6a92eb9
|
fix(main.py): fix order of assembly for streaming chunks
|
2024-01-25 14:51:08 -08:00 |
|
|
Krrish Dholakia
|
09ec6d6458
|
fix(utils.py): fix sagemaker async logging for sync streaming
https://github.com/BerriAI/litellm/issues/1592
|
2024-01-25 12:49:45 -08:00 |
|
|
Krrish Dholakia
|
39d5407e67
|
fix(proxy_server.py): don't set tpm/rpm limits unless set
https://github.com/BerriAI/litellm/issues/1594
|
2024-01-25 09:53:10 -08:00 |
|
|
Krrish Dholakia
|
fdb28407bc
|
docs(custom_pricing.md): fix tutorial
|
2024-01-25 09:36:15 -08:00 |
|
|
Krrish Dholakia
|
01a84837a7
|
docs(vertex.md): add vertex ai proxy tutorial to docs
|
2024-01-25 09:11:11 -08:00 |
|
|
Krrish Dholakia
|
389347250f
|
docs(users.md): add proxy budget to docs
|
2024-01-25 09:04:23 -08:00 |
|
|
ishaan-jaff
|
5b151c8566
|
(ghcr deploy) use platform
v1.19.2
|
2024-01-25 08:43:38 -08:00 |
|
|
Krrish Dholakia
|
7e06944d80
|
test(test_dynamodb_logs.py): skip flaky test
|
2024-01-24 23:18:45 -08:00 |
|
|
Krrish Dholakia
|
34154dde02
|
bump: version 1.19.1 → 1.19.2
|
2024-01-24 22:19:07 -08:00 |
|
|
Krrish Dholakia
|
81846ffdec
|
fix(proxy/utils.py): handle item not existing during batch updates
|
2024-01-24 21:49:47 -08:00 |
|
|
Krrish Dholakia
|
0752048b81
|
fix(dynamo_db.py): fix update bug
|
2024-01-24 21:29:56 -08:00 |
|
|
Krrish Dholakia
|
8e1157fc92
|
test(test_keys.py): reset proxy spend
|
2024-01-24 21:08:09 -08:00 |
|
|
Krrish Dholakia
|
34c4532e7e
|
fix(proxy_server.py): fix handling none value for existing spend object pt.2
|
2024-01-24 20:39:00 -08:00 |
|
|
Krrish Dholakia
|
12b2ad9ed1
|
fix(proxy_server.py): fix handling none value for existing spend object
|
2024-01-24 20:37:56 -08:00 |
|
|
Krish Dholakia
|
fe592aa7ec
|
Merge pull request #1603 from BerriAI/litellm_global_spend_updates
Litellm global spend updates
|
2024-01-24 20:20:27 -08:00 |
|
|
Krish Dholakia
|
6501fdb76e
|
Merge branch 'main' into litellm_global_spend_updates
|
2024-01-24 20:20:15 -08:00 |
|
|
Krrish Dholakia
|
30d615f442
|
build(proxy_server_config.yaml): add proxy budget to default yaml
|
2024-01-24 20:12:03 -08:00 |
|
|
Krrish Dholakia
|
b1864c3d11
|
bump: version 1.19.0 → 1.19.1
|
2024-01-24 20:10:14 -08:00 |
|
|
Krrish Dholakia
|
43f139fafd
|
fix(ollama_chat.py): fix default token counting for ollama chat
|
2024-01-24 20:09:17 -08:00 |
|
|
Krrish Dholakia
|
05b4d49882
|
ci(config.yml): add debug logs
|
2024-01-24 19:54:37 -08:00 |
|
|
ishaan-jaff
|
3e59a02dfb
|
(test) test /key/gen with max_budget=None
|
2024-01-24 19:27:53 -08:00 |
|
|
Ishaan Jaff
|
cf58ecf5c3
|
Merge pull request #1604 from BerriAI/litellm_view_cache_key_in_spend_logs
[Feat] Add cache_key in SpendLogs Table
|
2024-01-24 19:13:13 -08:00 |
|
|
ishaan-jaff
|
6bc715cf85
|
(test) logging cache_key in spendLogs
|
2024-01-24 18:54:23 -08:00 |
|
|
ishaan-jaff
|
2f3765a03f
|
(fix) log cache hits on SpendLogs table
|
2024-01-24 18:51:39 -08:00 |
|
|
ishaan-jaff
|
bf851ef19a
|
(fix) use litellm.cache for getting key
|
2024-01-24 18:34:22 -08:00 |
|
|
ishaan-jaff
|
2130a61b6e
|
(feat) add cache_key in spend_log
|
2024-01-24 17:56:00 -08:00 |
|
|
Krrish Dholakia
|
f148094d18
|
test(test_key_generate_prisma.py): add unit testing for global proxy budget
|
2024-01-24 17:43:01 -08:00 |
|
|
ishaan-jaff
|
d694993703
|
(fix) bug from bb7705b494
v1.19.0
|
2024-01-24 17:34:17 -08:00 |
|
|
ishaan-jaff
|
3305dc75ca
|
(docs) add comments on prisma.schema
|
2024-01-24 17:15:05 -08:00 |
|
|
Krrish Dholakia
|
30a8071bf1
|
fix(proxy_server.py): enforce budget limit if global proxy limit reached
|
2024-01-24 17:11:40 -08:00 |
|
|
Ishaan Jaff
|
45ca7343d0
|
Merge pull request #1601 from BerriAI/litellm_improve_slack_alertign
[Feat] Proxy - Improve Slack Alerting
|
2024-01-24 16:43:23 -08:00 |
|
|
Krrish Dholakia
|
624da17698
|
test(test_users.py): add testing for global proxy spend tracking
|
2024-01-24 16:24:50 -08:00 |
|
|
ishaan-jaff
|
9aae60f162
|
(FIX) improve slack alerting messages
|
2024-01-24 16:07:46 -08:00 |
|
|
Krrish Dholakia
|
574208f005
|
fix(proxy_server.py): track cost for global proxy
|
2024-01-24 16:06:10 -08:00 |
|
|
ishaan-jaff
|
b993c62144
|
(fix) only alert users when requests are hanging
|
2024-01-24 15:58:07 -08:00 |
|
|
Krrish Dholakia
|
ba24037baf
|
bump: version 1.18.13 → 1.19.0
|
2024-01-24 15:30:49 -08:00 |
|