Commit Graph
6804 Commits
Author SHA1 Message Date
Krrish Dholakia 1e5efdfa37 fix(proxy_server.py): support setting tpm/rpm limits per user / per key 2024-01-18 17:03:18 -08:00
Ishaan JaffandGitHub a8ba5df90e Merge pull request #1500 from BerriAI/litellm_create_keys_with_team_id
[Feat] /key/generate - create keys with`team_id`
2024-01-18 16:35:14 -08:00
Jakob 7ba7272a9a add headers to budget manager 2024-01-18 16:10:45 -08:00
Shaun Maher 94b7515a2e Add push to Docker Hub 2024-01-19 11:10:29 +11:00
Shaun Maher 963df31cd6 is "file" not relative to "context"? 2024-01-19 10:41:24 +11:00
Shaun Maher 657d1d85cb Draft: Expand GitHub workflows to also build an OCI image for the Admin UI. 2024-01-19 10:37:27 +11:00
Krrish Dholakia 5dac2402ef test(test_parallel_request_limiter.py): unit testing for tpm/rpm rate limits 2024-01-18 15:28:28 -08:00
Krrish Dholakia 22c3321208 test(test_parallel_request_limiter.py): unit testing for tpm/rpm rate limits 2024-01-18 15:25:29 -08:00
ishaan-jaff 340706565f (fix) add team_id to doc string 2024-01-18 15:23:05 -08:00
ishaan-jaff cdede8836f (docs)virtual keys 2024-01-18 15:16:40 -08:00
ishaan-jaff 0e3e8050d7 (docs) /key/info 2024-01-18 14:54:11 -08:00
ishaan-jaff d5e720e161 (docs) /key/update 2024-01-18 14:45:49 -08:00
ishaan-jaff 2b6972111e (feat) write team_id to User Table 2024-01-18 14:42:46 -08:00
ishaan-jaff 5beef6dbcd (test) setting team_id 2024-01-18 14:33:13 -08:00
Ishaan JaffandGitHub a26267851f Merge pull request #1498 from BerriAI/litellm_spend_tracking_logs
[Feat] Proxy - Add Spend tracking logs
2024-01-18 14:21:51 -08:00
ishaan-jaff f405a827e3 (docs) virtual_keys 2024-01-18 13:55:32 -08:00
ishaan-jaff 90509a159a (fix) write team_id to key table 2024-01-18 13:54:08 -08:00
Krrish Dholakia aef59c554f feat(parallel_request_limiter.py): add support for tpm/rpm limits 2024-01-18 13:52:15 -08:00
ishaan-jaff 42ad12b2bd (fix) support team_id for /key/generate 2024-01-18 13:48:52 -08:00
ishaan-jaff 4294657b99 (fix) use get_logging_payload 2024-01-18 13:40:48 -08:00
ishaan-jaff ea32a8757b (feat) set team_id on virtual_keys 2024-01-18 13:34:51 -08:00
ishaan-jaff 1c987a436e (docs) virtual_keys 2024-01-18 13:34:33 -08:00
ishaan-jaff 7bdf0a0a63 (chore) cleanup utils.py 2024-01-18 13:21:51 -08:00
ishaan-jaff 73938080f2 (feat) track - api_key in spendLogs 2024-01-18 13:16:25 -08:00
Duarte OCandGitHub daa399bc60 adds s3 folder prefix to cache 2024-01-18 21:57:47 +01:00
Krrish Dholakia 2e06e00413 bump: version 1.18.1 → 1.18.2 v1.18.2 2024-01-18 12:42:33 -08:00
Krrish Dholakia 1ea3833ef7 fix(parallel_request_limiter.py): decrement count for failed llm calls
https://github.com/BerriAI/litellm/issues/1477
2024-01-18 12:42:14 -08:00
ishaan-jaff 5b54bcc712 (feat) spendLogs table DynamoDB 2024-01-18 12:39:11 -08:00
ishaan-jaff 4eb9221121 (fix) track EmbeddingResponse cost 2024-01-18 12:29:21 -08:00
ishaan-jaff 88cdfedf84 (feat) track cost streaming 2024-01-18 12:21:56 -08:00
ishaan-jaff b0e18e92b6 (fix) when kwargs==None 2024-01-18 12:05:08 -08:00
ishaan-jaff d14d36af9a (v0 ) working - writing /chat/completion spend tracking 2024-01-18 11:54:15 -08:00
Krrish Dholakia 37e6c6a59f docs(sidebars.js): simplify docs nav 2024-01-18 11:38:02 -08:00
Krrish Dholakia 354a0b2497 docs(sidebar.js): add link to all endpoints in sidebar 2024-01-18 11:21:55 -08:00
Krrish Dholakia c8dd36db9e fix(proxy_server.py): show all models user has access to in /models 2024-01-18 10:56:37 -08:00
ishaan-jaff 4a5f987512 (feat) insert_data to spend table 2024-01-18 10:09:02 -08:00
ishaan-jaff 4821fa9201 (v0) add schema.prisma 2024-01-18 10:04:34 -08:00
Krish DholakiaandGitHub 658fd4de38 Merge pull request #1495 from puffo/litellm_ollama_chat_fix
fix(ollama_chat.py): use tiktoken as backup for prompt token counting
2024-01-18 10:02:27 -08:00
Krrish Dholakia 8873fe9049 fix(router.py): support http and https proxys 2024-01-18 09:58:41 -08:00
Ishaan JaffandGitHub 143e225194 Merge pull request #1496 from BerriAI/litellm_unit_test_key_endpoints
[Test+Fix] /Key/Info, /Key/Update - Litellm unit test key endpoints
2024-01-18 09:55:30 -08:00
ishaan-jaff 08ee65f894 (test) /key/update, /key/info 2024-01-18 09:35:02 -08:00
ishaan-jaff fc1eb36f24 (fix) /key/update overwriting metadata 2024-01-18 09:32:56 -08:00
Krrish Dholakia 96122a4f88 fix(proxy/utils.py): fix isoformat to string logic v1.18.1 2024-01-18 09:32:30 -08:00
Ishaan JaffandGitHub 7db04afaca Merge pull request #1494 from duarteocarmo/patch-1
Update s3 cache to support folder
2024-01-18 09:16:19 -08:00
puffo becff369dc fix(ollama_chat.py): use tiktoken as backup for prompt token counting 2024-01-18 10:47:24 -06:00
Duarte OC 5d0654e6f6 docs 2024-01-18 17:32:42 +01:00
Duarte OC dbadd64395 revert comment 2024-01-18 17:26:38 +01:00
Krrish Dholakia 76af479dea bump: version 1.18.0 → 1.18.1 2024-01-18 07:49:20 -08:00
Krrish Dholakia 71034099c9 fix(proxy/utils.py): prisma client fix get data to handle list return 2024-01-18 07:49:13 -08:00
ishaan-jaff e77782b4d3 (feat) Dockerfile bump langfuse 2024-01-18 07:20:42 -08:00