Commit Graph
6804 Commits
Author SHA1 Message Date
ishaan-jaff fffb077cf6 (test) get optional_params Azure 2024-01-13 14:32:41 -08:00
ishaan-jaff 79ad63009e (feat) support extra body for Azure, OpenAI 2024-01-13 14:32:11 -08:00
ishaan-jaff 406fbe4272 bump: version 1.17.4 → 1.17.5 v1.17.5 2024-01-13 14:02:56 -08:00
Ishaan JaffandGitHub 0119b0ae12 Merge pull request #1439 from BerriAI/litellm_fix_completion_cost
[Feat] Improve litellm.completion cost
2024-01-14 02:42:48 +05:30
ishaan-jaff 6bae534968 (fix) check if custom_llm_provider is not None 2024-01-13 12:54:03 -08:00
ishaan-jaff f62dbd0e08 (test) litellm.completion_cost mistral, anyscale 2024-01-13 12:35:09 -08:00
ishaan-jaff 53fd62b0cd (feat) use custom_llm_provider in completion_cost 2024-01-13 12:29:51 -08:00
ishaan-jaff 70426cad76 (fix) run prisma_setup on startup event 2024-01-13 12:06:23 -08:00
ishaan-jaff 4b3e9c6b38 (ci/cd) run testing again 2024-01-13 11:50:43 -08:00
ishaan-jaff 8d3ca785ae (fix) proxy only import dynamo_db when it's being used 2024-01-13 11:43:50 -08:00
ishaan-jaff b931841e60 (fix) dynamoDB import issues 2024-01-13 11:38:42 -08:00
Ishaan JaffandGitHub 7fc8ccf854 Merge pull request #1432 from BerriAI/litellm_set_hiden_params_custom_llm_provider
Set custom_llm_provider in ModelResponse hidden params
2024-01-14 01:00:49 +05:30
ishaan-jaff 61dff3decb (fix) gunicorn - show request logs like uvicorn 2024-01-13 11:22:16 -08:00
ishaan-jaff f3d25d2c27 (test) hidden params in stream_chunk builder 2024-01-13 11:10:23 -08:00
ishaan-jaff 485f469518 (feat) set custom_llm_provider in stream chunk builder 2024-01-13 11:09:22 -08:00
Krrish Dholakia 3d7c169a58 fix(proxy_cli.py): only run prisma db push if prisma in environment 2024-01-13 19:44:12 +05:30
Krrish Dholakia 8a7a745549 Merge branch 'litellm_dynamo_db_keys' 2024-01-13 18:38:43 +05:30
Krrish Dholakia be1ebe36a1 fix(dynamo_db.py): allow user to specify table names 2024-01-13 18:35:19 +05:30
Krrish Dholakia 3c02ad8b95 fix(utils.py): exclude s3 caching from individual item caching for embedding list
can't bulk upload to s3, so this will slow down calls

https://github.com/BerriAI/litellm/pull/1417
2024-01-13 16:19:30 +05:30
Krrish Dholakia fb53d18d6a refactor(main.py): trigger rebuild 2024-01-13 15:55:56 +05:30
Krrish Dholakia 40c952f7c2 fix(caching.py): fix async in-memory caching 2024-01-13 15:33:57 +05:30
Krrish Dholakia 7f83cca62c fix(caching.py): return updated kwargs from get_cache helper function 2024-01-13 15:04:34 +05:30
Krrish Dholakia ebf1bc842c fix(conftest.py): create an event loop if one isn't made 2024-01-13 14:23:04 +05:30
Krrish Dholakia 3789b37e97 test(conftest.py): create an event loop if one doesn't exist 2024-01-13 14:21:24 +05:30
Krrish Dholakia c43a141889 fix(caching.py): remove print verbose statement 2024-01-13 14:11:05 +05:30
Krrish Dholakia 01df37d8cf fix(caching.py): use bulk writes and blockconnectionpooling for reads from Redis 2024-01-13 11:50:50 +05:30
ishaan-jaff 99dcce1e0f (test) aembedding includes custom_llm_provider 2024-01-12 17:52:14 -08:00
ishaan-jaff 39f724d9f3 (fix) always check if response has hidden_param attr 2024-01-12 17:51:34 -08:00
ishaan-jaff c1686b264f (test) embedding hidden params 2024-01-12 17:35:33 -08:00
ishaan-jaff 7f37d7e44f (feat) set custom_llm_provider for embedding hidden params 2024-01-12 17:35:08 -08:00
ishaan-jaff f85b64b85c (test) custom_llm_provider in streaming response 2024-01-12 17:15:15 -08:00
ishaan-jaff 6b2a4714a6 (feat) return custom_llm_provider in streaming response 2024-01-12 17:14:43 -08:00
ishaan-jaff 70899521ae (test) custom_llm_provider in hidden params 2024-01-12 17:09:59 -08:00
ishaan-jaff fd9bddc71a (v0) 2024-01-12 17:05:51 -08:00
ishaan-jaff 0ae8ab1b13 (docs) sso login + bedrock v1.17.4 2024-01-12 16:51:15 -08:00
Krrish Dholakia b6a9274baa docs(virtual_keys.md): clearer example for /key/generate 2024-01-13 01:39:03 +05:30
Krrish Dholakia 2fdeaa0599 bump: version 1.17.3 → 1.17.4 2024-01-12 22:52:30 +05:30
Krrish Dholakia cd639a7f4b fix(proxy_server.py): have /user/info return user info + related user keys 2024-01-12 22:52:13 +05:30
Krish DholakiaandGitHub d29a9029ac Merge pull request #1425 from kaonick/main
#1424:gunicorn can't run in windows
2024-01-12 22:16:38 +05:30
Krish DholakiaandGitHub 554080804f Merge pull request #1429 from dleen/data
[bug] unbound variable in bedrock
2024-01-12 22:16:11 +05:30
Krish DholakiaandGitHub a459e68a31 Merge pull request #1431 from dleen/bedrockex
improve bedrock exception granularity
2024-01-12 22:14:26 +05:30
Krrish Dholakia 007870390d fix: support async redis caching 2024-01-12 21:46:41 +05:30
David Leen a674de8f36 improve bedrock exception granularity 2024-01-12 16:38:55 +01:00
David Leen 8b021fc4cd [bug] unbound variable in bedrock
note: the code was written as `json.dumps({})` even though it is more verbose in order to facilitate easier refactoring in the future

fixes #1428
2024-01-12 12:33:00 +01:00
XD3000/高瑞雲 574d042655 #1424:gunicorn can't run in windows 2024-01-12 14:30:23 +08:00
Krrish Dholakia 8a97acde63 fix: syncing changes 2024-01-12 11:41:40 +05:30
Krrish Dholakia 538c885776 bump: version 1.16.21.dev2 → 1.16.21.dev3 2024-01-12 11:35:17 +05:30
Krrish Dholakia 352f943dcf fix(dynamo_db.py): don't auto-create tables, allow database_type == 'dynamodb' 2024-01-12 11:33:40 +05:30
Krrish Dholakia 51110bfb62 fix(main.py): support text completion routing v1.17.3 2024-01-12 11:24:31 +05:30
Krrish Dholakia cbdb8d68a3 docs(health.md): add text completion health check tutorial to docs 2024-01-12 00:32:06 +05:30