11302 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Ishaan Jaff	6d6549c6c8	(fix) kub.yaml	2024-03-26 18:05:55 -07:00
Ishaan Jaff	4d22fe0947	bump: version 1.34.4 → 1.34.5	2024-03-26 18:04:05 -07:00
Krrish Dholakia	bf7cc943fb	docs(enterprise.md): update docs to turn on/off llm guard per key	2024-03-26 18:02:44 -07:00
Krrish Dholakia	1046a63521	test(test_llm_guard.py): unit testing for key-level llm guard enabling	2024-03-26 17:55:53 -07:00
Krrish Dholakia	6d418a2920	fix(llm_guard.py): working llm-guard 'key-specific' mode	2024-03-26 17:47:20 -07:00
Krrish Dholakia	e10eb8f6fe	feat(llm_guard.py): enable key-specific llm guard check	2024-03-26 17:21:51 -07:00
Krrish Dholakia	bec093675c	build(schema.prisma): update schema to enable team blocking	2024-03-26 17:03:32 -07:00
Krrish Dholakia	77472b80eb	fix(proxy_server.py): use consistent naming schema - move to /team/block	2024-03-26 16:59:36 -07:00
Krish DholakiaandGitHub	7eb2c7942c	Merge pull request #2675 from onukura/ollama-embedding ... Fix Ollama embedding	2024-03-26 16:08:28 -07:00
Krish DholakiaandGitHub	9d7aceb06e	Merge pull request #2697 from antoniomdk/fix-database-credentials-leakage ... (fix) Remove print statements from append_query_params	2024-03-26 16:07:33 -07:00
Krish DholakiaandGitHub	0ab708e6f1	Merge pull request #2704 from BerriAI/litellm_jwt_auth_improvements_3 ... fix(handle_jwt.py): enable team-based jwt-auth access	2024-03-26 16:06:56 -07:00
Krrish Dholakia	4f7ba902d8	feat(proxy_server.py): enable new /team/disable endpoint ... reject all requests from this team id, without deleting it.	2024-03-26 15:40:50 -07:00
Krrish Dholakia	ea8f6672c5	test(test_jwt.py): fix test	2024-03-26 15:22:05 -07:00
Krrish Dholakia	7b37f4c05f	fix(proxy_server.py): rename proxy roles param to litellm_jwtauth	2024-03-26 15:04:30 -07:00
Krrish Dholakia	4281f1545b	fix(utils.py): check if item in list is pydantic object or dict before dereferencing	2024-03-26 14:39:16 -07:00
Krrish Dholakia	752516df1b	fix(handle_jwt.py): support public key caching ttl param	2024-03-26 14:32:55 -07:00
Krrish Dholakia	d90f44fe8e	fix(proxy_server.py): check if team scope in jwt	2024-03-26 14:01:02 -07:00
Krrish Dholakia	4d7f4550e2	test(test_batch_completions.py): handle anthropic overloaded error	2024-03-26 13:55:03 -07:00
Krrish Dholakia	6b1d2551d1	test(test_batch_completions.py): handle overloaded anthropic error v1.34.4.dev2	2024-03-26 13:53:18 -07:00
Krrish Dholakia	3a82ff2ef2	fix(utils.py): don't send subsequent chunks if last chunk sent ... prevents multiple empty finish chunks from being sent	2024-03-26 13:49:42 -07:00
Krrish Dholakia	7d38c62717	fix(handle_jwt.py): enable team-based jwt-auth access ... Move auth to check on ‘client_id’ not ‘sub	2024-03-26 12:25:38 -07:00
Ishaan JaffandGitHub	0f432dfb4b	Merge pull request #2703 from BerriAI/litellm_remove_litellm_telemetry ... [Fix] remove litellm telemetry from proxy server	2024-03-26 11:35:18 -07:00
Ishaan JaffandGitHub	da503eab18	Merge branch 'main' into litellm_remove_litellm_telemetry	2024-03-26 11:35:02 -07:00
Ishaan Jaff	b6af44c4dc	(fix) telemetry = false	2024-03-26 11:23:23 -07:00
Ishaan Jaff	6b4b05b58f	(fix) remove litellm.telemetry	2024-03-26 11:21:09 -07:00
Ishaan Jaff	4d81df3d6f	(docs) switch of litellm telemetry	2024-03-26 11:19:55 -07:00
Krish DholakiaandGitHub	f3f56204c5	Update README.md	2024-03-26 10:34:16 -07:00
Krrish Dholakia	b4d0a95cff	test(test_router_debug_logs.py): add info statement to log test	2024-03-26 09:54:26 -07:00
Krrish Dholakia	584d187e0e	fix(utils.py): check if message is pydantic object or dict before dereferencing	2024-03-26 09:47:44 -07:00
Ishaan JaffandGitHub	2ecdd92619	Merge pull request #2702 from BerriAI/litellm_cache_flush ... [Feat] Proxy - /cache/flushall - delete all elements from cache	2024-03-26 09:34:39 -07:00
Ishaan Jaff	7409dcd222	(fix) doc string	2024-03-26 09:25:44 -07:00
Ishaan Jaff	75ef51b714	(fix) undo change from other branch	2024-03-26 09:24:12 -07:00
Ishaan Jaff	098a03facc	(fix) undo changes from other branches	2024-03-26 09:22:19 -07:00
Ishaan Jaff	b8af946fb9	(feat) /cache/flushall	2024-03-26 09:18:58 -07:00
Ishaan Jaff	151b717ae2	(feat) support cache flush on redis	2024-03-26 09:12:30 -07:00
Ishaan Jaff	ade5d58331	(fix) in mem redis reads	2024-03-26 09:10:49 -07:00
Krrish Dholakia	2dd2b8a8e3	test(test_streaming.py): add unit testing for custom stream wrapper v1.34.4.dev1	2024-03-26 08:57:44 -07:00
Rob Mann	e80aae5c30	Updating the default Claude3 max tokens	2024-03-26 11:46:59 -04:00
Antonio Molner Domenech	c713648db1	Update print statements to use verbose logger and DEBUG level	2024-03-26 22:41:28 +07:00
Krish DholakiaandGitHub	6f11f300fc	Merge pull request #2656 from TashaSkyUp/patch-1 ... fix for: when using ModelResponse.json() to save and then reconstruct a ModelResponse the choices field ends up empty	2024-03-26 08:36:55 -07:00
Krrish Dholakia	49e8cdbff9	fix(router.py): check for context window error when handling 400 status code errors ... was causing proxy context window fallbacks to not work as expected	2024-03-26 08:08:15 -07:00
Ishaan Jaff	787c9b7df0	(test) claude-1 api is unstable	2024-03-26 08:07:16 -07:00
Ishaan Jaff	81b716d8da	(fix) cache control logic	2024-03-26 07:36:45 -07:00
Ishaan Jaff	995c379a63	(fix) prod.md	2024-03-25 22:30:22 -07:00
Ishaan Jaff	5b2698a9ed	(kub) always pull litellm image v1.34.4	2024-03-25 22:29:23 -07:00
Ishaan Jaff	965fb6eb2c	(fix) cache control logic	2024-03-25 22:19:34 -07:00
Krrish Dholakia	a3617a6af6	bump: version 1.34.3 → 1.34.4	2024-03-25 21:58:49 -07:00
Krish DholakiaandGitHub	eb859f5dba	Merge pull request #2692 from BerriAI/litellm_streaming_fixes ... fix(utils.py): ensure last chunk is always empty delta w/ finish reason	2024-03-25 21:57:04 -07:00
Krrish Dholakia	643fd6ac96	test(test_caching.py): fix test_redis_cache_acompletion_stream	2024-03-25 21:36:47 -07:00
Krrish Dholakia	4d85387b5a	test(test_azure_astreaming_and_function_calling): fix test to handle caching	2024-03-25 19:33:57 -07:00