Commit Graph
8968 Commits
Author SHA1 Message Date
Ishaan Jaff 28e62af4e1 (fix) update load test used 2024-03-22 19:48:54 -07:00
Krish DholakiaandGitHub e2d81722d2 Merge pull request #2650 from BerriAI/litellm_jwt_auth_fixes
feat(handle_jwt.py): enable jwt-project based auth
2024-03-22 19:32:46 -07:00
Krrish Dholakia 90465ff00a bump: version 1.33.4 → 1.33.5 2024-03-22 18:15:42 -07:00
Krrish Dholakia 691a83b7dc fix(anthropic.py): handle multiple system prompts 2024-03-22 18:14:15 -07:00
Krrish Dholakia 265dd5cd4f docs(token_auth.md): add project based auth to docs 2024-03-22 17:27:40 -07:00
Krrish Dholakia d06b9a5a47 fix(proxy_server.py): enable jwt-auth for users
allow a user to auth into the proxy via jwt's and call allowed routes
2024-03-22 17:08:10 -07:00
Krrish Dholakia 9bf086386e fix(handle_jwt.py): add more logging for jwt header 2024-03-22 16:33:32 -07:00
Ishaan JaffandGitHub de1f348453 Merge pull request #2646 from BerriAI/litellm_bump_python
(feat) bump to python 3.11 - Improve Proxy perf 7%
2024-03-22 15:01:11 -07:00
Ishaan Jaff ff57887b70 (feat) bump to python 3.11 2024-03-22 14:44:41 -07:00
Krrish Dholakia 858fa07e07 docs(call_hooks.md): fix dead link 2024-03-22 09:06:01 -07:00
Krrish Dholakia 211a6887f3 docs(enterprise.md): fix llm guard api link 2024-03-22 09:03:11 -07:00
Krrish Dholakia 566d48d51b docs(prompt_injection.md): fix dead link on docs 2024-03-22 08:24:47 -07:00
Krrish Dholakia dfcc0c9ff0 fix(ollama_chat.py): don't pop from dictionary while iterating through it 2024-03-22 08:18:22 -07:00
Krrish Dholakia 93a1a865f0 bump: version 1.33.3 → 1.33.4 v1.33.4 2024-03-21 21:55:19 -07:00
Krrish Dholakia 66e7345296 docs(virtual_keys.md): simplify virtual keys docs 2024-03-21 21:49:50 -07:00
Krish DholakiaandGitHub db7974f9f2 Merge pull request #2617 from RoniGurvich/main
Bump fastapi version `0.104.1` to `0.109.1`
v1.33.3
2024-03-21 20:56:28 -07:00
Krish DholakiaandGitHub c980093ca4 Merge pull request #2620 from BerriAI/litellm_fix_retry_logic
[ fix ] retry logic - when using router/proxy - don't retry on the litellm.completion level too
2024-03-21 20:56:05 -07:00
Krish DholakiaandGitHub 8c45986e72 Merge pull request #2619 from BerriAI/litellm_install_tenacity
(fix) include tenacity in req.txt
2024-03-21 20:55:56 -07:00
Krish DholakiaandGitHub 5a086392e2 Merge pull request #2630 from BerriAI/litellm_bedrock_function_calling_streaming
fix(bedrock.py): support bedrock claude 3 function calling when stream=true
2024-03-21 20:40:44 -07:00
Krrish Dholakia 94f55aa6d9 fix(bedrock.py): support claude 3 function calling when stream=true
https://github.com/BerriAI/litellm/issues/2615
2024-03-21 18:39:03 -07:00
Krrish Dholakia 425165dda9 docs(gemini.md): fix string for calling gemini 1.5 v1.33.2 2024-03-21 18:04:11 -07:00
Krrish Dholakia d57995a73d build(schema.prisma): use jsonProtocol to fix db connection issues
https://github.com/prisma/prisma/discussions/19978
2024-03-21 18:01:45 -07:00
Krrish Dholakia bc17404055 bump: version 1.33.2 → 1.33.3 2024-03-21 17:56:26 -07:00
Krrish Dholakia 4ac14a4e85 build(networking.tsx): fix trailing slash 2024-03-21 17:50:59 -07:00
Krrish Dholakia d9577c3e2b build(networking.tsx): modify url to prevent redirects 2024-03-21 17:43:41 -07:00
Krrish Dholakia abe8d7c921 docs(configs.md): add disable swagger ui env tutorial to docs 2024-03-21 17:16:52 -07:00
Krrish Dholakia 33964233a5 fix(proxy_server.py): allow user to disable swagger ui docs via env
user can disable swagger ui docs by setting 'NO_DOCS="True"' in their env
2024-03-21 17:15:18 -07:00
Krrish Dholakia 44a91fe43a bump: version 1.33.1 → 1.33.2 2024-03-21 16:55:52 -07:00
Krrish Dholakia b5457beba6 fix(llm_guard.py): await moderation check 2024-03-21 16:55:28 -07:00
Krrish Dholakia d7b502bf64 bump: version 1.33.0 → 1.33.1 v1.33.1 v1.33.0 2024-03-21 11:23:02 -07:00
Krrish Dholakia c4dad3f34f fix(llm_guard.py): more logging for llm guard.py 2024-03-21 11:22:52 -07:00
Krrish Dholakia 550c9508d3 bump: version 1.32.9 → 1.33.0 2024-03-21 10:56:58 -07:00
Krrish Dholakia af27a61d76 refactor(main.py): trigger new build 2024-03-21 10:56:44 -07:00
Krish DholakiaandGitHub 4df79ff4db Merge pull request #2614 from BerriAI/litellm_llm_api_prompt_injection_check
feat(proxy_server.py): enable llm api based prompt injection checks
2024-03-21 09:57:16 -07:00
Krish DholakiaandGitHub 33a433eb0a Merge branch 'main' into litellm_llm_api_prompt_injection_check 2024-03-21 09:57:10 -07:00
Roni GurvichandGitHub f623d9b0bf Merge branch 'BerriAI:main' into main 2024-03-21 18:45:26 +02:00
roni 76d4871262 fastapi version bump in requirements.txt 2024-03-21 18:32:06 +02:00
Krrish Dholakia 0521e8a1d9 fix(prompt_injection_detection.py): fix type check 2024-03-21 08:56:13 -07:00
Ishaan Jaff 0558ac2345 (fix) don't run .completion retries if using router / proxy 2024-03-21 08:32:42 -07:00
Krrish Dholakia 42d62cf99b test(test_llm_guard.py): fix llm guard integration 2024-03-21 08:31:11 -07:00
Krrish Dholakia 84a540f2d6 build: fix mypy build issues 2024-03-21 08:27:23 -07:00
Krrish Dholakia 8e8c4e214e fix: fix linting issue 2024-03-21 08:19:09 -07:00
Ishaan Jaff 14459b89e3 (fix) include tenacity in req.txt 2024-03-21 08:10:12 -07:00
Krrish Dholakia e904a84bdb build: reintegrate mypy linting in pre-commit hook 2024-03-21 08:09:02 -07:00
Krrish Dholakia 2ce5de903f fix: fix linting issue 2024-03-21 08:05:47 -07:00
Ishaan JaffandGitHub bcd62034ed Merge pull request #2563 from eltociear/patch-2
Update proxy_server.py
2024-03-21 07:29:33 -07:00
Roni GurvichandGitHub 17e705183a Update poetry.lock
fastapi upgrade from 0.104.1 to 0.109.1
2024-03-21 14:23:35 +02:00
Roni GurvichandGitHub dcb1e06402 Update pyproject.toml
fastapi upgrade from 0.104.1 to 0.109.1
2024-03-21 14:22:29 +02:00
Krrish Dholakia d91f9a9f50 feat(proxy_server.py): enable llm api based prompt injection checks
run user calls through an llm api to check for prompt injection attacks. This happens in parallel to th
e actual llm call using `async_moderation_hook`
2024-03-20 22:43:42 -07:00
Ishaan JaffandGitHub 8363bd4e7e Merge pull request #2613 from BerriAI/litellm_fix_quick_start_docker
(docs) Litellm fix quick start docker
2024-03-20 21:34:19 -07:00