Commit Graph
8991 Commits
Author SHA1 Message Date
Krrish Dholakia eb3ca85d7e feat(router.py): enable pre-call checks
filter models outside of context window limits of a given message for a model group

 https://github.com/BerriAI/litellm/issues/872
2024-03-23 18:03:30 -07:00
Krrish Dholakia 2fabff06c0 fix(bedrock.py): fix supported openai params for bedrock claude 3 v1.33.8 2024-03-23 16:02:15 -07:00
Krish DholakiaandGitHub 5bcf92f4f5 Merge pull request #2659 from vivek-athina/athina-doc-updates-and-a-minor-fix
Athina docs updated with information about additional fields and a minor fix in the callback
2024-03-23 15:54:32 -07:00
Krrish Dholakia 2a9fd4c28d test(test_completion.py): make default claude 3 test message multi-turn 2024-03-23 14:34:42 -07:00
Krrish Dholakia 05dfc9e6ac bump: version 1.33.7 → 1.33.8 2024-03-23 10:45:30 -07:00
Krrish Dholakia 8bd626197a Revert "bump: version 1.33.7 → 1.33.7.dev1"
This reverts commit 1b24beb7c7.
2024-03-23 10:43:12 -07:00
Krrish Dholakia f0bee037ad build(test_python_38.py): add testing for litellm cli import 2024-03-23 10:42:19 -07:00
Krrish Dholakia 1b24beb7c7 bump: version 1.33.7 → 1.33.7.dev1 2024-03-23 10:31:38 -07:00
Krrish Dholakia 24204cec6b build(pyproject.toml): fix dependency issue re: cryptography 2024-03-23 10:31:31 -07:00
Krrish Dholakia 9b951b906d test(test_completion.py): fix claude multi-turn conversation test v1.33.7 2024-03-23 00:56:41 -07:00
Krrish Dholakia b9143a0a00 fix(factory.py): fix anthropic check 2024-03-23 00:27:24 -07:00
Vivek Aditya efc90b04c7 minor fix 2024-03-23 12:50:46 +05:30
Vivek Aditya 6bd49c6087 Athina docs updated with information about additional fields and a minor fix in the callback 2024-03-23 12:42:07 +05:30
Ishaan Jaff 68fd487c2e bump: version 1.33.6 → 1.33.7 2024-03-22 22:16:14 -07:00
Ishaan Jaff 3639b93d9f bump: version 1.33.5 → 1.33.6 2024-03-22 22:16:12 -07:00
Ishaan JaffandGitHub 5ae84d13ba Merge pull request #2657 from BerriAI/litellm_improve_perf
(feat) remove litellm.telemetry - improve perf on EC2 tiny machines by 90%
2024-03-22 22:15:41 -07:00
Ishaan Jaff f39f606e02 (feat) remove litellm.telemetry 2024-03-22 20:58:14 -07:00
Krrish Dholakia 42a7588b04 fix(anthropic.py): support async claude 3 tool calling + streaming
https://github.com/BerriAI/litellm/issues/2644
2024-03-22 19:57:01 -07:00
Ishaan JaffandGitHub 2e284a0cfe Merge pull request #2653 from BerriAI/litellm_add_example_kub_yamls
[FEAT] Add example Kubernetes + Service YAML Files
2024-03-22 19:49:11 -07:00
Ishaan Jaff aca6ec85e2 (fix) add some better load testing 2024-03-22 19:48:54 -07:00
Ishaan Jaff 28e62af4e1 (fix) update load test used 2024-03-22 19:48:54 -07:00
Ishaan Jaff 9c483dbae4 (feat) add sample kubernetes for litellm 2024-03-22 19:47:44 -07:00
Ishaan Jaff 311918b99c (fix) add some better load testing 2024-03-22 19:45:24 -07:00
Ishaan Jaff 48b9250a3d (fix) update load test used 2024-03-22 19:44:16 -07:00
Krish DholakiaandGitHub e2d81722d2 Merge pull request #2650 from BerriAI/litellm_jwt_auth_fixes
feat(handle_jwt.py): enable jwt-project based auth
2024-03-22 19:32:46 -07:00
Krrish Dholakia 90465ff00a bump: version 1.33.4 → 1.33.5 2024-03-22 18:15:42 -07:00
Krrish Dholakia 691a83b7dc fix(anthropic.py): handle multiple system prompts 2024-03-22 18:14:15 -07:00
Krrish Dholakia 265dd5cd4f docs(token_auth.md): add project based auth to docs 2024-03-22 17:27:40 -07:00
Krrish Dholakia d06b9a5a47 fix(proxy_server.py): enable jwt-auth for users
allow a user to auth into the proxy via jwt's and call allowed routes
2024-03-22 17:08:10 -07:00
Krrish Dholakia 9bf086386e fix(handle_jwt.py): add more logging for jwt header 2024-03-22 16:33:32 -07:00
Ishaan JaffandGitHub de1f348453 Merge pull request #2646 from BerriAI/litellm_bump_python
(feat) bump to python 3.11 - Improve Proxy perf 7%
2024-03-22 15:01:11 -07:00
Ishaan Jaff ff57887b70 (feat) bump to python 3.11 2024-03-22 14:44:41 -07:00
Krrish Dholakia 858fa07e07 docs(call_hooks.md): fix dead link 2024-03-22 09:06:01 -07:00
Krrish Dholakia 211a6887f3 docs(enterprise.md): fix llm guard api link 2024-03-22 09:03:11 -07:00
Krrish Dholakia 566d48d51b docs(prompt_injection.md): fix dead link on docs 2024-03-22 08:24:47 -07:00
Krrish Dholakia dfcc0c9ff0 fix(ollama_chat.py): don't pop from dictionary while iterating through it 2024-03-22 08:18:22 -07:00
Krrish Dholakia 93a1a865f0 bump: version 1.33.3 → 1.33.4 v1.33.4 2024-03-21 21:55:19 -07:00
Krrish Dholakia 66e7345296 docs(virtual_keys.md): simplify virtual keys docs 2024-03-21 21:49:50 -07:00
Krish DholakiaandGitHub db7974f9f2 Merge pull request #2617 from RoniGurvich/main
Bump fastapi version `0.104.1` to `0.109.1`
v1.33.3
2024-03-21 20:56:28 -07:00
Krish DholakiaandGitHub c980093ca4 Merge pull request #2620 from BerriAI/litellm_fix_retry_logic
[ fix ] retry logic - when using router/proxy - don't retry on the litellm.completion level too
2024-03-21 20:56:05 -07:00
Krish DholakiaandGitHub 8c45986e72 Merge pull request #2619 from BerriAI/litellm_install_tenacity
(fix) include tenacity in req.txt
2024-03-21 20:55:56 -07:00
Krish DholakiaandGitHub 5a086392e2 Merge pull request #2630 from BerriAI/litellm_bedrock_function_calling_streaming
fix(bedrock.py): support bedrock claude 3 function calling when stream=true
2024-03-21 20:40:44 -07:00
Krrish Dholakia 94f55aa6d9 fix(bedrock.py): support claude 3 function calling when stream=true
https://github.com/BerriAI/litellm/issues/2615
2024-03-21 18:39:03 -07:00
Krrish Dholakia 425165dda9 docs(gemini.md): fix string for calling gemini 1.5 v1.33.2 2024-03-21 18:04:11 -07:00
Krrish Dholakia d57995a73d build(schema.prisma): use jsonProtocol to fix db connection issues
https://github.com/prisma/prisma/discussions/19978
2024-03-21 18:01:45 -07:00
Krrish Dholakia bc17404055 bump: version 1.33.2 → 1.33.3 2024-03-21 17:56:26 -07:00
Krrish Dholakia 4ac14a4e85 build(networking.tsx): fix trailing slash 2024-03-21 17:50:59 -07:00
Krrish Dholakia d9577c3e2b build(networking.tsx): modify url to prevent redirects 2024-03-21 17:43:41 -07:00
Krrish Dholakia abe8d7c921 docs(configs.md): add disable swagger ui env tutorial to docs 2024-03-21 17:16:52 -07:00
Krrish Dholakia 33964233a5 fix(proxy_server.py): allow user to disable swagger ui docs via env
user can disable swagger ui docs by setting 'NO_DOCS="True"' in their env
2024-03-21 17:15:18 -07:00