Commit Graph
8575 Commits
Author SHA1 Message Date
Aaron Bach daca0a93ce Update docs 2024-03-13 17:37:59 -06:00
Aaron Bach 9fd6ac04c5 Add support for claude-3-haiku-20240307 (anthropic) 2024-03-13 16:46:50 -06:00
Ishaan JaffandGitHub 58b446b184 Update load_test.yml 2024-03-13 15:27:59 -07:00
ishaan-jaff 60f34066a5 (fix) default dockerfile use num_workers = 1 2024-03-13 15:23:53 -07:00
Ishaan JaffandGitHub 99783ae369 Update load_test.yml 2024-03-13 15:22:17 -07:00
Ishaan JaffandGitHub fc54358c26 Update load_test.yml 2024-03-13 15:08:20 -07:00
ishaan-jaff d28145f916 (fix) fake openai endpoint 2024-03-13 15:07:50 -07:00
ishaan-jaff acd8f7b48c (fix) example fake openai endpoint 2024-03-13 15:06:44 -07:00
Ishaan JaffandGitHub 07a6957cca Create locustfile.py 2024-03-13 15:05:46 -07:00
Ishaan JaffandGitHub 75e9bab41d Update load_test.yml 2024-03-13 15:04:39 -07:00
Ishaan JaffandGitHub 10a3f8e4d4 Create load_test.yml 2024-03-13 15:04:01 -07:00
ishaan-jaff 788583a737 (ci/cd) use fake-openai-endpoint in docker builds 2024-03-13 14:57:41 -07:00
Ishaan JaffandGitHub 8a886c6e93 Merge pull request #2501 from BerriAI/litellm_fix_using_enterprise_docker
(fix) using enterprise folder on litellm Docker
2024-03-13 14:26:21 -07:00
ishaan-jaff 992aba2a77 (fix) predict/spend/logs test 2024-03-13 14:09:51 -07:00
ishaan-jaff ba5cc19edf (test) using get_predict_spend_logs 2024-03-13 14:00:04 -07:00
Ishaan JaffandGitHub d82be720d2 Merge pull request #2493 from BerriAI/litellm_return_429_no_models_available
[Proxy] return 429 when no models available
2024-03-13 13:33:43 -07:00
Krrish Dholakia f5eb0a1751 bump: version 1.31.8 → 1.31.9 2024-03-13 12:37:50 -07:00
Krrish Dholakia 16e3aaced5 docs(enterprise.md): add prompt injection detection to docs 2024-03-13 12:37:32 -07:00
Krish DholakiaandGitHub 3e66b50602 Merge pull request #2498 from BerriAI/litellm_prompt_injection_detection
feat(prompt_injection_detection.py): support simple heuristic similarity check for prompt injection attacks
v1.31.8
2024-03-13 12:28:19 -07:00
Krrish Dholakia dbc7552d15 docs: refactor team based logging in docs 2024-03-13 12:26:39 -07:00
ishaan-jaff 82246d8e30 (fix) using enterprise folder on litellm 2024-03-13 12:16:58 -07:00
Krrish Dholakia b3493269b3 fix(proxy_server.py): support checking openai user param v1.31.7 2024-03-13 12:00:27 -07:00
ishaan-jaff 7924700df6 bump: version 1.31.7 → 1.31.8 2024-03-13 11:55:57 -07:00
Ishaan JaffandGitHub fd99f9f64a Merge pull request #2500 from BerriAI/litellm_fix_using_enterpise
(fix) issue with using litellm enterprise on Admin UI
2024-03-13 11:55:29 -07:00
Krrish Dholakia a0f08766fe bump: version 1.31.6 → 1.31.7 2024-03-13 11:35:24 -07:00
Krrish Dholakia dfac742324 fix(factory.py): fix mistral api prompt formatting 2024-03-13 11:34:45 -07:00
Krrish Dholakia 234cdbbfef feat(prompt_injection_detection.py): support simple heuristic similarity check for prompt injection attacks 2024-03-13 10:32:21 -07:00
ishaan-jaff 771d09312e (fix) issue with using litellm enterprise license 2024-03-13 10:30:31 -07:00
Ishaan JaffandGitHub ac867daadc Merge pull request #2204 from BerriAI/dependabot/pip/orjson-3.9.15
build(deps): bump orjson from 3.9.7 to 3.9.15
2024-03-13 08:50:15 -07:00
Ishaan JaffandGitHub 0058e0270c Merge pull request #2470 from tylerbrandt/gcp-dep
fix: add dependency for google-cloud-aiplatform
2024-03-13 08:17:08 -07:00
ishaan-jaff 4c526ade27 (fix) errors fro litellm proxy 2024-03-13 08:05:32 -07:00
ishaan-jaff 3aeada232e (fix) return 429 error 2024-03-13 08:03:28 -07:00
ishaan-jaff aaa008ecde (fix) raising No healthy deployment 2024-03-13 08:00:56 -07:00
Krrish Dholakia 9e692d6cce docs(sidebar.js): add dall e 3 cost tracking to docs 2024-03-12 22:26:10 -07:00
Krrish Dholakia 1b93ada827 bump: version 1.31.5 → 1.31.6 v1.31.6 2024-03-12 21:36:33 -07:00
Krish DholakiaandGitHub 9f2d540ebf Merge pull request #2472 from BerriAI/litellm_anthropic_streaming_tool_calling
fix(anthropic.py): support claude-3 streaming with function calling
2024-03-12 21:36:01 -07:00
Krrish Dholakia 488c4b9939 docs(cost_tracking.md): add docs for cost tracking dall e 3 calls 2024-03-12 21:35:17 -07:00
Ishaan JaffandGitHub 7b4f9691c7 Merge pull request #2479 from BerriAI/litellm_cohere_tool_call
[FEAT Cohere/command-r tool calling
2024-03-12 21:20:59 -07:00
Krrish Dholakia 55612a6a5f fix(anthropic.py): add more logging 2024-03-12 21:18:38 -07:00
Ishaan JaffandGitHub 3922b827f8 Merge pull request #2484 from BerriAI/litellm_fix_langfuse_default
[Proxy-High Traffic] Fix using Langfuse in high traffic
v1.31.5
2024-03-12 19:35:24 -07:00
Krrish Dholakia d620b4dc5d fix(anthropic.py): bug fix 2024-03-12 19:32:42 -07:00
Krrish Dholakia e892fc99a3 fix(anthropic.py): concurrent request fix 2024-03-12 19:25:05 -07:00
Krrish Dholakia 2b5ba1c7af bump: version 1.31.4 → 1.31.5 2024-03-12 19:18:05 -07:00
Krish DholakiaandGitHub 8beb6bb2bc Merge pull request #2382 from BerriAI/litellm_cost_tracking_fix
fix(proxy_server.py): support cost tracking if general_settings is none
2024-03-12 19:15:23 -07:00
Krrish Dholakia 82c53d7e2f test(anthropic.py): more logging for test 2024-03-12 19:07:52 -07:00
Krish DholakiaandGitHub df5d9a78b8 Merge pull request #2483 from BerriAI/litellm_proxy_perf
fix(proxy_server.py): cache master key check
2024-03-12 19:01:46 -07:00
ishaan-jaff 786df1d574 (fix) locust load test 2024-03-12 18:52:49 -07:00
ishaan-jaff 8bfb00cdab (fix) default langfuse setting 2024-03-12 17:42:31 -07:00
Krrish Dholakia 39f9bfad80 fix(proxy_server.py): cache master key check 2024-03-12 15:15:33 -07:00
ishaan-jaff b9bfc7c36c (fix) use cohere_chat optional params 2024-03-12 14:31:43 -07:00