Commit Graph
8587 Commits
Author SHA1 Message Date
ishaan-jaff 10a8eb223a (fix) update load test result 2024-03-13 17:53:51 -07:00
Ishaan JaffandGitHub b075e9f7a9 Update load_test.yml 2024-03-13 17:39:01 -07:00
Ishaan JaffandGitHub 22d034522f Update load_test.yml 2024-03-13 17:19:47 -07:00
Ishaan JaffandGitHub 3237f788e0 Update load_test.yml 2024-03-13 17:15:06 -07:00
Ishaan JaffandGitHub f5631cc237 Update load_test.yml 2024-03-13 17:10:33 -07:00
Ishaan JaffandGitHub 5c9b42321d Update load_test.yml 2024-03-13 17:06:36 -07:00
Ishaan JaffandGitHub 8fb035bc39 Merge pull request #2505 from bachya/claude-3-haiku
Add support for `claude-3-haiku-20240307` (`anthropic`)
2024-03-13 17:01:57 -07:00
Ishaan JaffandGitHub 5232e9b5fc Update load_test.yml 2024-03-13 17:00:19 -07:00
Ishaan JaffandGitHub 7b44de5901 Update load_test.yml 2024-03-13 16:53:40 -07:00
Aaron Bach daca0a93ce Update docs 2024-03-13 17:37:59 -06:00
Ishaan JaffandGitHub e578ce979e Update load_test.yml 2024-03-13 16:35:51 -07:00
Ishaan JaffandGitHub f19acd8a53 Update load_test.yml 2024-03-13 16:32:33 -07:00
Ishaan JaffandGitHub 0c2b13991b Update load_test.yml 2024-03-13 16:07:24 -07:00
Aaron Bach 9fd6ac04c5 Add support for claude-3-haiku-20240307 (anthropic) 2024-03-13 16:46:50 -06:00
Ishaan JaffandGitHub 58b446b184 Update load_test.yml 2024-03-13 15:27:59 -07:00
ishaan-jaff 60f34066a5 (fix) default dockerfile use num_workers = 1 2024-03-13 15:23:53 -07:00
Ishaan JaffandGitHub 99783ae369 Update load_test.yml 2024-03-13 15:22:17 -07:00
Ishaan JaffandGitHub fc54358c26 Update load_test.yml 2024-03-13 15:08:20 -07:00
ishaan-jaff d28145f916 (fix) fake openai endpoint 2024-03-13 15:07:50 -07:00
ishaan-jaff acd8f7b48c (fix) example fake openai endpoint 2024-03-13 15:06:44 -07:00
Ishaan JaffandGitHub 07a6957cca Create locustfile.py 2024-03-13 15:05:46 -07:00
Ishaan JaffandGitHub 75e9bab41d Update load_test.yml 2024-03-13 15:04:39 -07:00
Ishaan JaffandGitHub 10a3f8e4d4 Create load_test.yml 2024-03-13 15:04:01 -07:00
ishaan-jaff 788583a737 (ci/cd) use fake-openai-endpoint in docker builds 2024-03-13 14:57:41 -07:00
Ishaan JaffandGitHub 8a886c6e93 Merge pull request #2501 from BerriAI/litellm_fix_using_enterprise_docker
(fix) using enterprise folder on litellm Docker
2024-03-13 14:26:21 -07:00
ishaan-jaff 992aba2a77 (fix) predict/spend/logs test 2024-03-13 14:09:51 -07:00
ishaan-jaff ba5cc19edf (test) using get_predict_spend_logs 2024-03-13 14:00:04 -07:00
Ishaan JaffandGitHub d82be720d2 Merge pull request #2493 from BerriAI/litellm_return_429_no_models_available
[Proxy] return 429 when no models available
2024-03-13 13:33:43 -07:00
Krrish Dholakia f5eb0a1751 bump: version 1.31.8 → 1.31.9 2024-03-13 12:37:50 -07:00
Krrish Dholakia 16e3aaced5 docs(enterprise.md): add prompt injection detection to docs 2024-03-13 12:37:32 -07:00
Krish DholakiaandGitHub 3e66b50602 Merge pull request #2498 from BerriAI/litellm_prompt_injection_detection
feat(prompt_injection_detection.py): support simple heuristic similarity check for prompt injection attacks
v1.31.8
2024-03-13 12:28:19 -07:00
Krrish Dholakia dbc7552d15 docs: refactor team based logging in docs 2024-03-13 12:26:39 -07:00
ishaan-jaff 82246d8e30 (fix) using enterprise folder on litellm 2024-03-13 12:16:58 -07:00
Krrish Dholakia b3493269b3 fix(proxy_server.py): support checking openai user param v1.31.7 2024-03-13 12:00:27 -07:00
ishaan-jaff 7924700df6 bump: version 1.31.7 → 1.31.8 2024-03-13 11:55:57 -07:00
Ishaan JaffandGitHub fd99f9f64a Merge pull request #2500 from BerriAI/litellm_fix_using_enterpise
(fix) issue with using litellm enterprise on Admin UI
2024-03-13 11:55:29 -07:00
Krrish Dholakia a0f08766fe bump: version 1.31.6 → 1.31.7 2024-03-13 11:35:24 -07:00
Krrish Dholakia dfac742324 fix(factory.py): fix mistral api prompt formatting 2024-03-13 11:34:45 -07:00
Krrish Dholakia 234cdbbfef feat(prompt_injection_detection.py): support simple heuristic similarity check for prompt injection attacks 2024-03-13 10:32:21 -07:00
ishaan-jaff 771d09312e (fix) issue with using litellm enterprise license 2024-03-13 10:30:31 -07:00
Ishaan JaffandGitHub ac867daadc Merge pull request #2204 from BerriAI/dependabot/pip/orjson-3.9.15
build(deps): bump orjson from 3.9.7 to 3.9.15
2024-03-13 08:50:15 -07:00
Ishaan JaffandGitHub 0058e0270c Merge pull request #2470 from tylerbrandt/gcp-dep
fix: add dependency for google-cloud-aiplatform
2024-03-13 08:17:08 -07:00
ishaan-jaff 4c526ade27 (fix) errors fro litellm proxy 2024-03-13 08:05:32 -07:00
ishaan-jaff 3aeada232e (fix) return 429 error 2024-03-13 08:03:28 -07:00
ishaan-jaff aaa008ecde (fix) raising No healthy deployment 2024-03-13 08:00:56 -07:00
Krrish Dholakia 9e692d6cce docs(sidebar.js): add dall e 3 cost tracking to docs 2024-03-12 22:26:10 -07:00
Krrish Dholakia 1b93ada827 bump: version 1.31.5 → 1.31.6 v1.31.6 2024-03-12 21:36:33 -07:00
Krish DholakiaandGitHub 9f2d540ebf Merge pull request #2472 from BerriAI/litellm_anthropic_streaming_tool_calling
fix(anthropic.py): support claude-3 streaming with function calling
2024-03-12 21:36:01 -07:00
Krrish Dholakia 488c4b9939 docs(cost_tracking.md): add docs for cost tracking dall e 3 calls 2024-03-12 21:35:17 -07:00
Ishaan JaffandGitHub 7b4f9691c7 Merge pull request #2479 from BerriAI/litellm_cohere_tool_call
[FEAT Cohere/command-r tool calling
2024-03-12 21:20:59 -07:00