Commit Graph
16012 Commits
Author SHA1 Message Date
Krish DholakiaandGitHub 37ef63f522 Merge pull request #5101 from BerriAI/litellm_router_prioritization
feat(router.py): allows /chat/completion endpoint to work for request prioritization calls
2024-08-07 20:00:06 -07:00
Ishaan Jaff e17e959c62 image gen catch when predictions not in json response 2024-08-07 18:50:26 -07:00
Ishaan Jaff e1a78faf98 run that ci cd again 2024-08-07 18:47:11 -07:00
Krrish Dholakia b4392d2b67 test(test_amazing_vertex_completion.py): fix test for json schema validation in openai schema v1.43.2 2024-08-07 18:39:20 -07:00
Ishaan Jaff b571f3e115 run that ci/cd again 2024-08-07 18:25:52 -07:00
Krrish Dholakia 4e02425d8b fix(vertex_ai_partner.py): pass model for llama3 param mapping 2024-08-07 18:16:41 -07:00
Ishaan JaffandKrrish Dholakia 75bfe81748 fix all optional param tests 2024-08-07 18:16:41 -07:00
Ishaan JaffandKrrish Dholakia 472a1df76f fix test for wildcard routing 2024-08-07 18:16:41 -07:00
Ishaan JaffandKrrish Dholakia 4c375d13d6 fix test_drop_params_parallel_tool_calls 2024-08-07 18:16:41 -07:00
Krrish Dholakia a15317a377 fix(vertex_ai_partner.py): pass model for llama3 param mapping 2024-08-07 18:07:14 -07:00
Ishaan Jaff 4e90a25417 fix all optional param tests 2024-08-07 17:52:40 -07:00
Krrish Dholakia 400653992c feat(router.py): allow using .acompletion() for request prioritization
allows /chat/completion endpoint to work for request prioritization calls
2024-08-07 16:43:12 -07:00
Ishaan Jaff 6b03998e32 fix test for wildcard routing 2024-08-07 16:41:00 -07:00
Ishaan Jaff 341e098c32 fix test_drop_params_parallel_tool_calls 2024-08-07 16:26:56 -07:00
Ishaan Jaff e585dfba92 docs prom 2024-08-07 16:03:11 -07:00
Krish DholakiaandGitHub b6df998ac3 Merge pull request #5100 from sammcj/patch-1
Add deepseek-coder-v2(-lite), mistral-large, codegeex4 to ollama
2024-08-07 15:56:02 -07:00
SamandGitHub 8459046585 Add deepseek-coder-v2(-lite), mistral-large, codegeex4 to ollama 2024-08-08 10:51:59 +12:00
Ishaan Jaff 89050dc4f4 ci/cd run again 2024-08-07 15:44:54 -07:00
Ishaan Jaff 4543dbb2e2 fixinstalling openai on ci/cd 2024-08-07 15:44:36 -07:00
Ishaan Jaff 2c3e068435 fix test_team_update_redis 2024-08-07 15:37:02 -07:00
Ishaan Jaff be0984009b bump: version 1.43.1 → 1.43.2 2024-08-07 15:26:55 -07:00
Ishaan Jaff aab91a7314 fix - someone resolved a merge conflict badly 2024-08-07 15:23:15 -07:00
Ishaan Jaff 9cd437135b fix getting provider_specific_deployment 2024-08-07 15:20:59 -07:00
Ishaan JaffandGitHub 04b201efed Merge pull request #5098 from BerriAI/litellm_provider_wildcard_routing
[Feat-Router + Proxy] Add provider wildcard routing
2024-08-07 14:51:42 -07:00
Ishaan Jaff a367f97eb2 docs provider specific wildcard routing 2024-08-07 14:49:45 -07:00
Krish DholakiaandGitHub 2e434d56e3 Merge pull request #5079 from BerriAI/litellm_add_pydantic_model_support
feat(utils.py): support passing response_format as pydantic model
2024-08-07 14:43:05 -07:00
Krish DholakiaandGitHub 1bf1185506 Merge pull request #5095 from Mogith-P-N/main
Clarifai : Removed model name casing issue
2024-08-07 14:42:26 -07:00
Ishaan Jaff f1ffa82062 fix use provider specific routing 2024-08-07 14:37:20 -07:00
Krish DholakiaandGitHub 4640e925a1 Merge pull request #5091 from BerriAI/litellm_anthropic_streaming_tool_call_fix
fix(anthropic.py): handle anthropic returning empty argument string (invalid json str) for tool call while streaming
2024-08-07 14:33:42 -07:00
Krish DholakiaandGitHub 93d048b1dc Merge branch 'main' into litellm_anthropic_streaming_tool_call_fix 2024-08-07 14:33:30 -07:00
Ishaan Jaff 218ba0f470 support provider wildcard routing 2024-08-07 14:20:22 -07:00
Ishaan Jaff d42949cb4a test_router_provider_wildcard_routing 2024-08-07 14:12:40 -07:00
Ishaan Jaff 5d7a1b2ec6 router use provider specific wildcard routing 2024-08-07 14:12:10 -07:00
Ishaan Jaff 3249e295cb test provider wildcard routing 2024-08-07 13:52:00 -07:00
Ishaan Jaff 18305b23f4 add + test provider specific routing 2024-08-07 13:49:46 -07:00
Krrish Dholakia 55ad5bb7c6 fix(config.yml): fix build and test 2024-08-07 13:23:04 -07:00
Krrish Dholakia c0ef2e9dd0 fix(main.py): fix linting error for python3.8 2024-08-07 13:21:35 -07:00
Krrish Dholakia 37dc359efb fix(utils.py): fix linting error for python3.8 2024-08-07 13:14:29 -07:00
Ishaan Jaff 0b98959e6d gemini test skip internal server error 2024-08-07 13:12:45 -07:00
Krrish Dholakia a2e792d32e test: update build requirements 2024-08-07 13:09:49 -07:00
Krish DholakiaandGitHub 3605e873a1 Merge branch 'main' into litellm_add_pydantic_model_support 2024-08-07 13:07:46 -07:00
Krrish Dholakia f0f900d69e fix(router.py): add reason for fallback failure to client-side exception string
make it easier to debug why a fallback failed to occur
2024-08-07 13:02:47 -07:00
Ishaan Jaff 1bf36cd7a4 docs prom metrics 2024-08-07 12:50:03 -07:00
Ishaan Jaff 61ccd5354b docs prometheus 2024-08-07 12:47:06 -07:00
Ishaan Jaff 958e0fdfab show warning about prometheus moving to enterprise 2024-08-07 12:46:26 -07:00
Ishaan JaffandGitHub 80acc7ecfe Merge pull request #5088 from BerriAI/litellm_init_prom_svc_logger
[Fix] Init Prometheus Service Logger when it's None
2024-08-07 12:40:08 -07:00
Ishaan JaffandGitHub 3f9d37c596 Merge pull request #5092 from BerriAI/litellm_prom_metrics_llms
[Feat] - Prometheus Metrics to monitor a model health
2024-08-07 12:39:38 -07:00
Ishaan Jaff 72aebe5e59 docs link to enteprise pricing 2024-08-07 12:10:47 -07:00
Ishaan Jaff 8d1f051d8c docs prometheus 2024-08-07 11:37:05 -07:00
Ishaan Jaff 579f09b334 fix logging cool down deployment 2024-08-07 11:27:05 -07:00