Commit Graph
10659 Commits
Author SHA1 Message Date
Krrish Dholakia 4b04b017df bump: version 1.35.31 → 1.35.32 2024-04-29 09:16:44 -07:00
Krish DholakiaandGitHub ec2510029a Merge pull request #3354 from BerriAI/litellm_replicate_cost_tracking
fix(utils.py): replicate now also has token based pricing for some models
2024-04-29 09:13:41 -07:00
Krrish Dholakia 3725732c4d fix(utils.py): default to time-based tracking for unmapped replicate models. fix time-based cost calc for replicate 2024-04-29 08:36:01 -07:00
Krrish Dholakia a18844b230 fix(utils.py): use llama tokenizer for replicate models 2024-04-29 08:28:31 -07:00
Krrish Dholakia dc5c175406 build(model_prices_and_context_window.json): add token-based replicate costs to model cost map 2024-04-29 08:20:44 -07:00
Krrish Dholakia ab954243e8 fix(utils.py): fix watson streaming 2024-04-29 08:09:59 -07:00
Krrish Dholakia 2cfb97141d fix(utils.py): replicate now also has token based pricing for some models 2024-04-29 08:06:15 -07:00
Krrish Dholakia 0a6b6302f1 fix(router.py): fix typing error 2024-04-29 07:25:39 -07:00
Krrish Dholakia 7b617e666d fix(proxy_server.py): return more detailed auth error message. 2024-04-29 07:24:19 -07:00
Krish DholakiaandGitHub ffc6af0b22 Merge pull request #3334 from CyanideByte/main
protected_namespaces warning fixed for model_name & model_info
2024-04-29 07:16:05 -07:00
Krrish Dholakia f74a43aa78 docs(vllm.md): update docs to tell people to check openai-compatible endpoint docs for vllm 2024-04-28 09:48:03 -07:00
Krrish Dholakia 1f6c342e94 test: fix test 2024-04-28 09:45:01 -07:00
Krish DholakiaandGitHub 39244cd517 Merge pull request #3331 from BerriAI/litellm_common_auth_params
feat(utils.py): unify common auth params across azure/vertex_ai/bedrock/watsonx
2024-04-28 09:27:07 -07:00
Krish DholakiaandGitHub 1841b74f49 Merge branch 'main' into litellm_common_auth_params 2024-04-28 08:38:06 -07:00
Krrish Dholakia b9c0b55e7c test: fix test - set num_retries=0 v1.35.31 2024-04-27 21:02:19 -07:00
CyanideByteandGitHub 82be9a7e67 Merge branch 'BerriAI:main' into main 2024-04-27 20:51:33 -07:00
CyanideByte 03a43b99a5 Added _types.py cases from edwinjosegeorge PR#3340 2024-04-27 20:42:54 -07:00
Ishaan Jaff 1543efd5d4 bump: version 1.35.30 → 1.35.31 2024-04-27 19:08:36 -07:00
Krrish Dholakia 3e8d9fc80d test: skip local test 2024-04-27 19:07:49 -07:00
Ishaan JaffandGitHub d42c3309ec Merge pull request #3338 from BerriAI/litellm_alerting_sort_latencies
Fix - slack alerting show deployment latencies in sorted order
2024-04-27 18:40:07 -07:00
Krrish Dholakia a3257fd5d3 test(test_router_init.py): fix test 2024-04-27 18:40:00 -07:00
Ishaan JaffandGitHub a72167e88b Merge pull request #3336 from BerriAI/litellm_link_traces_hanging_requests
[Fix] - Link Langfuse Traces to Slack Alerts
2024-04-27 18:39:54 -07:00
Krrish Dholakia d07713a275 test: fix test 2024-04-27 17:48:07 -07:00
Krrish Dholakia 280148543f fix(router.py): fix trailing slash handling for api base which contains /v1 2024-04-27 17:36:28 -07:00
Ishaan Jaff de8f928bdd ui - new build 2024-04-27 17:28:30 -07:00
Ishaan JaffandGitHub f348024db7 Merge pull request #3339 from BerriAI/ui_fix_models_not_appear_bug
UI -  fix bug showing models to pic
2024-04-27 17:24:48 -07:00
Krrish Dholakia ec19c1654b fix(router.py): set initial value of default litellm params to none 2024-04-27 17:22:50 -07:00
Krrish Dholakia d9e0d7ce52 test: replace flaky endpoint 2024-04-27 16:37:09 -07:00
Ishaan Jaff 0e891528b6 ui - fix bug showing mdoels to pic 2024-04-27 16:01:50 -07:00
Krrish Dholakia 87aad0d2c8 fix(router.py): fix router should retry logic 2024-04-27 15:59:38 -07:00
Ishaan JaffandGitHub 2f9418eb46 Merge pull request #3337 from BerriAI/litellm_docs_alerting
docs - alerting
2024-04-27 15:46:57 -07:00
CyanideByte a4c7d933a9 Added pytest for pydantic protected namespace warning 2024-04-27 15:44:40 -07:00
Ishaan Jaff cc51db1999 fix slack alerting show deployment latencies 2024-04-27 15:44:30 -07:00
Ishaan Jaff 3b8126cf51 docs - alerting 2024-04-27 15:33:21 -07:00
Ishaan Jaff d6827c3574 fix - link to langfuse traces on slack alerts 2024-04-27 15:23:18 -07:00
Krrish Dholakia 9f24421d44 fix(router.py): fix router should_retry 2024-04-27 15:13:20 -07:00
Ishaan Jaff 1b586e5042 fix - allow langfuse init with flush interval 2024-04-27 14:53:18 -07:00
Krrish Dholakia 5e0bd5982e fix(router.py): fix sync should_retry logic 2024-04-27 14:48:07 -07:00
Ishaan JaffandGitHub f31d3c4e9f Merge pull request #3335 from BerriAI/litellm_fix_ui_cross_global_budget
Fix -  Admin UI stops working if proxy budget has been exceeded
2024-04-27 14:18:12 -07:00
Krrish Dholakia 5f0f3f9fe3 fix(utils.py): don't return usage for streaming - openai spec 2024-04-27 14:13:34 -07:00
Ishaan Jaff e49fe47d2e fix - only run global_proxy_spend on chat completion calls 2024-04-27 14:11:00 -07:00
CyanideByte e1786848cb protected_namespaces fixed for model_info 2024-04-27 13:08:45 -07:00
Krrish Dholakia 463b1aff24 fix(vertex_ai.py): support safety settings for async streaming calls 2024-04-27 11:43:22 -07:00
Ishaan JaffandGitHub 6762d07c7f Merge pull request #3330 from BerriAI/litellm_rdct_msgs
[Feat] Redact Logging Messages/Response content on Logging Providers with `litellm.turn_off_message_logging=True`
2024-04-27 11:25:09 -07:00
Ishaan Jaff f55838d185 sentry redact messages 2024-04-27 11:23:46 -07:00
Ishaan Jaff 01478c9148 docs - langfuse redact messages 2024-04-27 11:23:35 -07:00
Ishaan Jaff 4ce27e1219 fix - sentry data redaction 2024-04-27 11:23:08 -07:00
Krish DholakiaandGitHub 7502cb1aa8 Merge pull request #3302 from BerriAI/litellm_default_router_retries
fix(router.py): fix default retry logic
2024-04-27 11:22:03 -07:00
Krish DholakiaandGitHub 1a06f009d1 Merge branch 'main' into litellm_default_router_retries 2024-04-27 11:21:57 -07:00
Krish DholakiaandGitHub 07d8f189ec Merge pull request #3326 from simonsanvil/feature/watsonx-integration
Add watsonx to list of model providers and fixed typo in colab notebook
2024-04-27 11:21:13 -07:00