Commit Graph
11302 Commits
Author SHA1 Message Date
Ishaan Jaff bfc84a7e81 fix - slack alerting use one httpx client for alerts 2024-04-23 18:47:39 -07:00
Ishaan Jaff 31979f83d2 fix - refactor slack alerting 2024-04-23 18:34:11 -07:00
Ishaan Jaff 37069f45cb fix - use one slack class 2024-04-23 18:31:15 -07:00
Krish DholakiaandGitHub 8d2e411df6 Merge pull request #3124 from elisalimli/bugfix/add-missing-tool-calls-mistral-messages
Add missing tool_calls and name to messages
2024-04-23 17:25:12 -07:00
Krrish Dholakia 72ac0d26e3 test: fix test 2024-04-23 16:56:48 -07:00
Krrish Dholakia d67e47d7fd fix(test_caching.py): add longer delay for async test 2024-04-23 16:13:03 -07:00
Krrish Dholakia 305d526140 build(model_prices_and_context_window.json): add claude 3 supporting function calling as true flag 2024-04-23 15:38:42 -07:00
Ishaan JaffandGitHub 16d245468a Merge pull request #3252 from Manouchehri/groq-seed-1
(utils.py) - Add seed for Groq
2024-04-23 14:40:20 -07:00
David Manouchehri 69ddd7c68f (utils.py) - Add seed for Groq 2024-04-23 20:32:21 +00:00
Ishaan JaffandGitHub e29cf9ab38 Merge pull request #3249 from BerriAI/ui_router_Settings
ui - cleanup showing router settings
2024-04-23 13:04:01 -07:00
Krrish Dholakia 161e836427 fix(utils.py): fix 'no-cache': true when caching is turned on 2024-04-23 12:58:30 -07:00
Ishaan JaffandGitHub e15ce79833 Merge pull request #3244 from BerriAI/litellm_fix_linking_langfuse_slack_alerts
[Fix] Linking Langfuse Projects to Slack Alerts
v1.35.20.dev2
2024-04-23 12:53:18 -07:00
Ishaan Jaff eada6f6d5d ui - cleanup showing router settings 2024-04-23 12:34:00 -07:00
Ishaan JaffandGitHub 0b604146ae Merge pull request #3245 from BerriAI/litellm_router_settings_cleanup
[Fix] Proxy: updating router settings from UI
2024-04-23 12:10:13 -07:00
Ishaan Jaff 41ab5f2f56 fix - updating router settings from DB 2024-04-23 12:07:58 -07:00
Ishaan Jaff 5118c96b4d fix langfuse project id 2024-04-23 11:37:17 -07:00
Krish DholakiaandGitHub caca6a11d7 Merge pull request #3242 from BerriAI/litellm_router_fixes_2
fix(router.py) handle initial model list being empty
2024-04-23 10:55:19 -07:00
Krrish Dholakia 9d2726c2ac fix(proxy_server.py): handle router being initialized without a model list 2024-04-23 10:52:28 -07:00
dependabot[bot]andGitHub 7ca8809889 build(deps): bump hono from 4.1.5 to 4.2.7 in /litellm-js/spend-logs
Bumps [hono](https://github.com/honojs/hono) from 4.1.5 to 4.2.7.
- [Release notes](https://github.com/honojs/hono/releases)
- [Commits](https://github.com/honojs/hono/compare/v4.1.5...v4.2.7)

---
updated-dependencies:
- dependency-name: hono
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-04-23 16:25:03 +00:00
Simon Sanchez Viloria f9a7456eaa (docs) updated cookbook 2024-04-23 16:22:41 +02:00
Simon Sanchez Viloria d72b725273 Fixed bugs in prompt factory for ibm-mistral and llama 3 models. 2024-04-23 16:20:49 +02:00
Simon S. ViloriaandGitHub 2ef4fb2efa Merge branch 'BerriAI:main' into feature/watsonx-integration 2024-04-23 12:18:34 +02:00
Simon Sanchez Viloria e64aceea91 (feat) Update WatsonX credentials and variable names 2024-04-23 12:16:04 +02:00
Simon Sanchez Viloria 7cbe9835c9 (docs) updated litellm watsonx cookbook 2024-04-23 12:01:13 +02:00
Simon Sanchez Viloria 74d2ba0a23 feat - watsonx refractoring, removed dependency, and added support for embedding calls 2024-04-23 12:01:13 +02:00
Ishaan JaffandGitHub 774fb33f28 Merge pull request #3231 from Manouchehri/fix-groq-1
(utils.py) - Fix response_format typo for Groq
2024-04-22 22:06:48 -07:00
David Manouchehri 6d61607ee3 (utils.py) - Fix response_format typo for Groq 2024-04-23 04:26:26 +00:00
Krrish Dholakia 8b74b52932 docs(caching.md): add redis ssl to docs 2024-04-22 19:32:03 -07:00
Krrish Dholakia ec2c70e362 fix(vertex_ai.py): fix streaming logic v1.35.20 2024-04-22 19:15:20 -07:00
Krrish Dholakia 0bb8a4434e fix(vertex_ai.py): remove ExtendedGenerationConfig usage 2024-04-22 18:23:21 -07:00
Ishaan Jaff 7e9587c102 ui - new build 2024-04-22 18:16:54 -07:00
Ishaan JaffandGitHub fdf432798e Merge pull request #3228 from BerriAI/litellm_ui_polish
[Fix] Non-Admin SSO Login
2024-04-22 18:15:10 -07:00
Ishaan Jaff 9250f61a4c fix - sso login for non admins 2024-04-22 17:57:47 -07:00
Krish DholakiaandGitHub 14d92aa944 Merge pull request #3214 from Manouchehri/add-p-and-f-pen-gemmini-1
(Vertex AI) - Add `frequency_penalty` and `presence_penalty` support
2024-04-22 16:46:49 -07:00
Krish DholakiaandGitHub b1512d23be Merge pull request #3211 from Manouchehri/simplify-gemini-config-1
improve(vertex_ai.py): Switch to simpler dict type for supporting JSON mode
2024-04-22 16:46:33 -07:00
Ishaan JaffandGitHub 9886392694 Merge pull request #3226 from BerriAI/litellm_alerting_fix
[Bug-Fix] Alerting - don't send hanging request alert on failed request
2024-04-22 16:32:35 -07:00
Ishaan Jaff bd0d6bce0f fix models displayed when logging in 2024-04-22 16:31:47 -07:00
Ishaan Jaff 8874eaa0b3 fix - track litellm_status=fail 2024-04-22 16:11:04 -07:00
Ishaan Jaff 517f577292 fix - dont send alert on fail request 2024-04-22 16:07:58 -07:00
Krish DholakiaandGitHub 9a49065b0b Merge pull request #3224 from BerriAI/litellm_prometheus_key_owner
fix(prometheus.py): add user tracking to prometheus
2024-04-22 15:45:26 -07:00
Ishaan JaffandGitHub dbb06141a3 Merge pull request #3219 from BerriAI/litellm_ui_show_teams_ui
[UI-Fix] Show all teams on Admin UI
2024-04-22 15:22:14 -07:00
Ishaan JaffandGitHub c777e5d9d2 Merge pull request #3223 from paul-gauthier/main
Added openrouter/meta-llama/llama-3-70b-instruct context and cost metrics
2024-04-22 15:18:07 -07:00
Krrish Dholakia 6ac0dba5c2 fix(prometheus.py): add user tracking to prometheus 2024-04-22 15:14:38 -07:00
Paul Gauthier 0a021a6fa2 Added openrouter/meta-llama/llama-3-70b-instruct context and cost metadata
Per https://openrouter.ai/models/meta-llama/llama-3-70b-instruct

Meta: Llama 3 70B Instruct
meta-llama/llama-3-70b-instruct

Updated Apr 18
8,192 context
$0.8/M input tkns
$0.8/M output tkns
2024-04-22 15:07:58 -07:00
Ishaan JaffandGitHub aa73c115f6 Merge pull request #3205 from bllchmbrs/patch-1
Update langsmith_integration.md
2024-04-22 14:21:25 -07:00
Ishaan JaffandGitHub 4fbb92e9e9 Merge pull request #3218 from BerriAI/ui_cleanup_text_input
[UI-Polish] Cleanup Inputing Key Name, Team Name, User Email
2024-04-22 14:20:29 -07:00
Ishaan Jaff 50bbd188fb ui - show all teams on ui 1.35.19.dev1 2024-04-22 14:15:50 -07:00
Ishaan Jaff cd3b2a21c1 ui - find all teams 2024-04-22 14:15:09 -07:00
Ishaan JaffandGitHub 877c4e27f4 Merge pull request #3212 from BerriAI/ui_increase_default_session_time
UI - increase default session time to 2 hours
2024-04-22 13:46:18 -07:00
Ishaan JaffandGitHub 1a945092de Merge pull request #3210 from BerriAI/litellm_ui_round_up_team_spend_2_decimals
[UI] round up team spend to 2 decimals + diversify legend for team spend
2024-04-22 13:45:52 -07:00