Krrish Dholakia
a9f3fd4030
test(test_function_calling.py): remove flaky groq test
2024-04-19 16:41:23 -07:00
Krrish Dholakia
62aab91186
test(test_prometheus_service.py): remove duplicate test
2024-04-19 16:23:47 -07:00
Ishaan Jaff and GitHub
63632c907f
Merge pull request #3183 from BerriAI/langfuse_log_proxy_base_url
...
[Fix] - Langfuse log proxy_base_url to langfuse as a tag (if set by user)
2024-04-19 16:21:29 -07:00
Krrish Dholakia
41c81f6335
fix: fix tests
2024-04-19 16:21:15 -07:00
Ishaan Jaff
788394b1ec
fix - logging proxy base url to langfuse
2024-04-19 16:20:46 -07:00
Krrish Dholakia
0d9c96bebf
test(test_prometheus_services.py): fix testing to handle caching ping in init
2024-04-19 16:15:29 -07:00
Ishaan Jaff
def5ce4888
fix user needs to opt in to langfuse tags
2024-04-19 16:13:14 -07:00
Ishaan Jaff
c59051895b
fix - allow users to opt into langfuse default tags
2024-04-19 16:05:31 -07:00
Ishaan Jaff
2c76448756
fix - allow users to opt into langfuse default tags
2024-04-19 16:01:27 -07:00
frob and GitHub
5fb5bce780
Merge branch 'BerriAI:main' into ollama-special-symbol
2024-04-20 00:49:57 +02:00
Ishaan Jaff
c0befe9bbb
feat - log base_url to langfuse as a tag
2024-04-19 15:48:00 -07:00
Krrish Dholakia
62a8bf134f
fix(http_handler.py): fix linting error
2024-04-19 15:45:24 -07:00
Krish Dholakia and GitHub
dc932ac518
Merge pull request #3174 from jmandel/fix-claude-streaming
...
fix: Stream completion responses from anthropic. (Fix #3129 )
2024-04-19 15:37:29 -07:00
Ishaan Jaff and GitHub
48e5de4f0e
Merge pull request #3175 from BerriAI/litellm_log_team_alias_langfuse
...
[FEAT] Log team alias to langfuse
2024-04-19 15:30:59 -07:00
Ishaan Jaff and GitHub
c7b0d59bdc
Merge pull request #3180 from BerriAI/ui_create_user_flow
...
[UI] Show teams as dropdown in invite user flow
2024-04-19 15:27:27 -07:00
Krrish Dholakia
84685b5f34
fix(_redis.py): fix args passed to redis.from_url argument
2024-04-19 15:27:11 -07:00
Ishaan Jaff
5613f9b30a
UI - invite user flow
2024-04-19 15:26:29 -07:00
Ishaan Jaff
5d9f6282ce
create_user using user_email
2024-04-19 15:17:50 -07:00
Ishaan Jaff
559a312c9c
ui - show teams as dropdown in create user flow
2024-04-19 15:07:13 -07:00
Krrish Dholakia
01a1a8f731
fix(caching.py): dual cache async_batch_get_cache fix + testing
...
this fixes a bug in usage-based-routing-v2 which was caused b/c of how the result was being returned from dual cache async_batch_get_cache. it also adds unit testing for that function (and it's sync equivalent)
2024-04-19 15:03:25 -07:00
Ishaan Jaff
3167c9da9f
fix - use user_api_key_team_alias as the default tag on langfuse
2024-04-19 14:43:41 -07:00
Ishaan Jaff and GitHub
f220a337bd
Merge pull request #3176 from BerriAI/add_llama3_groq
...
[FEAT] Add `groq/llama3`
2024-04-19 14:40:10 -07:00
Ishaan Jaff
e8de984b38
docs - add groq llama3
2024-04-19 14:34:45 -07:00
Ishaan Jaff
12bf4346ec
feat - add llama3 on groq
2024-04-19 14:34:38 -07:00
Ishaan Jaff
410d1f2d2c
langfuse - log team alias
2024-04-19 14:26:58 -07:00
Josh Mandel
f411443e58
fix: Stream completion responses from anthropic. (Fix 3129)
2024-04-19 16:13:19 -05:00
Krrish Dholakia
08cf77623b
fix(caching.py): remove url parsing logic - causing redis ssl connections to fail
...
this reverts a change that was causing redis url w/ ssl to fail. this also adds unit testing for this sc
enario, to prevent future regressions
2024-04-19 14:01:13 -07:00
Krrish Dholakia
3c6b6355c7
fix(ollama_chat.py): accept api key as a param for ollama calls
...
allows user to call hosted ollama endpoint using bearer token for auth
2024-04-19 13:02:13 -07:00
frob and GitHub
3df7231fa5
Disable special tokens in ollama completion when counting tokens
...
Some(?) models (eg, codegemma) don't return a prompt_eval_count field, so ollama.py tries to compute the value based on encoding of the prompt. Unfortunately FIM symbols used in the prompt (eg, "<|fim_prefix|>") cause the encoder to throw an exception, so we disable special processing.
2024-04-19 21:38:42 +02:00
Ishaan Jaff
423121ff7d
feat - track team_alias is metadata for /chat, /embeddings
2024-04-19 10:52:54 -07:00
Ishaan Jaff
6d92b13c22
feat - log team_alias to langfuse
2024-04-19 10:29:42 -07:00
Ishaan Jaff and GitHub
b2bdc99474
Merge pull request #2961 from Manouchehri/langfuse-add-region-2937
...
(feat) Langfuse - Add location logging, and add cache_hit to metadata.
2024-04-19 10:06:34 -07:00
Krrish Dholakia
717abfef98
build(interpret_load_test.py): add hosted proxy info on release notes
2024-04-18 22:40:10 -07:00
Krrish Dholakia
d10743a609
bump: version 1.35.14 → 1.35.15
2024-04-18 22:17:33 -07:00
Krrish Dholakia
9e91541b8a
refactor(main.py): trigger new build
2024-04-18 22:17:19 -07:00
Krish Dholakia and GitHub
f1340b52dc
Merge pull request #3153 from BerriAI/litellm_usage_based_routing_v2_improvements
...
usage based routing v2 improvements - unit testing + *NEW* async + sync 'pre_call_checks'
2024-04-18 22:16:16 -07:00
Krrish Dholakia
9c42c847a5
fix(router.py): instrument pre-call-checks for all openai endpoints
2024-04-18 21:54:25 -07:00
Krrish Dholakia
3b9e2a58e2
fix(lowest_tpm_rpm_v2.py): ensure backwards compatibility for python 3.8
2024-04-18 21:42:35 -07:00
Krrish Dholakia
81573b2dd9
fix(test_lowest_tpm_rpm_routing_v2.py): unit testing for usage-based-routing-v2
2024-04-18 21:38:00 -07:00
Ishaan Jaff
c903b44849
(ci/cd) vertexai - skip 429 errors
2024-04-18 21:27:22 -07:00
Ishaan Jaff
cb053398eb
(ci/cd) run again
2024-04-18 21:04:07 -07:00
Ishaan Jaff and GitHub
c720c8ffe9
Merge pull request #3152 from BerriAI/litellm_show_api_base_hanging_req
...
[Fix] show api base hanging request alerts
2024-04-18 21:02:30 -07:00
Ishaan Jaff
6f948cd559
fix - show api_base in hanging requests
2024-04-18 21:01:26 -07:00
Ishaan Jaff
67d356b933
fix - show api base on hanging requests
2024-04-18 20:58:02 -07:00
Ishaan Jaff
f04604910b
fix - show api base on hanging requests
2024-04-18 20:57:22 -07:00
Ishaan Jaff
8c830e031d
(ci/cd) run again
2024-04-18 20:35:21 -07:00
Ishaan Jaff
7d2fb6da04
bump: version 1.35.13 → 1.35.14
2024-04-18 20:23:58 -07:00
Ishaan Jaff
5b55900d8e
fix - view spend per user
2024-04-18 20:23:04 -07:00
Ishaan Jaff
e95e7fde65
ui - new build
2024-04-18 20:18:50 -07:00
Ishaan Jaff and GitHub
0ed5cfc9de
Merge pull request #3151 from BerriAI/litellm_allow_set_get_alerts
...
[UI] View all alert types
2024-04-18 20:12:54 -07:00
Krrish Dholakia