11302 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Krrish Dholakia	853b70aba9	fix(langfuse.py): support 'existing_trace_id' param ... allow user to call out a trace as pre-existing, this prevents creating a default trace name, and potentially overwriting past traces	2024-04-29 16:39:17 -07:00
Krrish Dholakia	2cf069befb	fix(langfuse.py): don't set default trace_name if trace_id given	2024-04-29 16:39:17 -07:00
Ishaan JaffandGitHub	d58dd2cbeb	Merge pull request #3360 from BerriAI/litellm_random_pick_lowest_latency ... [Fix] Lowest Latency routing - random pick deployments when all latencies=0 v1.35.32.dev1	2024-04-29 16:31:32 -07:00
Krrish Dholakia	77f155d158	docs(load_test.md): cleanup docs	2024-04-29 16:27:58 -07:00
Krrish Dholakia	af6a21f27c	docs(load_test.md): add multi-instance router load test to docs	2024-04-29 16:25:56 -07:00
Ishaan Jaff	4cb4a7f06d	fix - lowest latency routing	2024-04-29 16:02:57 -07:00
Krrish Dholakia	8f830bd948	docs(load_test.md): simplify doc	2024-04-29 16:00:02 -07:00
Krrish Dholakia	fcb83781ec	docs(load_test.md): formatting	2024-04-29 15:58:41 -07:00
Krrish Dholakia	5fe0f38558	docs(load_test.md): load test multiple instances of the proxy w/ tpm/rpm limits on deployments	2024-04-29 15:58:14 -07:00
Ishaan Jaff	3b0aa05378	fix lowest latency - routing	2024-04-29 15:51:52 -07:00
Ishaan Jaff	5247d7b6a5	test - lowest latency router	2024-04-29 15:51:01 -07:00
Krrish Dholakia	cef2d95bb4	docs(routing.md): add max parallel requests to router docs	2024-04-29 15:37:48 -07:00
Krrish Dholakia	a978f2d881	fix(lowest_tpm_rpm_v2.py): shuffle deployments with same tpm values	2024-04-29 15:23:47 -07:00
Krrish Dholakia	f10a066d36	fix(lowest_tpm_rpm_v2.py): add more detail to 'No deployments available' error message v1.35.32	2024-04-29 15:04:37 -07:00
Ishaan JaffandGitHub	de3e642999	Merge pull request #3359 from BerriAI/litellm_docs_trackin_cost ... docs - update track cost with custom callbacks	2024-04-29 13:19:25 -07:00
Ishaan Jaff	8d26030b99	docs - track cost custom callbacks	2024-04-29 13:15:08 -07:00
sumanth	89e655c79e	usage based routing RPM count fix	2024-04-30 00:29:38 +05:30
Krrish Dholakia	4b04b017df	bump: version 1.35.31 → 1.35.32	2024-04-29 09:16:44 -07:00
Krish DholakiaandGitHub	ec2510029a	Merge pull request #3354 from BerriAI/litellm_replicate_cost_tracking ... fix(utils.py): replicate now also has token based pricing for some models	2024-04-29 09:13:41 -07:00
Krrish Dholakia	3725732c4d	fix(utils.py): default to time-based tracking for unmapped replicate models. fix time-based cost calc for replicate	2024-04-29 08:36:01 -07:00
Krrish Dholakia	a18844b230	fix(utils.py): use llama tokenizer for replicate models	2024-04-29 08:28:31 -07:00
Krrish Dholakia	dc5c175406	build(model_prices_and_context_window.json): add token-based replicate costs to model cost map	2024-04-29 08:20:44 -07:00
Krrish Dholakia	ab954243e8	fix(utils.py): fix watson streaming	2024-04-29 08:09:59 -07:00
Krrish Dholakia	2cfb97141d	fix(utils.py): replicate now also has token based pricing for some models	2024-04-29 08:06:15 -07:00
alisalim17	0aa8b94ff5	test: completion with Cohere command-r-plus model	2024-04-29 18:38:12 +04:00
Krrish Dholakia	0a6b6302f1	fix(router.py): fix typing error	2024-04-29 07:25:39 -07:00
Krrish Dholakia	7b617e666d	fix(proxy_server.py): return more detailed auth error message.	2024-04-29 07:24:19 -07:00
Krish DholakiaandGitHub	ffc6af0b22	Merge pull request #3334 from CyanideByte/main ... protected_namespaces warning fixed for model_name & model_info	2024-04-29 07:16:05 -07:00
Lucca Zenobio	a9e2ef6212	test	2024-04-29 10:05:30 -03:00
alisalim17	0db7fa3fd8	fix: cohere tool results	2024-04-29 14:20:24 +04:00
jinno	aa6576ad42	docs: add .github/pull_request_template.md	2024-04-29 12:41:29 +09:00
Krrish Dholakia	f74a43aa78	docs(vllm.md): update docs to tell people to check openai-compatible endpoint docs for vllm	2024-04-28 09:48:03 -07:00
Krrish Dholakia	1f6c342e94	test: fix test	2024-04-28 09:45:01 -07:00
Krish DholakiaandGitHub	39244cd517	Merge pull request #3331 from BerriAI/litellm_common_auth_params ... feat(utils.py): unify common auth params across azure/vertex_ai/bedrock/watsonx	2024-04-28 09:27:07 -07:00
Krish DholakiaandGitHub	1841b74f49	Merge branch 'main' into litellm_common_auth_params	2024-04-28 08:38:06 -07:00
Krrish Dholakia	b9c0b55e7c	test: fix test - set num_retries=0 v1.35.31	2024-04-27 21:02:19 -07:00
CyanideByteandGitHub	82be9a7e67	Merge branch 'BerriAI:main' into main	2024-04-27 20:51:33 -07:00
CyanideByte	03a43b99a5	Added _types.py cases from edwinjosegeorge PR#3340	2024-04-27 20:42:54 -07:00
Ishaan Jaff	1543efd5d4	bump: version 1.35.30 → 1.35.31	2024-04-27 19:08:36 -07:00
Krrish Dholakia	3e8d9fc80d	test: skip local test	2024-04-27 19:07:49 -07:00
Ishaan JaffandGitHub	d42c3309ec	Merge pull request #3338 from BerriAI/litellm_alerting_sort_latencies ... Fix - slack alerting show deployment latencies in sorted order	2024-04-27 18:40:07 -07:00
Krrish Dholakia	a3257fd5d3	test(test_router_init.py): fix test	2024-04-27 18:40:00 -07:00
Ishaan JaffandGitHub	a72167e88b	Merge pull request #3336 from BerriAI/litellm_link_traces_hanging_requests ... [Fix] - Link Langfuse Traces to Slack Alerts	2024-04-27 18:39:54 -07:00
Krrish Dholakia	d07713a275	test: fix test	2024-04-27 17:48:07 -07:00
Krrish Dholakia	280148543f	fix(router.py): fix trailing slash handling for api base which contains /v1	2024-04-27 17:36:28 -07:00
Ishaan Jaff	de8f928bdd	ui - new build	2024-04-27 17:28:30 -07:00
Ishaan JaffandGitHub	f348024db7	Merge pull request #3339 from BerriAI/ui_fix_models_not_appear_bug ... UI - fix bug showing models to pic	2024-04-27 17:24:48 -07:00
Krrish Dholakia	ec19c1654b	fix(router.py): set initial value of default litellm params to none	2024-04-27 17:22:50 -07:00
Krrish Dholakia	d9e0d7ce52	test: replace flaky endpoint	2024-04-27 16:37:09 -07:00
Ishaan Jaff	0e891528b6	ui - fix bug showing mdoels to pic	2024-04-27 16:01:50 -07:00