14667 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Ishaan Jaff	e65daef572	router return get_deployment_by_model_group_name	2024-07-15 19:27:12 -07:00
Ishaan Jaff	865469e43f	allow setting max_file_size_mb	2024-07-15 19:25:24 -07:00
Ishaan Jaff	a900f352b5	fix - don't write file.filename v1.41.22.dev4	2024-07-15 14:56:01 -07:00
Ishaan Jaff	3dc2ec8119	fix show debugging utils on in mem usage	2024-07-15 10:05:57 -07:00
Krrish Dholakia	2bf1f06a0e	bump: version 1.41.21 → 1.41.22 v1.41.22	2024-07-14 08:06:53 -07:00
Krrish Dholakia	82ca7af6df	fix(vertex_httpx.py): google search grounding fix	2024-07-14 08:06:17 -07:00
Krrish Dholakia	385da04d72	docs(vertex.md): add reference vertex ai grounding doc	2024-07-13 22:04:38 -07:00
Krrish Dholakia	fe6ea9f892	docs(user_keys.md): add openai js example to docs	2024-07-13 22:00:53 -07:00
Krish DholakiaandGitHub	6bf60d773e	Merge pull request #4696 from BerriAI/litellm_guardrail_logging_only ... Allow setting `logging_only` in guardrails config	2024-07-13 21:50:43 -07:00
Krish DholakiaandGitHub	1e2e67c3fe	Merge pull request #4702 from BerriAI/litellm_add_azure_ai_pricing ... add azure ai pricing + token info (mistral/jamba instruct/llama3)	2024-07-13 21:50:31 -07:00
Krish DholakiaandGitHub	7bc9a189e7	Merge branch 'main' into litellm_add_azure_ai_pricing	2024-07-13 21:50:26 -07:00
Krrish Dholakia	9cca25f874	test(test_end_users.py): fix test	2024-07-13 21:46:19 -07:00
Krrish Dholakia	d475311eb3	test(test_presidio_pii_masking.py): fix presidio test	2024-07-13 21:44:22 -07:00
Krish DholakiaandGitHub	d0fb685c56	Merge pull request #4706 from BerriAI/litellm_retry_after ... Return `retry-after` header for rate limited requests	2024-07-13 21:37:41 -07:00
Krrish Dholakia	de8230ed41	fix(proxy_server.py): fix returning response headers on exception	2024-07-13 19:11:30 -07:00
Ishaan JaffandGitHub	4d7d6504b6	Merge pull request #4704 from BerriAI/litellm_debug_mem ... [Debug-Utils] Add some useful memory usage debugging utils	2024-07-13 18:44:40 -07:00
Ishaan JaffandGitHub	ed5114c680	Merge pull request #4703 from BerriAI/litellm_only_use_internal_use_cache ... [Fix Memory Usage] - only use per request tracking if slack alerting is being used	2024-07-13 18:40:22 -07:00
Ishaan JaffandGitHub	785081422c	Merge pull request #4705 from BerriAI/litellm_return_internal_cache_usage ... feat mem utils debugging return size of in memory cache	2024-07-13 18:24:53 -07:00
Ishaan Jaff	31783196c0	feat - return size of in memory cache	2024-07-13 18:22:44 -07:00
Ishaan Jaff	759e02bdaa	debug mem issues show growth	2024-07-13 18:05:19 -07:00
Ishaan Jaff	69f74c1e6c	fix only use per request tracking if slack alerting is being used	2024-07-13 18:01:53 -07:00
Krrish Dholakia	fde434be66	feat(proxy_server.py): return 'retry-after' param for rate limited requests ... Closes https://github.com/BerriAI/litellm/issues/4695	2024-07-13 17:15:20 -07:00
Krrish Dholakia	bc9fe23ebf	fix: cleanup	2024-07-13 16:36:04 -07:00
Krrish Dholakia	b1be355d42	build(model_prices_and_context_window.json): add azure ai jamba instruct pricing + token details ... Adds jamba instruct, mistral, llama3 pricing + token info for azure_ai	2024-07-13 16:34:31 -07:00
Ishaan Jaff	5c6e24370e	bump: version 1.41.20 → 1.41.21 v1.41.21	2024-07-13 16:05:52 -07:00
Krish DholakiaandGitHub	bc58e44d8f	Merge pull request #4701 from BerriAI/litellm_rpm_support_passthrough ... Support key-rpm limits on pass-through endpoints	2024-07-13 15:22:29 -07:00
Krrish Dholakia	a6deb9c350	docs(pass_through.md): update doc to specify key rpm limits will be enforced	2024-07-13 15:10:13 -07:00
Ishaan JaffandGitHub	1206b0b6a9	Merge pull request #4693 from BerriAI/litellm_bad_req_error_mapping ... fix - Raise `BadRequestError` when passing the wrong role	2024-07-13 15:05:54 -07:00
Krrish Dholakia	da4bd47e3e	test: test fixes	2024-07-13 15:04:13 -07:00
Krrish Dholakia	77325358b4	fix(pass_through_endpoints.py): fix client init	2024-07-13 14:46:56 -07:00
Ishaan JaffandGitHub	c1a9881d5c	Merge pull request #4697 from BerriAI/litellm_fix_sso_bug ... [Fix] Bug - Clear user_id from cache when /user/update is called	2024-07-13 14:39:47 -07:00
Krrish Dholakia	7e769f3b89	fix: fix linting errors	2024-07-13 14:39:42 -07:00
Ishaan Jaff	fad37a969b	ui new build	2024-07-13 14:38:13 -07:00
Ishaan JaffandGitHub	b0a1ed72b1	Merge pull request #4692 from BerriAI/ui_fix_cache_ratio_calc ... [UI] Fix Cache Ratio Calc	2024-07-13 14:36:39 -07:00
Krrish Dholakia	55e153556a	test(test_pass_through_endpoints.py): add test for rpm limit support	2024-07-13 13:49:20 -07:00
Krrish Dholakia	0cc273d77b	feat(pass_through_endpoint.py): support enforcing key rpm limits on pass through endpoints ... Closes https://github.com/BerriAI/litellm/issues/4698	2024-07-13 13:29:44 -07:00
Ishaan Jaff	bba748eaf4	fix test rules	2024-07-13 13:23:23 -07:00
Ishaan Jaff	a447e4dd1a	delete updated / deleted values from cache	2024-07-13 13:16:57 -07:00
Ishaan Jaff	56b69eba18	test updating user role	2024-07-13 13:13:40 -07:00
Krrish Dholakia	f1fe229bb1	docs(guardrails.md): update guardrail api spec	2024-07-13 12:34:49 -07:00
Ishaan Jaff	893ed4e5f1	correctly clear cache when updating a user	2024-07-13 12:33:43 -07:00
Ishaan Jaff	bc91025307	use wrapper on /user endpoints	2024-07-13 12:29:15 -07:00
Ishaan Jaff	677db38f8b	add doc string to explain what delete cache does	2024-07-13 12:25:31 -07:00
Krrish Dholakia	6b78e39600	feat(guardrails.py): allow setting logging_only in guardrails_config for presidio pii masking integration	2024-07-13 12:22:17 -07:00
Ishaan Jaff	670bf1b98d	correctly flush cache when updating user	2024-07-13 12:05:09 -07:00
Krrish Dholakia	f2522867ed	fix(types/guardrails.py): add 'logging_only' param support	2024-07-13 11:44:37 -07:00
Krrish Dholakia	caa01d20cb	build: re-run ci/cd	2024-07-13 11:41:35 -07:00
Ishaan Jaff	bcc89a2c3a	fix testing exception mapping	2024-07-13 11:10:13 -07:00
Krrish Dholakia	9d02d51a17	docs(pass_through.md): cleanup docs	2024-07-13 09:56:06 -07:00
Ishaan Jaff	d0dbc0742b	fix exception raised in factory.py	2024-07-13 09:55:04 -07:00