Commit Graph
16492 Commits
Author SHA1 Message Date
Ishaan Jaff 0d41e2972b docs on oauth 2.0 2024-08-16 13:55:28 -07:00
Ishaan Jaff cd28b6607e add debugging for oauth2.0 2024-08-16 13:40:32 -07:00
Ishaan Jaff d4b33cf87c allow using oauth2 checks for logging into proxy 2024-08-16 13:36:29 -07:00
Ishaan Jaff 0c0b835c3f add init commit for oauth 2 checks 2024-08-16 13:30:22 -07:00
Ishaan Jaff 9c3124c5a7 ui new build 2024-08-16 12:53:23 -07:00
Ishaan Jaff bd7bf7f6b0 fix endpoint name on router 2024-08-16 12:46:43 -07:00
Ishaan JaffandGitHub f92cabbceb Merge pull request #5250 from BerriAI/docs_sagemaker_docs
[Docs] Sagemaker add example on using with LiteLLM Proxy and temperature=0
2024-08-16 12:43:02 -07:00
Ishaan Jaff dcd8ff44df docs add example on setting temp=0 for sagemaker 2024-08-16 12:04:35 -07:00
Ishaan Jaff 63b4e11bfd docs sagemaker - add example using with proxy 2024-08-16 11:47:13 -07:00
Ishaan Jaff 7f39f9f97d docs cleanup 2024-08-16 11:38:53 -07:00
Ishaan Jaff 740d1fdb1c add provider_specific_fields to GenericStreamingChunk 2024-08-16 11:38:22 -07:00
Krrish Dholakia cbdaecb5a8 fix(__init__.py): fix models_by_provider to include cohere_chat models
Fixes https://github.com/BerriAI/litellm/issues/5201
2024-08-16 11:33:23 -07:00
Ishaan JaffandGitHub 3d7e3d65d0 Merge pull request #5135 from BerriAI/dependabot/pip/aiohttp-3.10.2
build(deps): bump aiohttp from 3.9.4 to 3.10.2
2024-08-16 09:07:02 -07:00
Ishaan JaffandGitHub 374a46d924 Merge pull request #5173 from gitravin/rn/sagemaker-zero-temp
Allow zero temperature for Sagemaker models based on config
2024-08-16 08:45:44 -07:00
Krrish Dholakia 1510daba4f bump: version 1.43.15 → 1.43.16 2024-08-15 23:04:30 -07:00
Krish DholakiaandGitHub 6c3f37f8b4 Merge pull request #5235 from BerriAI/litellm_fix_s3_logs
fix(s3.py): fix s3 logging payload to have valid json values
2024-08-15 23:00:18 -07:00
Krish DholakiaandGitHub 1dbc9b8a2e Merge pull request #5215 from BerriAI/litellm_pass_through_endpoints_api
CRUD Endpoints for Pass-Through endpoints
2024-08-15 22:39:39 -07:00
Krish DholakiaandGitHub b3d15ace89 Merge branch 'main' into litellm_pass_through_endpoints_api 2024-08-15 22:39:19 -07:00
Krrish Dholakia 6fc6df134f feat(ui): for adding pass-through endpoints 2024-08-15 21:58:11 -07:00
Ishaan Jaff a614c9f525 fix sagemaker old used test v1.43.15-stable v1.43.15 2024-08-15 21:55:27 -07:00
Krrish Dholakia 589da45c24 feat(pass_through_endpoints.py): initial working CRUD endpoints for /pass_through_endoints 2024-08-15 21:23:26 -07:00
Ishaan Jaff eb9e5af1a3 fix test sagemaker config test 2024-08-15 21:18:18 -07:00
Ishaan JaffandGitHub 9546268aa5 Merge pull request #5238 from BerriAI/litellm_fix_use_prompt_caching_proxy
fix using anthropic prompt caching on proxy
2024-08-15 20:14:23 -07:00
Ishaan Jaff 6cb3675a06 fix using prompt caching on proxy 2024-08-15 20:12:11 -07:00
Ishaan Jaff 42c2290a77 bump: version 1.43.14 → 1.43.15 2024-08-15 19:53:51 -07:00
Ishaan Jaff 33ccf064eb bump: version 1.43.13 → 1.43.14 2024-08-15 19:53:51 -07:00
Ishaan JaffandGitHub f7dec5be25 Merge pull request #5237 from BerriAI/litellm_make_sagemaker_async_v2
[Feat] Make Sagemaker Async
2024-08-15 19:50:45 -07:00
Ishaan Jaff e1839c8da2 allow index to not exist in sagemaker chunks 2024-08-15 19:45:59 -07:00
Ishaan Jaff b93152e978 assume index is not always in stream chunk 2024-08-15 19:42:03 -07:00
Ishaan Jaff fa569aaf6f feat add support for aws_region_name 2024-08-15 19:32:59 -07:00
Ishaan Jaff b4ba12e22c show bedrock, sagemaker creds in verbose mode 2024-08-15 19:10:11 -07:00
Ishaan Jaff b96a27b230 add verbose logging on test 2024-08-15 19:05:23 -07:00
Ishaan Jaff 40dc27e72c fix sagemaker tests 2024-08-15 18:34:20 -07:00
Ishaan Jaff 0d374fb7c0 fix sagemaker test v1.43.13.dev1 2024-08-15 18:23:41 -07:00
Ishaan Jaff df4ea8fba6 refactor sagemaker to be async 2024-08-15 18:18:02 -07:00
Krrish Dholakia 28d7de30de fix(litellm_logging.py): wrap function to safely fail 2024-08-15 18:05:06 -07:00
Krrish Dholakia f6dba82882 feat(litellm_logging.py): cleanup payload + add response cost to logged payload 2024-08-15 17:53:25 -07:00
Krrish Dholakia 3ddeb3297d fix(litellm_logging.py): fix standard payload 2024-08-15 17:33:40 -07:00
Krrish Dholakia cda50e5d47 fix(s3.py): fix s3 logging payload to have valid json values
Previously pydantic objects were being stringified, making them unparsable
2024-08-15 17:09:02 -07:00
Ishaan JaffandGitHub e4638ee4e4 Merge pull request #5233 from BerriAI/litellm_make_sagemaker_async
[Fix] use BaseAWSLLM for bedrock, sagemaker
2024-08-15 15:13:29 -07:00
Ishaan Jaff b1aed699ea test sync sagemaker calls 2024-08-15 15:12:31 -07:00
Ishaan Jaff 2c9e3e9bd7 run mock tests for test_completion_sagemaker 2024-08-15 14:49:21 -07:00
Ishaan Jaff b58c2bef1c add non-stream mock tests for sagemaker 2024-08-15 14:48:24 -07:00
Ishaan JaffandGitHub c32cb365d0 Merge pull request #5226 from BerriAI/litellm_always_log_cache_key
[Fix-Proxy + Langfuse] Always log cache_key on hits/misses
2024-08-15 14:01:15 -07:00
Ishaan Jaff e217eda303 use BaseAWSLLM for bedrock getcredentials 2024-08-15 13:58:47 -07:00
Ishaan Jaff 5c1c9f7616 fix ImportError 2024-08-15 13:02:44 -07:00
Ishaan Jaff 5f693971f7 fix - don't require boto3 on the cli 2024-08-15 12:36:38 -07:00
Ishaan JaffandGitHub 08922041da Merge pull request #5224 from BerriAI/litellm_use_common_helper_llm_call
[Feat-Proxy] - user common helper to `route_request` for making llm call
2024-08-15 11:49:29 -07:00
Ishaan Jaff a59ed00fd3 litellm always log cache_key on hits/misses 2024-08-15 09:59:58 -07:00
Ishaan Jaff 7a17b2132f fix /moderations endpoint 2024-08-15 08:58:28 -07:00