Commit Graph
16377 Commits
Author SHA1 Message Date
Ishaan Jaff 45e367d4d4 docs Caching - Continuing Multi-Turn Convo 2024-08-14 15:26:25 -07:00
Ishaan Jaff 54102a660d pass cache_control in tool call 2024-08-14 15:18:11 -07:00
Ishaan Jaff 96f9655a02 test test_anthropic_api_prompt_caching_basic 2024-08-14 15:06:10 -07:00
Ishaan Jaff 69a640e9c4 test amnthropic prompt caching 2024-08-14 14:59:46 -07:00
Ishaan Jaff b0651bd481 add anthropic cache controls 2024-08-14 14:56:49 -07:00
Ishaan Jaff 9791352dc6 add testing for test_anthropic_cache_controls_pt 2024-08-14 14:07:48 -07:00
Ishaan Jaff 68e24fbf14 test passing cache controls through anthropic msg 2024-08-14 13:49:07 -07:00
Ishaan Jaff 209c91ac03 feat - anthropic api context caching v0 2024-08-14 13:08:03 -07:00
Ishaan Jaff 066ed20eb0 bump: version 1.43.11 → 1.43.12 v1.43.12 2024-08-14 10:42:08 -07:00
Ishaan Jaff f0ea00d4ab bump: version 1.43.10 → 1.43.11 2024-08-14 10:42:06 -07:00
Ishaan JaffandGitHub 98ea24aab0 Merge pull request #5202 from BerriAI/litellm_prom_prefix_litellm
[Fix] Prometheus use 'litellm_' prefix for new deployment metrics
2024-08-14 09:50:36 -07:00
Ishaan JaffandGitHub 38b6196413 Merge pull request #5200 from BerriAI/litellm_gcs_failure_callback
[Feat-Proxy] Add failure logging for GCS bucket
2024-08-14 09:50:29 -07:00
Ishaan JaffandGitHub 69f6952597 Merge pull request #5186 from BerriAI/litellm_prisma_issues
[Fix-Proxy] Fix prisma non-root user issues
2024-08-14 09:29:57 -07:00
Ishaan Jaff 47afbfcbaa allow running as non-root user 2024-08-14 09:26:47 -07:00
Ishaan Jaff 6f06da7d46 fix use normal prisma 2024-08-14 09:24:22 -07:00
Ishaan Jaff acadabe6c9 use litellm_ prefix for new deployment metrics 2024-08-14 09:08:14 -07:00
Krrish Dholakia 4cef6df4cf docs(sidebar.js): cleanup docs 2024-08-14 09:04:52 -07:00
Ishaan Jaff 326d797111 log failure calls on gcs + testing 2024-08-14 08:55:51 -07:00
Ishaan Jaff bb877f6ead fix test for gcs bucket 2024-08-14 08:40:02 -07:00
Ishaan Jaff 63af2942ab feat log fail events on gcs 2024-08-14 08:39:16 -07:00
Krish DholakiaandGitHub 5b46c88eb6 Merge pull request #5199 from zby/calendar_example
Mismatch in example fixed
2024-08-14 08:37:07 -07:00
Krish DholakiaandGitHub a6bf763dd9 Merge pull request #5116 from thiswillbeyourgithub/fix_ollama_argument_order
fix: wrong order of arguments for ollama
2024-08-14 08:36:14 -07:00
Zbigniew ŁukasiakandGitHub 963c921c5a Mismatch in example fixed 2024-08-14 15:07:10 +02:00
Ishaan Jaff e0978378c1 return detailed error message on check_valid_ip v1.43.10-stable v1.43.10 2024-08-13 21:29:21 -07:00
Ishaan Jaff 05725b8341 bump: version 1.43.9 → 1.43.10 2024-08-13 21:20:11 -07:00
Ishaan JaffandGitHub 4d2cedfdb6 Merge pull request #5191 from BerriAI/litellm_load_config_from_s3
[Feat] Allow loading LiteLLM config from s3 buckets
2024-08-13 21:19:16 -07:00
Ishaan Jaff 09535b25f4 fix use s3 get_credentials to get boto3 creds 2024-08-13 21:18:06 -07:00
Krish DholakiaandGitHub c8f4cd373d Merge pull request #5189 from ArtyomZemlyak/patch-1
Fix not sended json_data_for_triton
2024-08-13 20:44:26 -07:00
Krrish Dholakia c1279ed809 fix(bedrock_httpx.py): fix error code for not found provider/model combo to be 404 2024-08-13 20:36:12 -07:00
Krish DholakiaandGitHub d6125ca257 Merge pull request #5190 from Manouchehri/chatgpt-4o-latest-pricing
(models): Add chatgpt-4o-latest
2024-08-13 20:34:54 -07:00
Ishaan Jaff a37f087b62 fix ci/cd pipeline 2024-08-13 20:33:33 -07:00
Ishaan Jaff 86818ddffc comment on using boto3 2024-08-13 20:28:40 -07:00
Ishaan Jaff 6f7b204294 docs - set litellm config as s3 object 2024-08-13 20:26:29 -07:00
Ishaan Jaff 4e7b0ce76e feat read config from s3 2024-08-13 20:18:59 -07:00
Ishaan Jaff 1475ae59f3 add helper to load config from s3 2024-08-13 20:16:54 -07:00
David Manouchehri 9617e578f3 (models): Add chatgpt-4o-latest. 2024-08-14 03:03:22 +00:00
Artem ZemliakandGitHub 5290490106 Fix not sended json_data_for_triton 2024-08-14 09:57:48 +07:00
Ishaan Jaff fef6f50e23 fic docker file to run in non root model v1.43.9.dev4 2024-08-13 19:29:40 -07:00
Krrish Dholakia 66d77f177f fix(bedrock_httpx.py): raise bad request error if invalid bedrock model given 2024-08-13 19:27:06 -07:00
Ishaan Jaff 353b470cbc fix prisma issues v1.43.9.dev3 2024-08-13 19:17:01 -07:00
Ishaan JaffandGitHub b8e5b25dcc Merge pull request #5184 from fozziethebeat/fix-vllm-docs
Improving the proxy docs for configuring with vllm
2024-08-13 18:47:01 -07:00
Ishaan Jaff c7804e1ea2 ui new build 2024-08-13 18:45:09 -07:00
Ishaan Jaff 2de276cb44 temp set prisma pems v1.43.9.dev2 2024-08-13 18:40:00 -07:00
Ishaan Jaff ab7758840b skip prisma gen step 2024-08-13 18:38:10 -07:00
Ishaan JaffandGitHub 4159897570 Merge pull request #5187 from BerriAI/litellm_handle_session_expired_ui
[Feat-UI] - Handle session expired on UI
2024-08-13 17:15:23 -07:00
Ishaan Jaff d85762b32f ui - handle session expired on ui 2024-08-13 17:09:56 -07:00
Ishaan Jaff 2c0f4c9865 fix make prisma readable v1.43.9.dev1 2024-08-13 16:57:19 -07:00
Krrish Dholakia cdce13434e fix(teams.tsx): add team_id to team table on ui 2024-08-13 16:08:49 -07:00
Keith Stevens 17c6a4e532 Improving the proxy docs for configuring with vllm 2024-08-13 16:07:41 -07:00
Ishaan JaffandGitHub 063fb380e1 Merge pull request #5181 from BerriAI/litellm_check_x_fwded_for
[Feat-Proxy Security] Allow Using `x-forwarded-for` for enforcing + tracking  ip address
2024-08-13 16:07:31 -07:00