Commit Graph
21110 Commits
Author SHA1 Message Date
Ishaan Jaff 811f488ca3 get_aggregated_db_spend_update_transactions 2025-03-31 19:31:53 -07:00
Ishaan Jaff 71e772dd4a use typed data structure for queue 2025-03-31 19:28:17 -07:00
Ishaan Jaff a753fc9d9f test_long_term_spend_accuracy_with_bursts 2025-03-31 19:17:13 -07:00
Ishaan Jaff 4959512170 fix update_end_user_spend 2025-03-31 19:05:58 -07:00
Ishaan Jaff 73d6af5572 fix docstring 2025-03-31 19:03:02 -07:00
Ishaan Jaff 95e674d1e9 test spend accuracy 2025-03-31 19:01:17 -07:00
Ishaan Jaff 3e16a51ca6 fix update_database helper on db_spend_update_writer 2025-03-31 19:01:00 -07:00
Ishaan Jaff bcd49204f6 use spend_update_queue for RedisUpdateBuffer 2025-03-31 18:40:52 -07:00
Ishaan Jaff efe6d375e9 add new SpendUpdateQueue 2025-03-31 18:40:03 -07:00
Krish DholakiaandGitHub 46b3dbde8f Revert "fix: Anthropic prompt caching on GCP Vertex AI (#9605)" (#9670)
This reverts commit a8673246dc.
2025-03-31 17:13:55 -07:00
Krrish Dholakia b37cb642c1 test: fix b64 str 2025-03-31 17:10:06 -07:00
Krrish Dholakia 611afaf2ab ci(test-linting.yml): update to run black formatting 2025-03-31 17:03:59 -07:00
Krish DholakiaandGitHub 1e26c594cb Revert "Correct Databricks llama3.3-70b endpoint and add databricks claude 3.…" (#9668)
This reverts commit dfb838eaff.
2025-03-31 17:02:21 -07:00
Ishaan JaffandGitHub 0d48652012 Merge pull request #9515 from BerriAI/litellm_sagemaker_fix_stream
[Bug fix] -  Sagemaker endpoint with inference component streaming
2025-03-31 16:18:10 -07:00
Ishaan Jaff 3d0d5e1473 run black formatting 2025-03-31 16:12:31 -07:00
Ishaan JaffandGitHub f54105faf8 Merge pull request #9562 from KPCOFGS/main
Update all_caches.md
2025-03-31 16:06:44 -07:00
Ishaan JaffandGitHub 0719d399a7 Merge pull request #9581 from GabrielLoiseau/main
docs(gemini): fix typo
2025-03-31 16:06:10 -07:00
Ishaan Jaff ca4ed9ff2e ref issue 2025-03-31 16:05:10 -07:00
Ishaan Jaff bc66827537 test_aiter_bytes_valid_chunk_followed_by_unicode_error 2025-03-31 16:04:38 -07:00
Ishaan JaffandGitHub de9565dccf Merge pull request #9286 from colesmcintosh/xai-vision-model-docs-update
fix(docs): update xAI Grok vision model reference
2025-03-31 15:49:06 -07:00
Anton AbilovandGitHub dfb838eaff Correct Databricks llama3.3-70b endpoint and add databricks claude 3.7 sonnet endpoint (#9661) 2025-03-31 15:22:12 -07:00
Ishaan Jaff 83ba96b8c6 Merge branch 'main' into litellm_sagemaker_fix_stream 2025-03-31 14:22:20 -07:00
Ishaan Jaff ce5f55d04e test fix update spend 2025-03-31 14:20:47 -07:00
Shixian ShengandGitHub 63e9ac5d04 Merge branch 'BerriAI:main' into main 2025-03-30 06:53:09 -04:00
Krrish Dholakia 17ad8a0417 docs: cleanup docs 2025-03-30 00:40:23 -07:00
Krrish Dholakia 69db775e73 docs(vertex.md): update docs to show 'file' message usage 2025-03-30 00:28:45 -07:00
SamandGitHub a8673246dc fix: Anthropic prompt caching on GCP Vertex AI (#9605)
* fix: Anthropic prompt caching on GCP Vertex AI

* test(vertex): anthropic prompt caching
2025-03-29 23:40:34 -07:00
jmarshall-medalliaandGitHub da953c74a1 Add password to sync sentinel client (#9622) 2025-03-29 23:38:54 -07:00
Ishaan Jaff 31082344a4 docs release notes 2025-03-29 23:08:20 -07:00
Ishaan Jaff df01337bd8 docs litellm mcp 2025-03-29 22:28:03 -07:00
Ishaan Jaff cc80370e0c docs mcp litellm 2025-03-29 21:59:58 -07:00
Ishaan Jaff 366f3a901c docs mcp 2025-03-29 21:46:18 -07:00
Ishaan Jaff db12adb3db docs mcp tools 2025-03-29 20:42:14 -07:00
Ishaan Jaff 2238a5585b doc fix mcp 2025-03-29 20:35:53 -07:00
Ishaan Jaff 8c2f1c6142 docs 1.65.0-stable 2025-03-29 20:03:05 -07:00
Ishaan Jaff 7673293c9f docs update stable release 2025-03-29 20:01:00 -07:00
Ishaan Jaff 9b187d89f2 add litellm model name on SLP 2025-03-29 19:55:41 -07:00
Ishaan Jaff 1f10d985fb docs updates release notes 2025-03-29 19:51:38 -07:00
Ishaan Jaff e9b743e3c6 docs release notes 2025-03-29 19:50:13 -07:00
Ishaan JaffandGitHub 5df985f964 Merge pull request #9642 from BerriAI/litellm_mcp_improvements_expose_sse_urls
[Feat] - MCP improvements, add support for using SSE MCP servers
2025-03-29 19:37:57 -07:00
Ishaan JaffandGitHub 19be617fe9 Merge pull request #9643 from BerriAI/litellm_docs_stable_release_notes
[Docs - Release notes v0] v1.65.0-stable
2025-03-29 19:27:59 -07:00
Krish DholakiaandGitHub 5c107c64dd Add gemini audio input support + handle special tokens in sagemaker response (#9640)
* fix(internal_user_endpoints.py): cleanup unused variables on beta endpoint

no team/org split on daily user endpoint

* build(model_prices_and_context_window.json): gemini-2.0-flash supports audio input

* feat(gemini/transformation.py): support passing audio input to gemini

* test: fix test

* fix(gemini/transformation.py): support audio input as a url

enables passing google cloud bucket urls

* fix(gemini/transformation.py): support explicitly passing format of file

* fix(gemini/transformation.py): expand support for inferred file types from url

* fix(sagemaker/completion/transformation.py): fix special token error when counting sagemaker tokens

* test: fix import
2025-03-29 19:23:09 -07:00
Ishaan Jaff f3b72858e8 docs release notes 2025-03-29 19:08:23 -07:00
Ishaan Jaff d04cc6c81e docs release notes 2025-03-29 19:03:55 -07:00
Ishaan Jaff 46e5ebe3c7 docs add mcp graphic to stable release notes 2025-03-29 19:00:26 -07:00
Ishaan Jaff 10486dd17e fix listing mcp tools 2025-03-29 18:40:58 -07:00
Ishaan Jaff 3919e24256 test fix 2025-03-29 18:36:13 -07:00
Ishaan Jaff 194327bb7c test fixes 2025-03-29 18:34:58 -07:00
Ishaan Jaff 385e8bff4c fix order of imports 2025-03-29 18:32:06 -07:00
Ishaan Jaff 22f9a93e25 docs stable release notes 2025-03-29 18:21:42 -07:00