Commit Graph
19803 Commits
Author SHA1 Message Date
Krrish Dholakia 41b0404ae1 test: fix test 2025-03-10 22:00:50 -07:00
Krrish Dholakia 01aa536716 fix: fix test 2025-03-10 21:46:05 -07:00
Krrish Dholakia bfbe26b91d feat(azure.py): add azure bad request error support 2025-03-10 15:59:06 -07:00
Krrish Dholakia f688fc8138 feat(proxy_server.py): check code before defaulting to status code 2025-03-10 15:34:06 -07:00
Krrish Dholakia 5f87dc229a feat(openai.py): bubble all error information back to client 2025-03-10 15:27:43 -07:00
Krrish Dholakia c1ec82fbd5 refactor: instrument body param to bubble up on exception 2025-03-10 15:21:04 -07:00
Ishaan JaffandGitHub 5b2e8a5006 Merge pull request #8948 from colesmcintosh/main
build: Add Makefile for LiteLLM project with test targets
2025-03-10 14:27:07 -07:00
Ishaan JaffandGitHub a0b4cc43bf Merge pull request #9107 from BerriAI/litellm_add_contributing_guide
(docs) add section for contributing to litellm
2025-03-10 14:21:30 -07:00
Ishaan Jaff b768ebb426 docs contributing section 2025-03-10 14:19:08 -07:00
Ishaan JaffandGitHub 4261df3e4f Merge pull request #9014 from BerriAI/dependabot/pip/jinja2-3.1.6
build(deps): bump jinja2 from 3.1.4 to 3.1.6
2025-03-10 14:00:02 -07:00
Ishaan JaffandGitHub 0fcce63852 Merge pull request #9032 from themrzmaster/feat/jamba_1.6
pricing for jamba new models
v1.63.5-nightly
2025-03-10 13:59:37 -07:00
Ishaan Jaff c5606c06ae ui linting fix 2025-03-10 12:30:37 -07:00
Ishaan Jaff 618335a7d9 ui linting fixes #2 2025-03-10 12:25:57 -07:00
Ishaan Jaff 49ad10f621 ui fix linting errors 2025-03-10 12:23:33 -07:00
Ishaan Jaff 574f7b1dcc fix linting error 2025-03-10 12:20:37 -07:00
Ishaan Jaff 60d3cb10bc openweb tutorial 2025-03-10 08:10:07 -07:00
Krrish Dholakia 0fa3ec98ab bump: version 1.63.4 → 1.63.5 2025-03-09 20:47:51 -07:00
Krrish Dholakia 574f5056c8 fix(utils.py): fix linting error 2025-03-09 20:47:12 -07:00
Krish DholakiaandGitHub f899b828cf Support openrouter reasoning_content on streaming (#9094)
* feat(convert_dict_to_response.py): support openrouter format of reasoning content

* fix(transformation.py): fix openrouter streaming with reasoning content

Fixes https://github.com/BerriAI/litellm/issues/8193#issuecomment-270892962

* fix: fix type error
2025-03-09 20:03:59 -07:00
5aaee9andGitHub 42b7921ca1 fix: perplexity return both delta and message cause OpenWebUI repect text (#9081) 2025-03-09 19:46:31 -07:00
65ef65d360 feat: prioritize api_key over tenant_id for more Azure AD token provi… (#8701)
* feat: prioritize api_key over tenant_id for more Azure AD token provider (#8318)

* fix: prioritize api_key over tenant_id for Azure AD token provider

* test: Add test for Azure AD token provider in router

* fix: fix linting error

---------

Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
2025-03-09 18:59:37 -07:00
Krish DholakiaandGitHub e00d4fb18c Litellm dev 03 08 2025 p3 (#9089)
* feat(ollama_chat.py): pass down http client to ollama_chat

enables easier testing

* fix(factory.py): fix passing images to ollama's `/api/generate` endpoint

Fixes https://github.com/BerriAI/litellm/issues/6683

* fix(factory.py): fix ollama pt to handle templating correctly
2025-03-09 18:20:56 -07:00
Krrish Dholakia 93273723cd docs(index.md): add git diff to release notes 2025-03-08 19:14:56 -08:00
Krrish Dholakia ac3e57a501 docs: add images to release notes 2025-03-08 17:39:24 -08:00
Ishaan Jaff b6eee01381 Revert "experimental - track anthropic messages as mode"
This reverts commit 22b3862e0d.
2025-03-08 17:38:24 -08:00
Ishaan Jaff 22b3862e0d experimental - track anthropic messages as mode 2025-03-08 17:33:35 -08:00
Ishaan Jaff 83062b892b fix test_list_key_helper_team_filtering 2025-03-08 17:21:32 -08:00
Krrish Dholakia de0467b8e6 docs: cleanup 2025-03-08 16:43:42 -08:00
Krrish Dholakia b0ae49a53d docs(index.md): cleanup 2025-03-08 16:37:01 -08:00
Krrish Dholakia 4e5893ef65 docs(index.md): cleanup 2025-03-08 16:36:36 -08:00
Ishaan Jaff 6e3b21775f test_cost_azure_openai_prompt_caching 2025-03-08 16:19:28 -08:00
Krish DholakiaandGitHub 09d0144711 New stable release notes (#9085)
* docs: stable release notes

* docs: additional doc improvements

* docs(anthropic_unified.md): add doc on unified anthropic endpoint

* docs: update docs
2025-03-08 16:19:07 -08:00
Ishaan JaffandGitHub b41311bb21 (UI) - Fix show correct count of internal user keys on Users Page (#9082)
* get_user_key_counts

* fix get_user_key_counts

* fix get_user_key_counts

* test_get_users_filters_dashboard_keys

* remove unused func
2025-03-08 16:13:18 -08:00
Ishaan JaffandGitHub 73df319f4e (Clean up) - Allow switching off storing Error Logs in DB (#9084)
* fix - cleanup, dont store ErrorLogs in 2 tables

* async_post_call_failure_hook

* docs disable error logs

* disable_error_logs
2025-03-08 16:12:03 -08:00
Ishaan JaffandGitHub a7f6a95dd9 (UI) - Fix, Allow Filter Keys by Team Alias, Key Alias and Org (#9083)
* working team, key, org filters

* fix size of filter

* all keys filter

* 1 file for filter logic

* remove key alias check
2025-03-08 15:58:29 -08:00
Krish DholakiaandGitHub 4330ef8e81 Fix batches api cost tracking + Log batch models in spend logs / standard logging payload (#9077)
* feat(batches/): fix batch cost calculation - ensure it's accurate

use the correct cost value - prev. defaulting to non-batch cost

* feat(batch_utils.py): log batch models to spend logs + standard logging payload

makes it easy to understand how cost was calculated

* fix: fix stored payload for test

* test: fix test
2025-03-08 11:47:25 -08:00
Teja VishwanadhaandGitHub 8c049dfffc support bytes.IO for audio transcription (#9071) 2025-03-08 08:47:15 -08:00
Ishaan JaffandGitHub b5ad968e8a (UI) - Minor improvements to logs page (#9076)
* logs - make sure all cols have max width

* fix missing data message

* fix toggle handle responsive logs
2025-03-07 21:38:45 -08:00
Ishaan JaffandGitHub e2d612efd9 Bug fix - String data: stripped from entire content in streamed Gemini responses (#9070)
* _strip_sse_data_from_chunk

* use _strip_sse_data_from_chunk

* use _strip_sse_data_from_chunk

* use _strip_sse_data_from_chunk

* _strip_sse_data_from_chunk

* test_strip_sse_data_from_chunk

* _strip_sse_data_from_chunk

* testing

* _strip_sse_data_from_chunk
2025-03-07 21:06:39 -08:00
Krrish Dholakia 2163d5c3e9 fix(transform_request.tsx): allow dev to file translation error 2025-03-07 19:43:49 -08:00
Krish DholakiaandGitHub 0e3caf92b9 UI - new API Playground for testing LiteLLM translation (#9073)
* feat: initial commit - enable dev to see translated request

* feat(utils.py): expose new endpoint - `/utils/transform_request` to see the raw request sent by litellm

* feat(transform_request.tsx): allow user to see their transformed request

* refactor(litellm_logging.py): return raw request in 3 parts - api_base, headers, request body

easier to render each individually on UI vs. extracting from combined string

* feat: transform_request.tsx

working e2e raw request viewing

* fix(litellm_logging.py): fix transform viewing for bedrock models

* fix(litellm_logging.py): don't return sensitive headers in raw request headers

prevent accidental leak

* feat(transform_request.tsx): style improvements
2025-03-07 19:39:31 -08:00
Ishaan JaffandGitHub 1cf6f53a6c (UI) - Allow adding Cerebras, Sambanova, Perplexity, Fireworks, Openrouter, TogetherAI Models on Admin UI (#9069)
* allow adding cerebras on litellm ui

* add perplexity

* add openrouter, fireworks, together
2025-03-07 17:01:53 -08:00
Ishaan JaffandGitHub b5eeafdd72 (Docs) OpenWeb x LiteLLM Docker compose + Instructions on spend tracking + logging (#9059)
* docs improve open web ui litellm doc

* docs openweb show teams + keys

* docs open web ui litellm
2025-03-07 17:01:39 -08:00
Ishaan JaffandGitHub e753f61231 fix logs page selected log (#9061) 2025-03-07 17:01:11 -08:00
Ishaan JaffandGitHub 0e7fd162f4 (UI) - Keys Page - Show 100 Keys Per Page, Use full height, increase width of key alias (#9064)
* show 100 keys + increase height of keys

* fix key_alias

* litellm show key alias full width
2025-03-07 15:43:10 -08:00
Krrish Dholakia 36f3276d8c docs: update docs 2025-03-07 11:00:12 -08:00
Minh DucandGitHub d3ececfc20 Mark several Claude models as being able to accept PDF inputs (#9054) 2025-03-07 10:05:57 -08:00
Jascha BesteandGitHub ecef36d02c docs: Add project page for pgai (#8576)
* docs: Add project page for pgai

* Add pgai to sidebar.js
2025-03-07 08:08:01 -08:00
Ishaan JaffandGitHub 7f70bdd99b (Feat) - add pricing for eu.amazon.nova models (#9056)
* add pricing for eu.amazon.nova models

* fix typo in key management endpoints.py
2025-03-07 07:06:17 -08:00
Krrish Dholakia 995fc001e0 docs(release_cycle.md): add stable tag info to release cycle 2025-03-06 23:22:45 -08:00