tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-14 15:05:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
21,165 Commits 2,072 Branches 1,425 Tags
8f372ea2436cbf642ee8a5eb4eec9a2622e77390
Commit Graph

21165 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ishaan Jaff 8f372ea243 test_completion_invalid_param_cohere 2025-04-02 06:49:11 -07:00
Ishaan Jaff 63dd2934b7 test_supports_tool_choice 2025-04-01 21:43:46 -07:00
Ishaan Jaff 4b99f833bb test_cohere_request_body_with_allowed_params 2025-04-01 21:30:24 -07:00
Ishaan Jaff 4080fe54d5 clean up o series 2025-04-01 21:21:41 -07:00
Ishaan Jaff 5f286fe147 fix _check_valid_arg 2025-04-01 21:20:31 -07:00
Ishaan Jaff f7129e5e59 fix _apply_openai_param_overrides 2025-04-01 21:17:59 -07:00
Ishaan Jaff 9acda77b75 add allowed_openai_params 2025-04-01 19:54:35 -07:00
Ishaan Jaff 50aa34a4a0 allowed_openai_params as a litellm param 2025-04-01 19:50:31 -07:00
Ishaan Jaff c454dbec30 get_supported_openai_params for o-1 series models 2025-04-01 19:03:50 -07:00
Ishaan Jaff 655ce2e745 Merge pull request #9683 from BerriAI/litellm_fix_service_account_behavior 
[Bug fix] - Service accounts - only apply `service_account_settings.enforced_params` on service accounts
 2025-04-01 12:04:38 -07:00
Ishaan Jaff 4ddca7a79c Merge branch 'main' into litellm_fix_service_account_behavior 2025-04-01 12:04:28 -07:00
Ishaan Jaff 61b609f320 Merge pull request #9673 from BerriAI/litellm_qa_deadlock_fixes 
[Reliability] - Ensure new Redis + DB architecture tracks spend accurately
 2025-04-01 12:04:03 -07:00
Ishaan Jaff 5965680176 fix dev release.txt 2025-04-01 12:02:51 -07:00
Krrish Dholakia 40a792472b build(enterprise.md): add why enterprise to docs 2025-04-01 11:27:03 -07:00
Ishaan Jaff c2c5dbf24f test_get_enforced_params 2025-04-01 08:41:53 -07:00
Ishaan Jaff f805e15f7b test_get_enforced_params_for_service_account_settings 2025-04-01 08:39:41 -07:00
Ishaan Jaff 01bd418e0b remove deprecated logic 2025-04-01 07:55:28 -07:00
Ishaan Jaff e5f6529c42 test_get_enforced_params_for_service_account_settings 2025-04-01 07:46:38 -07:00
Ishaan Jaff 13aa7f75f6 test_enforced_params_check 2025-04-01 07:40:31 -07:00
Ishaan Jaff f8ce30763e fix check_if_token_is_service_account 2025-04-01 07:36:35 -07:00
Ishaan Jaff 55763ae276 test_end_user_transactions_reset 2025-04-01 07:13:25 -07:00
Ishaan Jaff 7a2442d6c0 test_batch_update_spend 2025-04-01 07:12:29 -07:00
Krrish Dholakia b0fa934fe3 docs(anthropic.md): update docs with file message usage 2025-03-31 22:58:51 -07:00
Krish Dholakia 62ad84fb64 UI (new_usage.tsx): Report 'total_tokens' + report success/failure calls (#9675) 
* feat(internal_user_endpoints.py): return 'total_tokens' in `/user/daily/analytics`

* test(test_internal_user_endpoints.py): add unit test to assert spend metrics and dailyspend metadata always report the same fields

* build(schema.prisma): record success + failure calls to daily user table

allows understanding why model requests might exceed provider requests (e.g. user hit rate limit error)

* fix(internal_user_endpoints.py): report success / failure requests in API

* fix(proxy/utils.py): default to success

status can be missing or none at times for successful requests

* feat(new_usage.tsx): show success/failure calls on UI

* style(new_usage.tsx): ui cleanup

* fix: fix linting error

* fix: fix linting error

* feat(litellm-proxy-extras/): add new migration files
 2025-03-31 22:48:43 -07:00
Krish Dholakia f2a7edaddc fix(proxy_server.py): Fix "Circular reference detected" error when max_parallel_requests = 0 (#9671) 
* fix(proxy_server.py): remove non-functional parent backoff/retry on /chat/completion

Causes circular reference error

* fix(http_parsing_utils.py): safely return parsed body - don't allow mutation of cached request body by client functions

Root cause fix for circular reference error

* Revert "fix: Anthropic prompt caching on GCP Vertex AI (#9605)" (#9670)

This reverts commit a8673246dc.

* add type hints for AnthropicMessagesResponse

* define types for response form AnthropicMessagesResponse

* fix response typing

* allow using litellm.messages.acreate and litellm.messages.create

* fix anthropic_messages implementation

* add clear type hints to litellm.messages.create functions

* fix anthropic_messages

* working anthropic API tests

* fixes - anthropic messages interface

* use new anthropic interface

* fix code quality check

* docs anthropic messages endpoint

* add namespace_packages = True to mypy

* fix mypy lint errors

* docs anthropic messages interface

* test: fix unit test

* test(test_http_parsing_utils.py): update tests

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
 2025-03-31 22:06:02 -07:00
Ishaan Jaff d0a7e44a6e fix linting 2025-03-31 21:33:05 -07:00
superpoussin22 136f1d60b3 Update model_prices_and_context_window.json add gemini-2.5-pro-exp-03-25 (#9650) 
* Update model_prices_and_context_window.json

add gemini-2.5-pro-exp-03-25

* Update model_prices_and_context_window.json

correct tokens limit
 2025-03-31 21:31:30 -07:00
Krish Dholakia ef88792ad3 Revert "Revert "Correct Databricks llama3.3-70b endpoint and add databricks c…" (#9676) 
This reverts commit 1e26c594cb.
 2025-03-31 21:30:50 -07:00
Krish Dholakia 722f3ff0e6 fix(cost_calculator.py): allows checking received + sent model name when checking for cost calculation (#9669) 
Fixes issue introduced by https://github.com/BerriAI/litellm/commit/dfb838eaff82301d4101d09982fbbb251bbc1ce1#r154667517
 2025-03-31 21:29:48 -07:00
Ishaan Jaff 115946d402 unit testing for SpendUpdateQueue 2025-03-31 21:25:24 -07:00
Krish Dholakia 5ad2fbcba6 Openrouter streaming fixes + Anthropic 'file' message support (#9667) 
* fix(openrouter/transformation.py): Handle error in openrouter stream

Fixes https://github.com/Aider-AI/aider/issues/3550

* test(test_openrouter_chat_transformation.py): add unit tests

* feat(anthropic/chat/transformation.py): add openai 'file' message content type support

Closes https://github.com/BerriAI/litellm/issues/9463

* fix(factory.py): add bedrock converse support for openai 'file' message content type

Closes https://github.com/BerriAI/litellm/issues/9463
 2025-03-31 21:22:59 -07:00
Ishaan Jaff f7ddc583f0 linting fix get_aggregated_db_spend_update_transactions 2025-03-31 21:15:21 -07:00
Ishaan Jaff 9951b356da test_long_term_spend_accuracy_with_bursts 2025-03-31 21:09:29 -07:00
Ishaan Jaff 923ac2303b test_end_user_transactions_reset 2025-03-31 20:55:13 -07:00
Ishaan Jaff bc5cc51b9d Merge pull request #9567 from BerriAI/litellm_anthropic_messages_improvements 
[Refactor] - Expose litellm.messages.acreate() and  litellm.messages.create() to make LLM API calls in Anthropic API spec
v1.65.1-nightly 		2025-03-31 20:50:30 -07:00
Ishaan Jaff 5fa5c1154e add SpendUpdateQueue 2025-03-31 19:42:20 -07:00
Ishaan Jaff 6d4a6a8402 add spend tracking config.yaml 2025-03-31 19:42:00 -07:00
Ishaan Jaff 271b8b95bc test spend accuracy 2025-03-31 19:35:07 -07:00
Ishaan Jaff aa8261af89 test fixes 2025-03-31 19:33:10 -07:00
Ishaan Jaff 811f488ca3 get_aggregated_db_spend_update_transactions 2025-03-31 19:31:53 -07:00
Ishaan Jaff 71e772dd4a use typed data structure for queue 2025-03-31 19:28:17 -07:00
Ishaan Jaff a753fc9d9f test_long_term_spend_accuracy_with_bursts 2025-03-31 19:17:13 -07:00
Ishaan Jaff 4959512170 fix update_end_user_spend 2025-03-31 19:05:58 -07:00
Ishaan Jaff 73d6af5572 fix docstring 2025-03-31 19:03:02 -07:00
Ishaan Jaff 95e674d1e9 test spend accuracy 2025-03-31 19:01:17 -07:00
Ishaan Jaff 3e16a51ca6 fix update_database helper on db_spend_update_writer 2025-03-31 19:01:00 -07:00
Ishaan Jaff bcd49204f6 use spend_update_queue for RedisUpdateBuffer 2025-03-31 18:40:52 -07:00
Ishaan Jaff efe6d375e9 add new SpendUpdateQueue 2025-03-31 18:40:03 -07:00
Krish Dholakia 46b3dbde8f Revert "fix: Anthropic prompt caching on GCP Vertex AI (#9605)" (#9670) 
This reverts commit a8673246dc.
 2025-03-31 17:13:55 -07:00
Krrish Dholakia b37cb642c1 test: fix b64 str 2025-03-31 17:10:06 -07:00