Ishaan JaffandGitHub 6261ec3599 (feat proxy) v2 - model max budgets (#7302) ...

* clean up unused code

* add _PROXY_VirtualKeyModelMaxBudgetLimiter

* adjust type imports

* working _PROXY_VirtualKeyModelMaxBudgetLimiter

* fix user_api_key_model_max_budget

* fix user_api_key_model_max_budget

* update naming

* update naming

* fix changes to RouterBudgetLimiting

* test_call_with_key_over_model_budget

* test_call_with_key_over_model_budget

* handle _get_request_model_budget_config

* e2e test for test_call_with_key_over_model_budget

* clean up test

* run ci/cd again

* add validate_model_max_budget

* docs fix

* update doc

* add e2e testing for _PROXY_VirtualKeyModelMaxBudgetLimiter

* test_unit_test_max_model_budget_limiter.py

2024-12-18 19:42:46 -08:00

..

example_config_yaml

Revert "Revert "(feat) Allow using include to include external YAML files in a config.yaml (#6922)""

2024-11-27 16:08:59 -08:00

test_configs

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_model_response_typing

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

adroit-crow-413218-bc47f303efc9.json

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

azure_fine_tune.jsonl

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

batch_job_results_furniture.jsonl

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

conftest copy.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

conftest.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

data_map.txt

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

eagle.wav

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

gettysburg.wav

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

large_text.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

log.txt

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

messages_with_counts.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

model_cost.json

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

openai_batch_completions_router.jsonl

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

openai_batch_completions.jsonl

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

speech_vertex.mp3

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_aproxy_startup.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_audit_logs_proxy.py

(docs) add docstrings for all /key, /user, /team, /customer endpoints (#6804)

2024-11-18 19:44:06 -08:00

test_banned_keyword_list.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_custom_callback_input.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_deployed_proxy_keygen.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_jwt.py

Litellm dev 12 06 2024 (#7067)

2024-12-06 22:44:18 -08:00

test_key_generate_dynamodb.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_key_generate_prisma.py

(feat proxy) v2 - model max budgets (#7302)

2024-12-18 19:42:46 -08:00

test_proxy_config_unit_test.py

Revert "Revert "(feat) Allow using include to include external YAML files in a config.yaml (#6922)""

2024-11-27 16:08:59 -08:00

test_proxy_custom_auth.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_proxy_custom_logger.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_proxy_encrypt_decrypt.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_proxy_exception_mapping.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_proxy_gunicorn.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_proxy_pass_user_config.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_proxy_reject_logging.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_proxy_routes.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_proxy_server_caching.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_proxy_server_cost.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_proxy_server_keys.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_proxy_server_langfuse.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_proxy_server_spend.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_proxy_server.py

(feat) UI - Disable Usage Tab once SpendLogs is 1M+ Rows (#7208)

2024-12-12 18:43:17 -08:00

test_proxy_setting_guardrails.py

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30

test_proxy_token_counter.py

Litellm dev 12 12 2024 (#7203)

2024-12-13 08:54:03 -08:00

test_proxy_utils.py

fix(proxy_server.py): pass model access groups to get_key/get_team mo… (#7281)

2024-12-18 09:33:33 -08:00

test_unit_test_max_model_budget_limiter.py

(feat proxy) v2 - model max budgets (#7302)

2024-12-18 19:42:46 -08:00

test_unit_test_proxy_hooks.py

(feat) Allow disabling ErrorLogs written to the DB (#6940)

2024-11-27 19:34:51 -08:00

test_update_spend.py

(bug fix) SpendLogs update DB catch all possible DB errors for retrying (#7082)

2024-12-07 15:59:53 -08:00

test_user_api_key_auth.py

(proxy) - Auth fix, ensure re-using safe request body for checking model field (#7222)

2024-12-14 12:01:25 -08:00

vertex_key.json

fix(pattern_match_deployments.py): default to user input if unable to… (#6632)

2024-11-08 00:55:57 +05:30