tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-19 20:24:27 +00:00
Code Issues Packages Projects Releases Wiki Activity
25,673 Commits 2,072 Branches 1,425 Tags
bb4b7fdd005ade698f85b3ec4d11eeeb32e1d528
Commit Graph
784 Commits
Author SHA1 Message Date
Ishaan Jaffer bb4b7fdd00 test_gemini_pro_function_calling_httpx 2025-09-27 12:43:06 -07:00
Ishaan Jaffer 30a3795e78 test_vertex_ai_stream 2025-09-27 12:42:37 -07:00
Ishaan Jaffer 6aa35ec999 test text-embedding-ada-002 2025-09-27 12:41:35 -07:00
Ishaan Jaffer c27beb74b9 test fix 2025-09-27 12:40:34 -07:00
Ishaan Jaffer 919d680e18 test_completion_azure_function_calling_stream 2025-09-27 12:38:18 -07:00
Ishaan Jaffer 9a35d760cf test_async_custom_handler_stream 2025-09-27 12:37:56 -07:00
Ishaan Jaffer 02cc9133a5 test_async_chat_azure_stream 2025-09-27 12:37:36 -07:00
Ishaan Jaffer 9c028c03fb test_bad_request_error_contains_httpx_response 2025-09-27 12:35:59 -07:00
Ishaan Jaffer 973d4b71e7 test_embedding_caching_azure 2025-09-27 12:34:49 -07:00
Ishaan Jaffer 2ba34d22bd test_router_mock_request_with_mock_timeout_with_fallbacks 2025-09-27 12:27:54 -07:00
Ishaan Jaffer 99314221e1 test_router_azure_acompletion 2025-09-27 12:27:34 -07:00
Ishaan Jaffer 4b06d6d6d6 test_provider_budgets_e2e_test 2025-09-27 12:26:40 -07:00
Ishaan Jaffer f7213bacfe test_async_custom_handler_embedding_optional_param 2025-09-27 12:18:17 -07:00
Ishaan Jaffer bbf5761b49 tets health check 2025-09-27 12:06:26 -07:00
Ishaan Jaffer 9097aaa65c test_usage_based_routing 2025-09-27 11:42:34 -07:00
Ishaan Jaffer c99c9ad87d test_service_unavailable_fallbacks 2025-09-27 11:41:20 -07:00
Ishaan Jaffer 5e2479d7a3 test_router_with_caching 2025-09-27 11:38:08 -07:00
Ishaan Jaffer 95590ba81c test_router_retries 2025-09-27 11:35:33 -07:00
Ishaan Jaffer d616545483 test_reading_key_from_model_list 2025-09-27 11:30:09 -07:00
Ishaan Jaffer 172dc07e52 test_cooldown_same_model_name 2025-09-27 11:29:05 -07:00
Ishaan Jaffer 401ec6f2cf test_cooldown_badrequest_error 2025-09-27 11:28:20 -07:00
Ishaan Jaffer 66b86e46e3 test_azure_embedding_on_router 2025-09-27 11:27:56 -07:00
Ishaan Jaffer bd77bdabe6 test_call_one_endpoint 2025-09-27 11:27:34 -07:00
Ishaan Jaffer 2b39663291 test_async_fallbacks_embeddings 2025-09-27 10:18:18 -07:00
Ishaan Jaffer a2e72fbcc9 test_caching_with_models_v2 2025-09-27 10:08:32 -07:00
Ishaan Jaffer 9220ddc598 test router policy violation 2025-09-27 10:04:02 -07:00
Ishaan Jaffer 6cca81291b test_acompletion_caching_on_router 2025-09-27 09:57:07 -07:00
Ishaan Jaffer d6e882163a test_acompletion_caching_on_router_caching_groups 2025-09-27 09:53:37 -07:00
Ishaan Jaffer 22c033d3d7 test_acompletion_caching_on_router_caching_groups 2025-09-27 09:28:24 -07:00
Ishaan Jaffer 8510c70416 test fixes 2025-09-27 09:11:43 -07:00
Krish DholakiaandGitHub 79ebb2c95e Merge pull request #14888 from mrFranklin/feat/improve-opik 
feat: improve opik integration code
 2025-09-25 23:40:41 -07:00
Alexsander HamirandGitHub eaa04cd8ce fix: use fastuuid helper (#14903) 
* fix: use fastuuid helper across the codebase

First batch of changes, simple drop in replacement.

* second batch of changes

* fixed: script mistake on helper file
 2025-09-25 15:47:01 -07:00
mrFranklin f221ce5866 chore: add a comment explaining why update one second to three second 2025-09-25 14:28:49 +08:00
mrFranklin 02a41d76be fix: add default value to pass the opik test 2025-09-25 14:23:00 +08:00
Ishaan Jaffer e1b342604d test vertex test_get_token_url 2025-09-23 19:34:50 -07:00
Ishaan Jaffer 6964b5a67a test humanloop 2025-09-23 18:28:27 -07:00
Krish DholakiaandGitHub 1f9afcb349 Merge pull request #14438 from hakasecurity/change-aim-headers 
rename aim headers + tests
 2025-09-19 23:32:50 -07:00
Krrish Dholakia 92e841e311 fix: fix test 2025-09-18 23:37:38 -07:00
Krish DholakiaandGitHub 664c83cfb5 Merge branch 'litellm_contributor_prs_09_18_2025_p2' into litellm_dev_09_17_2025_p2_v2 2025-09-18 19:50:55 -07:00
Sameer KankuteandGitHub d213a2e066 correct the gaurdcontent name (#14684) 
* correct the gaurdcontent name

* correct the gaurdcontent name

* fix model required error in test

* Add correct model
 2025-09-18 11:00:19 -07:00
Ishaan Jaffer 1e1d174733 fix: test_completion_with_no_model 2025-09-18 10:13:32 -07:00
Krrish Dholakia e32ce6b053 feat(anthropic/chat/transformation.py): separate 5m vs. 1h cache creation token details for anthropic cost tracking 2025-09-17 15:51:07 -07:00
Krish DholakiaandGitHub 895c41efa3 Merge pull request #14619 from BerriAI/litellm_dev_09_16_2025_p1 
UI - allow team member to view service account keys they create + Anthropic - include cache creation tokens in prompt token total (separate out during cost tracking)
 2025-09-17 15:43:04 -07:00
Krrish Dholakia 0e747aaaf1 test: fix test 2025-09-16 19:20:12 -07:00
Krrish Dholakia 1c855385c9 build(model_cost): add cache_creation_input_token_cost_above_1hr pricing 2025-09-16 18:43:57 -07:00
Krrish Dholakia 0341e7fc09 fix: fix test 2025-09-16 18:34:24 -07:00
Krrish Dholakia e488312873 fix(utils.py): log cache_creation_tokens in prompt token details 
Closes LIT-907
 2025-09-16 18:24:10 -07:00
Arseny BoykovandGitHub f4318bccd3 [Performance] Use _PROXY_MaxParallelRequestsHandler_v3 by default again (#14450) 
* Use _PROXY_MaxParallelRequestsHandler_v3 by default (#14352)

(cherry picked from commit f3fa45cf8fbd5f5cce2f45a7312776d5005fb08e)
(cherry picked from commit 5b680bb4a3)

* Use random api_key for parallel requests test

* Fix off-by-one error in parallel request rate limit

The rate limiter was incorrectly rejecting requests when the limit was met, but not exceeded. The check in `is_cache_list_over_limit` was `int(counter_value) + 1 > current_limit`, which caused the first request to be rejected if the limit was 1.

This commit removes the `+ 1`, changing the logic to `int(counter_value) > current_limit`. The check now correctly allows requests up to the specified parallel limit.

* Test actual parallel requests

* Ensure rate limiting works correctly for multiple users

* Add sequential rate-limit test

* Revert random key usage
 2025-09-12 17:33:55 -07:00
Boopesh ShanmugamandGitHub 8b338a4d8c User Headers X LiteLLM Users Mapping feature (#14485) 
* Draft commit.

* user header mapping feature with backward compatibility with user_header_name field.

* user header mapping feature with backward compatibility with user_header_name field optimizations.

* Added unit tests.
 2025-09-12 11:49:37 -07:00
drorbaron 2ee8c0c6d7 rename aim headers + tests 2025-09-11 11:19:58 +03:00