tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-07 00:24:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
30,881 Commits 2,072 Branches 1,425 Tags
12bc66aa5ba767f2af4daf4ae99d41af77ba5ede
Commit Graph
924 Commits
Author SHA1 Message Date
Ishaan Jaffer bbf5761b49 tets health check 2025-09-27 12:06:26 -07:00
Ishaan Jaffer 9097aaa65c test_usage_based_routing 2025-09-27 11:42:34 -07:00
Ishaan Jaffer c99c9ad87d test_service_unavailable_fallbacks 2025-09-27 11:41:20 -07:00
Ishaan Jaffer 5e2479d7a3 test_router_with_caching 2025-09-27 11:38:08 -07:00
Ishaan Jaffer 95590ba81c test_router_retries 2025-09-27 11:35:33 -07:00
Ishaan Jaffer d616545483 test_reading_key_from_model_list 2025-09-27 11:30:09 -07:00
Ishaan Jaffer 172dc07e52 test_cooldown_same_model_name 2025-09-27 11:29:05 -07:00
Ishaan Jaffer 401ec6f2cf test_cooldown_badrequest_error 2025-09-27 11:28:20 -07:00
Ishaan Jaffer 66b86e46e3 test_azure_embedding_on_router 2025-09-27 11:27:56 -07:00
Ishaan Jaffer bd77bdabe6 test_call_one_endpoint 2025-09-27 11:27:34 -07:00
Ishaan Jaffer 2b39663291 test_async_fallbacks_embeddings 2025-09-27 10:18:18 -07:00
Ishaan Jaffer a2e72fbcc9 test_caching_with_models_v2 2025-09-27 10:08:32 -07:00
Ishaan Jaffer 9220ddc598 test router policy violation 2025-09-27 10:04:02 -07:00
Ishaan Jaffer 6cca81291b test_acompletion_caching_on_router 2025-09-27 09:57:07 -07:00
Ishaan Jaffer d6e882163a test_acompletion_caching_on_router_caching_groups 2025-09-27 09:53:37 -07:00
Ishaan Jaffer 22c033d3d7 test_acompletion_caching_on_router_caching_groups 2025-09-27 09:28:24 -07:00
Ishaan Jaffer 8510c70416 test fixes 2025-09-27 09:11:43 -07:00
Krish DholakiaandGitHub 79ebb2c95e Merge pull request #14888 from mrFranklin/feat/improve-opik 
feat: improve opik integration code
 2025-09-25 23:40:41 -07:00
Alexsander HamirandGitHub eaa04cd8ce fix: use fastuuid helper (#14903) 
* fix: use fastuuid helper across the codebase

First batch of changes, simple drop in replacement.

* second batch of changes

* fixed: script mistake on helper file
 2025-09-25 15:47:01 -07:00
mrFranklin f221ce5866 chore: add a comment explaining why update one second to three second 2025-09-25 14:28:49 +08:00
mrFranklin 02a41d76be fix: add default value to pass the opik test 2025-09-25 14:23:00 +08:00
Ishaan Jaffer e1b342604d test vertex test_get_token_url 2025-09-23 19:34:50 -07:00
Ishaan Jaffer 6964b5a67a test humanloop 2025-09-23 18:28:27 -07:00
daily-kim 62622ef4b2 fix: update authorization header to use 'Bearer' instead of 'bearer' 2025-09-21 10:44:47 +00:00
Krish DholakiaandGitHub 1f9afcb349 Merge pull request #14438 from hakasecurity/change-aim-headers 
rename aim headers + tests
 2025-09-19 23:32:50 -07:00
Krrish Dholakia 92e841e311 fix: fix test 2025-09-18 23:37:38 -07:00
Krish DholakiaandGitHub 664c83cfb5 Merge branch 'litellm_contributor_prs_09_18_2025_p2' into litellm_dev_09_17_2025_p2_v2 2025-09-18 19:50:55 -07:00
Sameer KankuteandGitHub d213a2e066 correct the gaurdcontent name (#14684) 
* correct the gaurdcontent name

* correct the gaurdcontent name

* fix model required error in test

* Add correct model
 2025-09-18 11:00:19 -07:00
Ishaan Jaffer 1e1d174733 fix: test_completion_with_no_model 2025-09-18 10:13:32 -07:00
Krrish Dholakia e32ce6b053 feat(anthropic/chat/transformation.py): separate 5m vs. 1h cache creation token details for anthropic cost tracking 2025-09-17 15:51:07 -07:00
Krish DholakiaandGitHub 895c41efa3 Merge pull request #14619 from BerriAI/litellm_dev_09_16_2025_p1 
UI - allow team member to view service account keys they create + Anthropic - include cache creation tokens in prompt token total (separate out during cost tracking)
 2025-09-17 15:43:04 -07:00
Krrish Dholakia 0e747aaaf1 test: fix test 2025-09-16 19:20:12 -07:00
Krrish Dholakia 1c855385c9 build(model_cost): add cache_creation_input_token_cost_above_1hr pricing 2025-09-16 18:43:57 -07:00
Krrish Dholakia 0341e7fc09 fix: fix test 2025-09-16 18:34:24 -07:00
Krrish Dholakia e488312873 fix(utils.py): log cache_creation_tokens in prompt token details 
Closes LIT-907
 2025-09-16 18:24:10 -07:00
Krish DholakiaandGitHub a11f50d8ba Merge branch 'main' into litellm_dev_09_11_2025_p1 2025-09-12 19:59:28 -07:00
Arseny BoykovandGitHub f4318bccd3 [Performance] Use _PROXY_MaxParallelRequestsHandler_v3 by default again (#14450) 
* Use _PROXY_MaxParallelRequestsHandler_v3 by default (#14352)

(cherry picked from commit f3fa45cf8fbd5f5cce2f45a7312776d5005fb08e)
(cherry picked from commit 5b680bb4a3)

* Use random api_key for parallel requests test

* Fix off-by-one error in parallel request rate limit

The rate limiter was incorrectly rejecting requests when the limit was met, but not exceeded. The check in `is_cache_list_over_limit` was `int(counter_value) + 1 > current_limit`, which caused the first request to be rejected if the limit was 1.

This commit removes the `+ 1`, changing the logic to `int(counter_value) > current_limit`. The check now correctly allows requests up to the specified parallel limit.

* Test actual parallel requests

* Ensure rate limiting works correctly for multiple users

* Add sequential rate-limit test

* Revert random key usage
 2025-09-12 17:33:55 -07:00
Boopesh ShanmugamandGitHub 8b338a4d8c User Headers X LiteLLM Users Mapping feature (#14485) 
* Draft commit.

* user header mapping feature with backward compatibility with user_header_name field.

* user header mapping feature with backward compatibility with user_header_name field optimizations.

* Added unit tests.
 2025-09-12 11:49:37 -07:00
Krrish Dholakia 3f3efea301 test(test_gemini.py): add additional testing for additionalproperties case 2025-09-11 15:12:21 -07:00
drorbaron 2ee8c0c6d7 rename aim headers + tests 2025-09-11 11:19:58 +03:00
Krrish Dholakia a504c7dae3 test: update tests 2025-09-09 21:43:37 -07:00
Krrish Dholakia d05f58721e test: remove end of life model from tests 2025-09-09 21:01:45 -07:00
Krrish Dholakia e443d01925 test: remove redundant test 2025-09-09 20:37:09 -07:00
Krrish Dholakia 0854c35d3e test: remove eol bedrock model from tests 2025-09-09 19:48:35 -07:00
Krish DholakiaandGitHub 351896cd1d Merge pull request #12414 from dotmobo/feature/fix-timestamp-granularities 
The parameter timestamp_granularities is broken for openai-like transcription
 2025-09-08 23:13:13 -07:00
Krish DholakiaandGitHub b9ce3a1587 Merge pull request #12416 from dotmobo/feature/fix-alloy 
feat: add a health_check_voice parameter in model_info
 2025-09-08 23:12:48 -07:00
Ishaan Jaff c7f9be6803 test_async_log_cache_hit_on_callbacks 2025-09-08 17:15:53 -07:00
Ishaan Jaff 679d0414e2 test fix 2025-09-06 17:08:31 -07:00
Ishaan Jaff d89a2a0797 test 2025-09-06 16:38:43 -07:00
Ishaan Jaff 7054067238 test_cooldown_handlers.py 2025-09-06 16:13:30 -07:00