Files
litellm/tests
ryan-crabbeandGitHub d67d12fc54 perf: Add LRU caching to get_model_info for faster cost lookups (#19606)
- Add @lru_cache decorator to get_model_info() and _cached_get_model_info_helper()
- Update _invalidate_model_cost_lowercase_map() to clear these caches when model_cost changes
- Update test to call cache invalidation after modifying litellm.model_cost

Reduces get_model_cost_information from 46% to <1% of request handling time.
2026-01-23 17:26:45 -08:00
..
2026-01-20 18:37:56 +05:30
2026-01-22 11:01:01 -08:00
2026-01-23 12:20:27 -08:00
2026-01-11 08:00:31 -08:00
2026-01-07 15:05:09 -08:00
2026-01-20 18:01:22 -08:00
2026-01-22 10:50:23 -08:00
2026-01-02 17:38:52 +09:00
2026-01-22 15:21:44 -08:00

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.