Commit Graph
1 Commits
Author SHA1 Message Date
Ishaan JaffandGitHub 753290e5b8 (perf) Fix memory leak on /completions route (#8551)
* initial mem util test

* fix _cached_get_model_info_helper

* test memory usage

* fix tests

* fix mem usage
2025-02-14 18:58:16 -08:00