[Misc] Modify LRUCache touch (#16689)

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

[Misc] Modify LRUCache touch (#16689)
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
0d7d05f4 · Jee Jee Li · GitHub · 96bb8aa6 · 0d7d05f4
Unverified Commit 0d7d05f4 authored Apr 16, 2025 by Jee Jee Li Committed by GitHub Apr 16, 2025
Show whitespace changes
Inline Side-by-side

Showing with 4 additions and 1 deletion

vllm/utils.py vllm/utils.py +4 -1

No files found.
--- a/vllm/utils.py
+++ b/vllm/utils.py
@@ -316,7 +316,10 @@ class LRUCache(cachetools.LRUCache[_K, _V], Generic[_K, _V]):
        return info

    def touch(self, key: _K) -> None:
-        self._LRUCache__update(key)  # type: ignore
+        try:
+            self._LRUCache__order.move_to_end(key)  # type: ignore
+        except KeyError:
+            self._LRUCache__order[key] = None  # type: ignore

    @overload
    def get(self, key: _K, /) -> Optional[_V]: