"vllm/vscode:/vscode.git/clone" did not exist on "95863540538804a48e31ca5806cefbac9d4c5326"
- 17 Oct, 2024 1 commit
-
-
Kuntai Du authored
Removing the block manager v1. This is the initial piece of prefix-caching-centric design. In order to achieve prefix-caching-centric design, we need to simplify the code path so that we only use v2 block manager (which has much higher performance on prefix caching).
-
- 20 Jun, 2024 1 commit
-
-
Michael Goin authored
-
- 14 May, 2024 1 commit
-
-
Kuntai Du authored
[Core][Hash][Automatic Prefix caching] Accelerating the hashing function by avoiding deep copies (#4696)
-
