tests/prefix_caching/test_prefix_caching.py · 6d2051cc498f78cd60b4c1da054a499d6a7594ff · OpenDAS / vllm_cscc

[Core] Deprecating block manager v1 and make block manager v2 default (#8704) · 81ede99c

Kuntai Du authored Oct 17, 2024

Removing the block manager v1. This is the initial piece of prefix-caching-centric design. In order to achieve prefix-caching-centric design, we need to simplify the code path so that we only use v2 block manager (which has much higher performance on prefix caching).

81ede99c

test_prefix_caching.py 1.65 KB

Replace test_prefix_caching.py