tests/prefix_caching/test_prefix_caching.py · 9474e89ba4ecae253b585eb6b3e1d85f4e108f01 · OpenDAS / vllm_cscc

[PREFIX CACHING FOLLOW UP] A bunch of fixes to block allocator performance... · 9474e89b

ElizaWszola authored Mar 20, 2024


[PREFIX CACHING FOLLOW UP] A bunch of fixes to block allocator performance when automatic prefix caching is disabled (#3357)
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

9474e89b

test_prefix_caching.py 2.61 KB

Replace test_prefix_caching.py