tests/kernels/test_encoder_decoder_attn.py · 705f6a35aa92800b9c69c8b346168c3055fdebbd · OpenDAS / vllm_cscc

[Kernel] Correctly invoke prefill & decode kernels for cross-attention... · 543aa485

afeldman-nm authored Jul 08, 2024


[Kernel] Correctly invoke prefill & decode kernels for cross-attention (towards eventual encoder/decoder model support) (#4888)
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

543aa485

test_encoder_decoder_attn.py 35.9 KB

Replace test_encoder_decoder_attn.py