tests/kernels/test_encoder_decoder_attn.py · e150cf119b2e20f81775f36fd2cdf55321b7e5a8 · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "1248e8506a4d98b4f15cbfe729cf2af42fb4223a"

[Core] Subclass ModelRunner to support cross-attention & encoder sequences... · fd95e026

afeldman-nm authored Aug 06, 2024


[Core] Subclass ModelRunner to support cross-attention & encoder sequences (towards eventual encoder/decoder model support) (#4942)
Co-authored-by: Andrew Feldman <afeld2012@gmail.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>

fd95e026

test_encoder_decoder_attn.py 37.8 KB

Replace test_encoder_decoder_attn.py