Unverified Commit 3a6ae1d3 authored by Simon Mo's avatar Simon Mo Committed by GitHub
Browse files

[CI] Disable flash_attn backend for spec decode (#5286)

parent 8f1729b8
......@@ -124,7 +124,10 @@ steps:
- label: Speculative decoding tests
#mirror_hardwares: [amd]
command: pytest -v -s spec_decode
commands:
# See https://github.com/vllm-project/vllm/issues/5152
- export VLLM_ATTENTION_BACKEND=XFORMERS
- pytest -v -s spec_decode
- label: LoRA Test %N
#mirror_hardwares: [amd]
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment