Merge branch 'v0.9.2-dev-wm' into 'v0.9.2-dev'
[fix]避免mla中cudagraph的适配影响非并行解码的逻辑 See merge request dcutoolkit/deeplearing/vllm!165
Showing
Please register or sign in to comment
[fix]避免mla中cudagraph的适配影响非并行解码的逻辑 See merge request dcutoolkit/deeplearing/vllm!165