Skip to content

GitLab

"...git@developer.sourcefind.cn:2222/OpenDAS/vllm_cscc.git" did not exist on "661a34fd4fdd700a29b2db758e23e4e243e7ff18"
Unverified Commit f9e2a75a authored by jiahanc's avatar jiahanc Committed by GitHub
Browse files

[fix] add cutedsl to global sf (#32001) 


Signed-off-by: default avatarjiahanc <173873397+jiahanc@users.noreply.github.com>
parent a4d5d663
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
vllm/model_executor/layers/quantization/utils/flashinfer_utils.py
View file @ f9e2a75a
...@@ -264,6 +264,7 @@ def is_flashinfer_supporting_global_sf(backend: FlashinferMoeBackend | None) -> ...@@ -264,6 +264,7 @@ def is_flashinfer_supporting_global_sf(backend: FlashinferMoeBackend | None) ->
backends_supporting_global_sf = ( backends_supporting_global_sf = (
FlashinferMoeBackend.CUTLASS, FlashinferMoeBackend.CUTLASS,
FlashinferMoeBackend.TENSORRT_LLM, FlashinferMoeBackend.TENSORRT_LLM,
FlashinferMoeBackend.CUTEDSL,
) )
return backend in backends_supporting_global_sf return backend in backends_supporting_global_sf
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment