Skip to content

GitLab

Unverified Commit f9e2a75a authored by jiahanc's avatar jiahanc Committed by GitHub
Browse files

[fix] add cutedsl to global sf (#32001) 


Signed-off-by: default avatarjiahanc <173873397+jiahanc@users.noreply.github.com>
parent a4d5d663
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
vllm/model_executor/layers/quantization/utils/flashinfer_utils.py
View file @ f9e2a75a
......@@ -264,6 +264,7 @@ def is_flashinfer_supporting_global_sf(backend: FlashinferMoeBackend | None) ->
backends_supporting_global_sf = (
FlashinferMoeBackend.CUTLASS,
FlashinferMoeBackend.TENSORRT_LLM,
FlashinferMoeBackend.CUTEDSL,
)
return backend in backends_supporting_global_sf
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment