"vllm/model_executor/models/commandr.py" did not exist on "27feead2f80f906de88d64c6e69342451cf1d7f0"
[Bug Fix] Fix the support check for FP8 CUTLASS (#5352)
Bug description: With torch 2.4.0.dev20240603+cu121, cutlass_fp8_supported outputs False, and the (capability, version) before the comparison is (90, 11111111112) This PR fixes the support check for FP8 CUTLASS ( cutlass_fp8_supported) which was introduced in https://github.com/vllm-project/vllm/pull/5183.
Showing
Please register or sign in to comment