Skip to content

GitLab

Commit 4f799f11 authored by zhuwenwen's avatar zhuwenwen
Browse files

[Feature] Supported deepseek_v4_fp8 quantization in rocm

parent a7378418
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
vllm/platforms/rocm.py
View file @ 4f799f11
...@@ -418,6 +418,7 @@ class RocmPlatform(Platform): ...@@ -418,6 +418,7 @@ class RocmPlatform(Platform):
"torchao", "torchao",
"bitsandbytes", "bitsandbytes",
"modelopt_fp4", "modelopt_fp4",
"deepseek_v4_fp8",
] ]
@classmethod @classmethod
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment