Skip to content

GitLab

Unverified Commit 24aebae1 authored by Michael Goin's avatar Michael Goin Committed by GitHub
Browse files

[Bugfix] Disable gptq_bitblas for <SM80 to fix GPTQ on V100/T4 (#17541) 


Signed-off-by: default avatarmgoin <mgoin64@gmail.com>
parent 39c0813a
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/model_executor/layers/quantization/gptq_bitblas.py
View file @ 24aebae1
...@@ -134,7 +134,7 @@ class GPTQBitBLASConfig(QuantizationConfig): ...@@ -134,7 +134,7 @@ class GPTQBitBLASConfig(QuantizationConfig):
@classmethod @classmethod
def get_min_capability(cls) -> int: def get_min_capability(cls) -> int:
return 70 return 80
@classmethod @classmethod
def get_config_filenames(cls) -> List[str]: def get_config_filenames(cls) -> List[str]:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment