"vllm/vscode:/vscode.git/clone" did not exist on "7b5575fa7dcf76ac86ab8d18501b9cc04f74f6bb"
Unverified Commit 24aebae1 authored by Michael Goin's avatar Michael Goin Committed by GitHub
Browse files

[Bugfix] Disable gptq_bitblas for <SM80 to fix GPTQ on V100/T4 (#17541)


Signed-off-by: default avatarmgoin <mgoin64@gmail.com>
parent 39c0813a
......@@ -134,7 +134,7 @@ class GPTQBitBLASConfig(QuantizationConfig):
@classmethod
def get_min_capability(cls) -> int:
return 70
return 80
@classmethod
def get_config_filenames(cls) -> List[str]:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment