Skip to content

GitLab

Unverified Commit 141cd439 authored by Michael Goin's avatar Michael Goin Committed by GitHub
Browse files

[UX] Remove noisy CT UnquantizedLinearMethod warn (#33273) 


Signed-off-by: default avatarmgoin <mgoin64@gmail.com>
parent 6bf3b46d
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 5 deletions
vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors.py
View file @ 141cd439
......@@ -751,11 +751,7 @@ class CompressedTensorsConfig(QuantizationConfig):
model_compression_config=model_compression_config,
)
elif weight_quant is None:
logger.warning_once(
"Acceleration for non-quantized schemes is "
"not supported by Compressed Tensors. "
"Falling back to UnquantizedLinearMethod"
)
# Falling back to UnquantizedLinearMethod
return None
else:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment