Skip to content

GitLab

Unverified Commit cbe94391 authored by Rahul Tuli's avatar Rahul Tuli Committed by GitHub
Browse files

Fix: cases with empty sparsity config (#12057) 


Signed-off-by: default avatarRahul Tuli <rahul@neuralmagic.com>
parent 994fc655
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors.py
View file @ cbe94391
......@@ -113,7 +113,7 @@ class CompressedTensorsConfig(QuantizationConfig):
:return: A dictionary mapping target layer names to their corresponding
sparsity compression configurations
"""
if (sparsity_config := config.get(SPARSITY_CONFIG_NAME)) is None:
if not (sparsity_config := config.get(SPARSITY_CONFIG_NAME)):
return dict()
sparsity_config = SparsityCompressionConfig.model_validate(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment