Skip to content

GitLab

Unverified Commit e465b08d authored by liwenju0's avatar liwenju0 Committed by GitHub
Browse files

fix bug of VLLM_AVAILABLE not defined (#5497)

parent bed05878
Hide whitespace changes
Inline Side-by-side
Showing with 7 additions and 0 deletions
python/sglang/srt/layers/quantization/compressed_tensors/compressed_tensors.py
View file @ e465b08d
...@@ -40,6 +40,13 @@ from sglang.srt.layers.quantization.compressed_tensors.utils import ( ...@@ -40,6 +40,13 @@ from sglang.srt.layers.quantization.compressed_tensors.utils import (
should_ignore_layer, should_ignore_layer,
) )
try:
import vllm
VLLM_AVAILABLE = True
except ImportError:
VLLM_AVAILABLE = False
logger = logging.getLogger(__name__) logger = logging.getLogger(__name__)
__all__ = ["CompressedTensorsLinearMethod"] __all__ = ["CompressedTensorsLinearMethod"]
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment