Skip to content

GitLab

"docs/vscode:/vscode.git/clone" did not exist on "af990989cf1463ce209299541142279972355a6b"
Unverified Commit fd63b62e authored by Enrique Shockwave's avatar Enrique Shockwave Committed by GitHub
Browse files

fix compressed tensors WNA16 imports (#8142)

parent 719b29f2
Hide whitespace changes
Inline Side-by-side
Showing with 4 additions and 1 deletion
python/sglang/srt/layers/quantization/compressed_tensors/compressed_tensors.py
View file @ fd63b62e
...@@ -40,7 +40,10 @@ from sglang.srt.layers.quantization.compressed_tensors.utils import ( ...@@ -40,7 +40,10 @@ from sglang.srt.layers.quantization.compressed_tensors.utils import (
from sglang.srt.layers.quantization.unquant import UnquantizedLinearMethod from sglang.srt.layers.quantization.unquant import UnquantizedLinearMethod
try: try:
import vllm from vllm.model_executor.layers.quantization.compressed_tensors.schemes.compressed_tensors_wNa16 import (
WNA16_SUPPORTED_BITS,
CompressedTensorsWNA16,
)
VLLM_AVAILABLE = True VLLM_AVAILABLE = True
except ImportError: except ImportError:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment