Unverified Commit 8ecb3e9e authored by Tyler Michael Smith's avatar Tyler Michael Smith Committed by GitHub
Browse files

[CI Bugfix] Fix wNa16 kernel not found for test_shared_storage_connector_hashes (#22163)


Signed-off-by: default avatarTyler Michael Smith <tyler@neuralmagic.com>
parent e5949e5a
......@@ -10,7 +10,7 @@ from vllm.assets.image import ImageAsset
from vllm.config import KVTransferConfig
from vllm.multimodal.utils import encode_image_base64
MODEL_NAME = "RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w4a16"
MODEL_NAME = "RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w8a8"
SAMPLING_PARAMS = SamplingParams(temperature=0.0, top_k=1, max_tokens=128)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment