"ssh:/git@developer.sourcefind.cn:2222/OpenDAS/vllm_cscc.git" did not exist on "36d7f19897843c9cbdb701ba88d0f2c29954fe44"
Unverified Commit 8ecb3e9e authored by Tyler Michael Smith's avatar Tyler Michael Smith Committed by GitHub
Browse files

[CI Bugfix] Fix wNa16 kernel not found for test_shared_storage_connector_hashes (#22163)


Signed-off-by: default avatarTyler Michael Smith <tyler@neuralmagic.com>
parent e5949e5a
...@@ -10,7 +10,7 @@ from vllm.assets.image import ImageAsset ...@@ -10,7 +10,7 @@ from vllm.assets.image import ImageAsset
from vllm.config import KVTransferConfig from vllm.config import KVTransferConfig
from vllm.multimodal.utils import encode_image_base64 from vllm.multimodal.utils import encode_image_base64
MODEL_NAME = "RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w4a16" MODEL_NAME = "RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w8a8"
SAMPLING_PARAMS = SamplingParams(temperature=0.0, top_k=1, max_tokens=128) SAMPLING_PARAMS = SamplingParams(temperature=0.0, top_k=1, max_tokens=128)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment