Unverified Commit a6e6604d authored by Jee Jee Li's avatar Jee Jee Li Committed by GitHub
Browse files

[Bugfix] Fix CI bitsandbytes failure (#19969)


Signed-off-by: default avatarJee Jee Li <pandaleefree@gmail.com>
parent b82e0f82
......@@ -159,6 +159,7 @@ def test_4bit_bnb_embedding_model(
with vllm_runner(model_name,
task="embed",
dtype=dtype,
gpu_memory_utilization=0.5,
quantization="bitsandbytes") as vllm_model:
vllm_outputs = vllm_model.encode(example_prompts)
check_embeddings_close(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment