Skip to content

GitLab

Unverified Commit a6e6604d authored by Jee Jee Li's avatar Jee Jee Li Committed by GitHub
Browse files

[Bugfix] Fix CI bitsandbytes failure (#19969) 


Signed-off-by: default avatarJee Jee Li <pandaleefree@gmail.com>
parent b82e0f82
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
tests/quantization/test_bitsandbytes.py
View file @ a6e6604d
...@@ -159,6 +159,7 @@ def test_4bit_bnb_embedding_model( ...@@ -159,6 +159,7 @@ def test_4bit_bnb_embedding_model(
with vllm_runner(model_name, with vllm_runner(model_name,
task="embed", task="embed",
dtype=dtype, dtype=dtype,
gpu_memory_utilization=0.5,
quantization="bitsandbytes") as vllm_model: quantization="bitsandbytes") as vllm_model:
vllm_outputs = vllm_model.encode(example_prompts) vllm_outputs = vllm_model.encode(example_prompts)
check_embeddings_close( check_embeddings_close(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment