Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
055bd397
Unverified
Commit
055bd397
authored
Jul 30, 2025
by
Michael Goin
Committed by
GitHub
Jul 31, 2025
Browse files
[CI Bugfix] Fix CI OOM for `test_shared_storage_connector_hashes` (#21973)
Signed-off-by:
mgoin
<
mgoin64@gmail.com
>
parent
0f7919fc
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
1 deletion
+3
-1
tests/v1/kv_connector/unit/test_shared_storage_connector.py
tests/v1/kv_connector/unit/test_shared_storage_connector.py
+3
-1
No files found.
tests/v1/kv_connector/unit/test_shared_storage_connector.py
View file @
055bd397
...
@@ -10,7 +10,7 @@ from vllm.assets.image import ImageAsset
...
@@ -10,7 +10,7 @@ from vllm.assets.image import ImageAsset
from
vllm.config
import
KVTransferConfig
from
vllm.config
import
KVTransferConfig
from
vllm.multimodal.utils
import
encode_image_base64
from
vllm.multimodal.utils
import
encode_image_base64
MODEL_NAME
=
"
Qwen
/Qwen2.5-VL-3B-Instruct"
MODEL_NAME
=
"
RedHatAI
/Qwen2.5-VL-3B-Instruct
-quantized.w4a16
"
SAMPLING_PARAMS
=
SamplingParams
(
temperature
=
0.0
,
top_k
=
1
,
max_tokens
=
128
)
SAMPLING_PARAMS
=
SamplingParams
(
temperature
=
0.0
,
top_k
=
1
,
max_tokens
=
128
)
...
@@ -130,6 +130,8 @@ def test_shared_storage_connector_hashes(tmp_path):
...
@@ -130,6 +130,8 @@ def test_shared_storage_connector_hashes(tmp_path):
model
=
MODEL_NAME
,
model
=
MODEL_NAME
,
max_model_len
=
8192
,
max_model_len
=
8192
,
max_num_seqs
=
1
,
max_num_seqs
=
1
,
gpu_memory_utilization
=
0.4
,
enforce_eager
=
True
,
kv_transfer_config
=
kv_transfer_config
,
kv_transfer_config
=
kv_transfer_config
,
limit_mm_per_prompt
=
{
"image"
:
2
},
limit_mm_per_prompt
=
{
"image"
:
2
},
)
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment