Unverified Commit 7c636432 authored by Wentao Ye's avatar Wentao Ye Committed by GitHub
Browse files

[CI Bug] fix flaky test (#39938)


Signed-off-by: default avataryewentao256 <zhyanwentao@126.com>
parent c77e596e
...@@ -195,7 +195,7 @@ def test_fewer_blocks_with_hma(monkeypatch, model_name, sw_size): ...@@ -195,7 +195,7 @@ def test_fewer_blocks_with_hma(monkeypatch, model_name, sw_size):
llm_kwargs = { llm_kwargs = {
"model": model_name, "model": model_name,
"enforce_eager": True, "enforce_eager": True,
"gpu_memory_utilization": 0.5, "gpu_memory_utilization": 0.47,
"kv_transfer_config": kv_transfer_config, "kv_transfer_config": kv_transfer_config,
"max_model_len": 2048, "max_model_len": 2048,
# NOTE: Make sure HMA is enabled # NOTE: Make sure HMA is enabled
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment