Unverified Commit c7d2a554 authored by Huamin Li's avatar Huamin Li Committed by GitHub
Browse files

[CI Failure] fix test_default_mm_loras (#27795)


Signed-off-by: default avatarHuamin Li <3ericli@gmail.com>
parent af826e08
...@@ -30,7 +30,8 @@ VLLM_RUNNER_BASE_KWARGS = { ...@@ -30,7 +30,8 @@ VLLM_RUNNER_BASE_KWARGS = {
"enable_lora": "True", "enable_lora": "True",
"max_num_seqs": 2, "max_num_seqs": 2,
"max_lora_rank": 320, "max_lora_rank": 320,
"max_model_len": 12800, # Keep these LoRA tests on short-RoPE for determinism post-LongRoPE change.
"max_model_len": 4096,
"gpu_memory_utilization": 0.8, "gpu_memory_utilization": 0.8,
"limit_mm_per_prompt": {"audio": 1}, "limit_mm_per_prompt": {"audio": 1},
"enforce_eager": True, "enforce_eager": True,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment