Skip to content

GitLab

Unverified Commit a79079fe authored by Richard Zou's avatar Richard Zou Committed by GitHub
Browse files

[BugFix] Fix flakiness in test_eagle_dp for PyTorch 2.10 (#31915) 


Signed-off-by: default avatarRichard Zou <zou3519@gmail.com>
parent 9f6dcb71
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 1 deletion
tests/v1/distributed/test_eagle_dp.py
View file @ a79079fe
...@@ -47,7 +47,9 @@ async def test_run_eagle_dp(monkeypatch: pytest.MonkeyPatch): ...@@ -47,7 +47,9 @@ async def test_run_eagle_dp(monkeypatch: pytest.MonkeyPatch):
) )
prompt = "This is a test of data parallel with eagle" prompt = "This is a test of data parallel with eagle"
num_expected_tokens = 100 # This test might be flaky, see
# https://github.com/vllm-project/vllm/issues/31913
num_expected_tokens = 20
sampling_params = SamplingParams( sampling_params = SamplingParams(
min_tokens=num_expected_tokens, min_tokens=num_expected_tokens,
max_tokens=num_expected_tokens, max_tokens=num_expected_tokens,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment