Skip to content

GitLab

Unverified Commit cad21918 authored by Aaron Hao's avatar Aaron Hao Committed by GitHub
Browse files

[BUG] Fix rlhf_async example (#35788) 


Signed-off-by: default avatarahao-anyscale <ahao@anyscale.com>
parent 53700bf4
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
examples/offline_inference/new_weight_syncing/rlhf_async_new_apis.py
View file @ cad21918
......@@ -104,7 +104,7 @@ class MyLLM(vllm.AsyncLLMEngine):
while not self._request_pause_flag:
await asyncio.sleep(0)
await super().pause_generation(mode="keep")
await asyncio.sleep(0.2)
await asyncio.sleep(5)
self._generation_paused = True
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment