"...git@developer.sourcefind.cn:2222/OpenDAS/vllm_cscc.git" did not exist on "d14c4ebf08c9a6b6c4131eb3021d50da6fb0c212"
Unverified Commit 76df6072 authored by Mark McLoughlin's avatar Mark McLoughlin Committed by GitHub
Browse files

[Core] Fix state names in pause_scheduler() (#34840)


Signed-off-by: default avatarMark McLoughlin <markmc@redhat.com>
parent 16f24e87
...@@ -1370,15 +1370,15 @@ class EngineCoreProc(EngineCore): ...@@ -1370,15 +1370,15 @@ class EngineCoreProc(EngineCore):
) -> Future | None: ) -> Future | None:
"""Pause generation; behavior depends on mode. """Pause generation; behavior depends on mode.
All pause states queue new adds. PAUSE_ABORT and PAUSE_KEEP skip step(); All pause modes queue new adds -- "abort" and "keep" skip step();
PAUSE_WAIT allows step() so in-flight requests can drain. "wait" allows step() so in-flight requests can drain.
- ``abort``: Set PAUSE_ABORT, abort all requests, wait for abort - ``abort``: Set PAUSED_NEW, abort all requests, wait for abort
outputs to be sent (when running with output_queue), clear caches, outputs to be sent (when running with output_queue), optionally
then complete the returned Future. clear caches, then complete the returned Future.
- ``wait``: Set PAUSE_WAIT (queue adds, keep stepping); when drained, - ``wait``: Set PAUSED_NEW (queue adds, keep stepping); when drained,
set PAUSE_KEEP, clear caches, complete the returned Future. optionally clear caches, then complete the returned Future.
- ``keep``: Set PAUSE_KEEP; return a Future that completes when the - ``keep``: Set PAUSED_ALL; return a Future that completes when the
output queue is empty. output queue is empty.
""" """
if mode not in ("keep", "abort", "wait"): if mode not in ("keep", "abort", "wait"):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment