tests/fault_tolerance/test_request_cancellation.py · 8bb9a555a4f7ab2dd2d85d171c7f21bdaf9d5793 · OpenDAS / dynamo · GitLab

Find file Blame History Permalink

feat: Enable vLLM abort while engine is generating the next token (#3102) · 8bb9a555
Jacky authored Sep 23, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
8bb9a555

test_request_cancellation.py 18.6 KB