Commits · 8ff4a9956693450a37843bde88934ebcea440402 · OpenDAS / vllm_cscc

09 Jan, 2026 1 commit

[Async][Feat] support apply penalty or bad_words for async + spec (#30495) · 8ff4a995

zhrrr authored Jan 09, 2026


Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

8ff4a995

06 Jan, 2026 1 commit

[Perf] Async Scheduling + Speculative Decoding + Structured Outputs (#29821) · f7008ce1

Benjamin Chislett authored Jan 06, 2026


Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

f7008ce1

05 Jan, 2026 1 commit
- [Bug] Revert torch warning fix (#31585) · af9a7ec2
  Wentao Ye authored Jan 05, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  af9a7ec2
18 Dec, 2025 1 commit
- [ROCm][CI] Reduce Flakiness For test_async_scheduling Using ROCM_ATTN With FP32 (#30811) · fd8afdf3
  Micah Williamson authored Dec 17, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  fd8afdf3
17 Dec, 2025 1 commit
- [Attention] Update tests to remove deprecated env vars (#30563) · 7eb6cb6c
  Matthew Bonanni authored Dec 17, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  7eb6cb6c
11 Dec, 2025 1 commit
- [Chore] Fix torch precision warning (#30428) · d6464f26
  Wentao Ye authored Dec 10, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d6464f26
10 Dec, 2025 1 commit

[ROCm][CI] Attempt to fix the failures under a subgroup of the e2e the test group (#29358) · ed7af317

Andreas Karatzas authored Dec 09, 2025


Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>

ed7af317

09 Dec, 2025 1 commit

[Compile] Fix torch warning `TensorFloat32 tensor cores for float32 matrix... · 83319b44

Wentao Ye authored Dec 09, 2025


[Compile] Fix torch warning `TensorFloat32 tensor cores for float32 matrix multiplication available but not enabled` (#29897)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

83319b44

25 Nov, 2025 1 commit
- [Core] Support logprobs with spec decode + async scheduling (#29223) · 4e57c658
  Nick Hill authored Nov 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4e57c658
18 Nov, 2025 1 commit
- [CI] Fix async scheduling + spec decoding test flake (#28902) · 5bdd1552
  Nick Hill authored Nov 17, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5bdd1552
17 Nov, 2025 1 commit

[Core] Async Scheduling X Spec Decoding Compatibility (#24799) · d8874c61

Ronald authored Nov 18, 2025


Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

d8874c61

16 Nov, 2025 1 commit
- [BugFix] Fix async scheduling + chunked prefill + preemption (#28787) · 80b6080d
  Nick Hill authored Nov 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  80b6080d
15 Nov, 2025 1 commit
- [Test] Rework e2e async scheduling tests (#28744) · 58e61e56
  Nick Hill authored Nov 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  58e61e56
01 Nov, 2025 1 commit
- [Core] Async scheduling + structured outputs compatibility (#26866) · 0cdbe7b7
  Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  0cdbe7b7
28 Oct, 2025 1 commit
- [AsyncScheduling] Make async overlap work with logprobs (#27615) · 4fe58953
  Nick Hill authored Oct 28, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4fe58953
21 Oct, 2025 1 commit
- Update PyTorch to 2.9.0+cu129 (#24994) · becb7de4
  Huy Do authored Oct 21, 2025
```
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  becb7de4
16 Oct, 2025 1 commit
- [small][batch invariance] Rename the env and internal flags to simplify usage (#26855) · b2f78cba
  Bram Wasti authored Oct 16, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
```
  b2f78cba
10 Oct, 2025 2 commits
- [BugFix] Make penalties and bad_words work with async scheduling (#26467) · 5bc26c43
  Nick Hill authored Oct 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5bc26c43
- [BugFix] Fix async scheduling + request preemption (#26385) · 949cb017
  Nick Hill authored Oct 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  949cb017