Commits · 9e0f44bec449df17d30ed9abef7aeedc059ddfde · OpenDAS / vllm_cscc · GitLab

04 Mar, 2026 1 commit
- [cohere][fix][spec-decode]: fix crash when allowed_token_ids is set without penalties (#35654) · 9e0f44be
  Komal Kumar Teru authored Mar 04, 2026
```
Signed-off-by: kkt-cohere <komal@cohere.com>
```
  9e0f44be
26 Feb, 2026 1 commit
- [Core] Support `min_tokens` with speculative decoding (#32642) · d9406076
  Yiliu Dong authored Feb 27, 2026
```
Signed-off-by: qianlihuang <yiliu.dong@qq.com>
Co-authored-by: qianlihuang <yiliu.dong@qq.com>
```
  d9406076
21 Feb, 2026 1 commit
- [Kernel] Optimize sample_recovered_tokens_kernel (#34974) · 7a5adad4
  Xin Yang authored Feb 20, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  7a5adad4
31 Jan, 2026 1 commit
- [perf] v1/spec_decode: skip softmax for all-greedy rejection sampling (#32852) · 8980001c
  caozuoba authored Jan 31, 2026
```
Signed-off-by: hdj <1293066020@qq.com>
```
  8980001c
09 Jan, 2026 1 commit
- [perf][async] support non cpu sync get logprob tensors for spec (#31336) · 97ba96fb
  zhrrr authored Jan 10, 2026
```
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  97ba96fb
19 Dec, 2025 1 commit
- [BugFix] Fix logprobs with spec decode and modified logits (#30846) · 2ac85a45
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  2ac85a45
12 Dec, 2025 1 commit
- [bugfix] fix bug when top_logprobs=0 with spec decoding (#30059) · d2c919dc
  realliujiaxu authored Dec 13, 2025
```
Signed-off-by: realliujiaxu <realliujiaxu@163.com>
```
  d2c919dc
25 Nov, 2025 1 commit
- [Core] Support logprobs with spec decode + async scheduling (#29223) · 4e57c658
  Nick Hill authored Nov 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4e57c658
21 Nov, 2025 1 commit
- Revert "[Redo] #26368 (#28771)" (#29121) · 30b9c677
  Jialin Ouyang authored Nov 20, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  30b9c677
15 Nov, 2025 3 commits

[Redo] #26368 (#28771) · 98b4d389

Cyrus Leung authored Nov 15, 2025


Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>

98b4d389

Revert "[Core] Performance: Use list[np.ndarray] instead of list[list… (#28773) · ac86bff8
Nick Hill authored Nov 14, 2025

ac86bff8

[Core] Performance: Use list[np.ndarray] instead of list[list[int]] for output... · 186352b2

Jialin Ouyang authored Nov 14, 2025


[Core] Performance: Use list[np.ndarray] instead of list[list[int]] for output tokens for GC optimization (#26368)
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>

186352b2

23 Oct, 2025 1 commit
- [V1][spec decode] return logprobs for spec decoding (#26060) · 6644796b
  Giancarlo Delfin authored Oct 22, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  6644796b
17 Oct, 2025 1 commit
- [V1][Spec Decode] Fix greedy temperature detection after sampler refactor (#27077) · acedc74b
  Pradyun92 authored Oct 17, 2025
```
Signed-off-by: Pradyun Ramadorai <pradyunr@amazon.com>
Co-authored-by: Pradyun Ramadorai <pradyunr@amazon.com>
```
  acedc74b
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 1 commit
- [Misc] Misc code simplifications (#26450) · ddcbc2f3
  Nick Hill authored Oct 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ddcbc2f3
07 Oct, 2025 1 commit

[V1] Logit processors for rejection sampler (#19482) · 6ebaf43e

Sergei Skvortsov authored Oct 07, 2025


Signed-off-by: southfreebird <yvorott@gmail.com>
Signed-off-by: Sergei Skvortsov <sergeyskv@nebius.com>
Signed-off-by: Sergei Skvortsov <yvorott@gmail.com>
Co-authored-by: Sergei Skvortsov <sergeyskv@nebius.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

6ebaf43e

05 Oct, 2025 2 commits
- Fix per file ruff ignores related to simplification (#26259) · b893d661
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b893d661
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
03 Oct, 2025 1 commit
- [Perf] Remove hardcoded num_warps=1 (#26183) · 0879736a
  Corey Lowman authored Oct 03, 2025
```
Signed-off-by: Corey Lowman <clowman1993@gmail.com>
```
  0879736a
25 Sep, 2025 1 commit

[Spec Decode] Add Batch Parallel Ngram. Upto 8x lower overhead. (#24986) · e71b8e21

Ekagra Ranjan authored Sep 25, 2025


Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

e71b8e21

20 Sep, 2025 1 commit
- [Docs] Fix warnings in mkdocs build (continued) (#25042) · 032d661d
  Wenlong Wang authored Sep 20, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  032d661d
28 Aug, 2025 2 commits
- [bugfix] [spec-decoding] fix data race in sample_recovered_tokens_kernel (vLLM v1) (#23829) · 57d4ede5
  Jingkai He authored Aug 29, 2025
```
Signed-off-by: He-Jingkai <he-jingkai@outlook.com>
```
  57d4ede5
- [BugFix][Spec Decode] Use float64 for uniform_probs (#23803) · a3432f18
  Woosuk Kwon authored Aug 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  a3432f18
27 Aug, 2025 1 commit
- [Docs] Fix warnings in `mkdocs build` (continued) (#23743) · 4e4d017b
  Hyogeun Oh (오효근) authored Aug 28, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
Signed-off-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
```
  4e4d017b
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
06 May, 2025 1 commit
- [Bugfix] Fix triton import with local TritonPlaceholder (#17446) · f9bc5a06
  Mengqing Cao authored May 06, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  f9bc5a06
04 May, 2025 1 commit
- Add full API docs and improve the UX of navigating them (#17485) · d6484ef3
  Harry Mellor authored May 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6484ef3
23 Apr, 2025 1 commit
- [V1][Spec Decode] Always use argmax for sampling draft tokens (#16899) · 41fb013d
  Woosuk Kwon authored Apr 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  41fb013d
29 Mar, 2025 1 commit
- [V1][Minor] Simplify rejection sampler's parse_output (#15741) · 2bc4be4e
  Woosuk Kwon authored Mar 29, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2bc4be4e
27 Mar, 2025 1 commit

[V1] Refactor num_computed_tokens logic (#15307) · 54aa6194

Cody Yu authored Mar 26, 2025


Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

54aa6194

25 Mar, 2025 3 commits
- [V1][Spec Decode] Update target_logits in place for rejection sampling (#15427) · 25f560a6
  Woosuk Kwon authored Mar 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  25f560a6
- [Minor][Spec Decode] Remove compiled_softmax (#15416) · 911c8eb0
  Woosuk Kwon authored Mar 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  911c8eb0
- [V1][Spec Decode] Enable spec decode for top-p & top-k sampling (#15063) · ebcebeeb
  Woosuk Kwon authored Mar 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  ebcebeeb
18 Mar, 2025 1 commit
- [V1][Spec Decode] Optimize Rejection Sampler with Triton Kernels (#14930) · 99abb8b6
  Woosuk Kwon authored Mar 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  99abb8b6
17 Mar, 2025 1 commit
- [V1] [Spec Decode] Support random sampling for spec decode (#13933) · 8d6cf895
  Lily Liu authored Mar 16, 2025
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  8d6cf895
14 Mar, 2025 1 commit
- [V1] Temporarily disable FlashInfer Rejection Sampler (#14788) · 32ef4983
  Woosuk Kwon authored Mar 13, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  32ef4983
03 Mar, 2025 1 commit
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8
26 Feb, 2025 1 commit
- [V1][Spec Decode] Change Spec Decode Rejection Sampling API (#13729) · 5629f26d
  Lily Liu authored Feb 25, 2025
  
  5629f26d
18 Feb, 2025 1 commit
- [V1] Optimize handling of sampling metadata and req_ids list (#13244) · 30172b49
  Nick Hill authored Feb 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  30172b49