Commits · 4731884796d43bd8493769dbfb0e199a2a542092 · OpenDAS / vllm_cscc

24 Mar, 2026 1 commit

[Feature] limit thinking tokens (hard limit) (#20859) · 47318847

Sungjae Lee authored Mar 25, 2026


Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
Signed-off-by: Sungjae Lee <sung-jae.lee@navercorp.com>
Signed-off-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

47318847

17 Mar, 2026 1 commit
- [Perf] Optimize top-k search in apply_top_k_top_p_triton sampler (#37225) · 51b2333b
  Michael Goin authored Mar 17, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  51b2333b
04 Mar, 2026 3 commits
- [CI] Bump `mypy` version (#34950) · 17dc9c7f
  Harry Mellor authored Mar 04, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  17dc9c7f
- [Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d
  Kunshang Ji authored Mar 04, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  16d2ad1d
- [cohere][fix][spec-decode]: fix crash when allowed_token_ids is set without penalties (#35654) · 9e0f44be
  Komal Kumar Teru authored Mar 04, 2026
```
Signed-off-by: kkt-cohere <komal@cohere.com>
```
  9e0f44be
26 Feb, 2026 1 commit
- [Core] Support `min_tokens` with speculative decoding (#32642) · d9406076
  Yiliu Dong authored Feb 27, 2026
```
Signed-off-by: qianlihuang <yiliu.dong@qq.com>
Co-authored-by: qianlihuang <yiliu.dong@qq.com>
```
  d9406076
25 Feb, 2026 2 commits
- [Platform] Add current_platform.num_compute_units interface (#35042) · 8ad54a99
  Kunshang Ji authored Feb 25, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
```
  8ad54a99
- remove cuda check in `top_k_top_p_triton` kernel (#35011) · 92510edc
  Kunshang Ji authored Feb 25, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  92510edc
22 Feb, 2026 1 commit
- Fix apply_top_k_top_p_triton called by non-cuda logits Tensor (#35030) · 30132cd1
  Xiao Li authored Feb 21, 2026
```
Signed-off-by: Xiao Li <ilx@meta.com>
```
  30132cd1
21 Feb, 2026 1 commit
- [Kernel] Optimize sample_recovered_tokens_kernel (#34974) · 7a5adad4
  Xin Yang authored Feb 20, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  7a5adad4
17 Feb, 2026 1 commit

[Kernel] Triton-based Top-k and Top-p sampler kernels (#33538) · c656ba3b

Jongseok Park authored Feb 17, 2026


Signed-off-by: js_park <cakeng@naver.com>
Signed-off-by: Jongseok Park <37990712+cakeng@users.noreply.github.com>
Signed-off-by: Sunga Kim <sunga.kim@berkeley.edu>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Sunga Kim <sunga.kim@berkeley.edu>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

c656ba3b

13 Feb, 2026 1 commit
- Fix num_logprobs parameter description in sampler.py (#34451) · d707678d
  Zhuohan Li authored Feb 12, 2026
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  d707678d
31 Jan, 2026 1 commit
- [perf] v1/spec_decode: skip softmax for all-greedy rejection sampling (#32852) · 8980001c
  caozuoba authored Jan 31, 2026
```
Signed-off-by: hdj <1293066020@qq.com>
```
  8980001c
30 Jan, 2026 1 commit

[Misc] Replace Optional[X] with X | None syntax (#33332) · 1a7894db

杨朱 · Kiki authored Jan 30, 2026


Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>

1a7894db

22 Jan, 2026 1 commit
- [Refactor] Remove unused tpu files (#32610) · f7448101
  Wentao Ye authored Jan 22, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  f7448101
15 Jan, 2026 1 commit
- [ROCm][Bugfix] Disable hip sampler to fix deepseek's accuracy issue on ROCm (#32413) · 77c16df3
  Pleaplusone authored Jan 16, 2026
```
Signed-off-by: ganyi <ygan@amd.com>
```
  77c16df3
09 Jan, 2026 1 commit
- [perf][async] support non cpu sync get logprob tensors for spec (#31336) · 97ba96fb
  zhrrr authored Jan 10, 2026
```
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  97ba96fb
07 Jan, 2026 1 commit
- [BugFix] Fix bad words with speculative decoding (#31908) · 10ef65ed
  Nick Hill authored Jan 07, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  10ef65ed
19 Dec, 2025 1 commit
- [BugFix] Fix logprobs with spec decode and modified logits (#30846) · 2ac85a45
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  2ac85a45
12 Dec, 2025 1 commit
- [bugfix] fix bug when top_logprobs=0 with spec decoding (#30059) · d2c919dc
  realliujiaxu authored Dec 13, 2025
```
Signed-off-by: realliujiaxu <realliujiaxu@163.com>
```
  d2c919dc
02 Dec, 2025 1 commit
- [Perf] Avoid pageable HtoD transfer in MinTokensLogitsProcessor (#29826) · 1528e079
  jthomson04 authored Dec 02, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  1528e079
28 Nov, 2025 2 commits
- [mypy] Enable type checking for more directories (#29674) · 9e6bcda3
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9e6bcda3
- Guard FlashInfer sampler using the same check as FlashInfer attention backend (#29415) · 9eec282c
  Harry Mellor authored Nov 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  9eec282c
27 Nov, 2025 1 commit
- [Doc]: fixing typos in diverse files (#29492) · 66d3d542
  Didier Durand authored Nov 27, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  66d3d542
25 Nov, 2025 1 commit
- [Core] Support logprobs with spec decode + async scheduling (#29223) · 4e57c658
  Nick Hill authored Nov 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4e57c658
22 Nov, 2025 1 commit
- [BugFix] Fix returned logprobs with spec decode + prefill chunking (#29216) · d44a63c6
  Nick Hill authored Nov 22, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  d44a63c6
21 Nov, 2025 2 commits

Revert "[Redo] #26368 (#28771)" (#29121) · 30b9c677
Jialin Ouyang authored Nov 20, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
30b9c677

[AITER] [ROCm] Fix crash when loading llama4 model with old aiter version... · ed6ae1e3

Xiao Li authored Nov 20, 2025


[AITER] [ROCm] Fix crash when loading llama4 model with old aiter version installed, fallback to forward_native implementation (#29124)
Signed-off-by: Xiao Li <ilx@meta.com>

ed6ae1e3

18 Nov, 2025 1 commit
- [FEAT] [AITER] [ROCm] integrate aiter sampling ops (#26084) · 0af3d4f0
  vllmellm authored Nov 19, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  0af3d4f0
17 Nov, 2025 1 commit

[Core] Async Scheduling X Spec Decoding Compatibility (#24799) · d8874c61

Ronald authored Nov 18, 2025


Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

d8874c61

15 Nov, 2025 3 commits

[Redo] #26368 (#28771) · 98b4d389

Cyrus Leung authored Nov 15, 2025


Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>

98b4d389

Revert "[Core] Performance: Use list[np.ndarray] instead of list[list… (#28773) · ac86bff8
Nick Hill authored Nov 14, 2025

ac86bff8

[Core] Performance: Use list[np.ndarray] instead of list[list[int]] for output... · 186352b2

Jialin Ouyang authored Nov 14, 2025


[Core] Performance: Use list[np.ndarray] instead of list[list[int]] for output tokens for GC optimization (#26368)
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>

186352b2

12 Nov, 2025 1 commit
- [Performance] Cache loaded custom logitsprocs to avoid overheads (#28462) · 3f770f44
  Isotr0py authored Nov 12, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3f770f44
07 Nov, 2025 1 commit
- [CPU]Avoid repeated random sample compile (#28260) · 7bdb42b2
  Zhang Xiangze authored Nov 07, 2025
```
Signed-off-by: Zhang Xiangze <Xiangze.Zhang@arm.com>
```
  7bdb42b2
05 Nov, 2025 1 commit
- [Bugfix] Validate custom logits processor xargs for online serving (#27560) · 3f5a4b64
  Isotr0py authored Nov 06, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3f5a4b64
01 Nov, 2025 1 commit
- [BugFix] Fix mixed penalties batch with async scheduling (#27910) · c2ed069b
  Nick Hill authored Nov 01, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c2ed069b
24 Oct, 2025 1 commit
- [Log] Optimize Startup Log (#26740) · 52efc34e
  Wentao Ye authored Oct 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  52efc34e
23 Oct, 2025 2 commits
- [Chore] Separate out `vllm.utils.platform_utils.py` (#27374) · ca76486a
  Jonathan Chen authored Oct 23, 2025
```
Signed-off-by: Jonathan <chenleejonathan@gmail.com>
```
  ca76486a
- [V1][spec decode] return logprobs for spec decoding (#26060) · 6644796b
  Giancarlo Delfin authored Oct 22, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  6644796b