Commits · 586f0eba8225d7c0a358c8a286e4e13b9739dfd7 · OpenDAS / vllm_cscc

04 Mar, 2026 1 commit
- [perf]合入lightop topp_topk 融合算子 · 586f0eba
  王敏 authored Mar 04, 2026
  
  586f0eba
26 Feb, 2026 1 commit

feat(sampler): 增加 reduced topk+topp 采样快速路径以降低全词表 softmax 开销 · a17c410d

laibao authored Feb 26, 2026

新增 VLLM_V1_USE_REDUCED_TOPK_TOPP_SAMPLER 开关并补充适用场景说明

在 V1 GPU 输入批预计算 max_top_k/has_any_no_top_k，native sampler 满足条件时走 reduced fast path，异常自动回退

a17c410d

16 Jan, 2026 1 commit
- [ROCm][Bugfix] Disable hip sampler to fix deepseek's accuracy issue on ROCm (#32413) · 6ac0fcf4
  Pleaplusone authored Jan 16, 2026
```
Signed-off-by: ganyi <ygan@amd.com>
(cherry picked from commit 77c16df3)
```
  6ac0fcf4
15 Jan, 2026 1 commit
- [ROCm][Bugfix] Disable hip sampler to fix deepseek's accuracy issue on ROCm (#32413) · 77c16df3
  Pleaplusone authored Jan 16, 2026
```
Signed-off-by: ganyi <ygan@amd.com>
```
  77c16df3
07 Jan, 2026 1 commit
- [BugFix] Fix bad words with speculative decoding (#31908) · 10ef65ed
  Nick Hill authored Jan 07, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  10ef65ed
28 Nov, 2025 1 commit
- Guard FlashInfer sampler using the same check as FlashInfer attention backend (#29415) · 9eec282c
  Harry Mellor authored Nov 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  9eec282c
21 Nov, 2025 1 commit

[AITER] [ROCm] Fix crash when loading llama4 model with old aiter version... · ed6ae1e3

Xiao Li authored Nov 20, 2025


[AITER] [ROCm] Fix crash when loading llama4 model with old aiter version installed, fallback to forward_native implementation (#29124)
Signed-off-by: Xiao Li <ilx@meta.com>

ed6ae1e3

18 Nov, 2025 1 commit
- [FEAT] [AITER] [ROCm] integrate aiter sampling ops (#26084) · 0af3d4f0
  vllmellm authored Nov 19, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  0af3d4f0
07 Nov, 2025 1 commit
- [CPU]Avoid repeated random sample compile (#28260) · 7bdb42b2
  Zhang Xiangze authored Nov 07, 2025
```
Signed-off-by: Zhang Xiangze <Xiangze.Zhang@arm.com>
```
  7bdb42b2
01 Nov, 2025 1 commit
- [BugFix] Fix mixed penalties batch with async scheduling (#27910) · c2ed069b
  Nick Hill authored Nov 01, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c2ed069b
24 Oct, 2025 1 commit
- [Log] Optimize Startup Log (#26740) · 52efc34e
  Wentao Ye authored Oct 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  52efc34e
23 Oct, 2025 1 commit
- [Chore] Separate out `vllm.utils.platform_utils.py` (#27374) · ca76486a
  Jonathan Chen authored Oct 23, 2025
```
Signed-off-by: Jonathan <chenleejonathan@gmail.com>
```
  ca76486a
18 Oct, 2025 1 commit
- [Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
  Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  6ac5e06f
17 Oct, 2025 1 commit
- [Kernel] Lazy import FlashInfer (#26977) · fec2b341
  Jee Jee Li authored Oct 17, 2025
  
  fec2b341
16 Oct, 2025 1 commit
- [Hardware][CPU][PowerPC]Disable torch.compile() in toptopk sampling (#26987) · f7d318de
  Akash kaothalkar authored Oct 16, 2025
```
Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
```
  f7d318de
15 Oct, 2025 1 commit
- Disable FlashInfer sampler by default (#26859) · e66d787b
  Michael Goin authored Oct 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  e66d787b
13 Oct, 2025 1 commit

[Hardware][CPU] Disable torch.compile for RISC-V to prevent APIError (#26693) · 4a61950f

ihb2032 authored Oct 13, 2025


Signed-off-by: lyd1992 <liuyudong@iscas.ac.cn>
Signed-off-by: ihb2032 <1355790728@qq.com>
Signed-off-by: lyd1992 <liuyudong@iscas.ac.cn

4a61950f

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
08 Oct, 2025 1 commit
- Tidy `vllm/config/__init__.py` to only add classes and functions (#26405) · 2f99f2f5
  Harry Mellor authored Oct 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2f99f2f5
07 Oct, 2025 1 commit

[V1] Logit processors for rejection sampler (#19482) · 6ebaf43e

Sergei Skvortsov authored Oct 07, 2025


Signed-off-by: southfreebird <yvorott@gmail.com>
Signed-off-by: Sergei Skvortsov <sergeyskv@nebius.com>
Signed-off-by: Sergei Skvortsov <yvorott@gmail.com>
Co-authored-by: Sergei Skvortsov <sergeyskv@nebius.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

6ebaf43e

05 Oct, 2025 2 commits
- Fix per file ruff ignores related to simplification (#26259) · b893d661
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b893d661
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
25 Sep, 2025 2 commits
- [ux] Switch a warning to debug about a pytorch fallback (#23750) · 532a6cfc
  Russell Bryant authored Sep 25, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  532a6cfc
- [CPU] update torch 2.8 and fix missing fields in TorchSDPAMetadata (#25652) · eb32335e
  Li, Jiang authored Sep 25, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  eb32335e
19 Sep, 2025 1 commit
- Move `ModelConfig` from `config/__init__.py` to `config/model.py` (#25252) · aed16879
  Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  aed16879
07 Sep, 2025 1 commit
- [TPU] Remove TopKTopPSampler dependency for TPU sampler (#24391) · 105d3d62
  Woosuk Kwon authored Sep 07, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  105d3d62
21 Aug, 2025 1 commit

[Sampler] Support returning final logprobs (#22387) · f571ff8e

22quinn authored Aug 20, 2025


Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

f571ff8e

07 Aug, 2025 1 commit
- [Bugfix] Add proper comparison for package versions (#22314) · 609b533c
  Syed Muhammad Bin Asif authored Aug 07, 2025
```
Signed-off-by: Syed Muhammad Bin Asif <syedmba7@connect.hku.hk>
```
  609b533c
28 Jul, 2025 1 commit
- [Logs] Change flashinfer sampler logs to once (#21759) · 34a20c49
  Michael Goin authored Jul 28, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  34a20c49
25 Jul, 2025 1 commit
- [Bugfix][Logprobs] Fix logprobs op to support more backend (#21591) · f3a683b7
  Mengqing Cao authored Jul 25, 2025
```
Signed-off-by: MengqingCao <cmq0113@163.com>
```
  f3a683b7
21 Jul, 2025 1 commit
- [v1][sampler] Inplace logprobs comparison to get the token rank (#21283) · 8d0a01a5
  Lu Fang authored Jul 21, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  8d0a01a5
05 Jul, 2025 1 commit
- [v1] Re-add fp32 support to v1 engine through FlexAttention (#19754) · 32c9be22
  Isotr0py authored Jul 05, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  32c9be22
02 Jul, 2025 1 commit

[V1] LogitsProcessor programming model (#16728) · 48fb076c

afeldman-nm authored Jul 02, 2025


Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

48fb076c

03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
26 May, 2025 1 commit
- [V1][Sampler] Improve performance of FlashInfer sampling by sampling logits... · e7523c2e
  Lukas Geiger authored May 26, 2025
```
[V1][Sampler] Improve performance of FlashInfer sampling by sampling logits instead of probs (#18608)
```
  e7523c2e
16 May, 2025 1 commit
- [Sampler] Adapt to FlashInfer 0.2.3 sampler API (#15777) · 7fdfa015
  Bowen Wang authored May 16, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  7fdfa015
17 Apr, 2025 1 commit

[V1][TPU] Enable Top K (#15489) · eb5819b2

Nicolò Lucchesi authored Apr 17, 2025


Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Hyesoo Yang <hyeygit@gmail.com>
Co-authored-by: Hyesoo Yang <hyeygit@gmail.com>

eb5819b2

03 Apr, 2025 1 commit

[V1][TPU] TPU-optimized top-p implementation (avoids scattering). (#15736) · 1b84eff0

Hyesoo Yang authored Apr 02, 2025


Signed-off-by: Hyesoo Yang <hyeygit@gmail.com>
Co-authored-by: root <root@t1v-n-822696b7-w-0.us-central2-b.c.tpu-prod-env-large-adhoc.internal>

1b84eff0

02 Apr, 2025 1 commit
- [V1] Fix: make sure `k_index` is int64 for `apply_top_k_only` (#15907) · 6efb195a
  Brayden Zhong authored Apr 01, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  6efb195a
26 Mar, 2025 1 commit
- [V1][Sampler] Faster top-k only implementation (#15478) · 35fad35a
  Nick Hill authored Mar 26, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  35fad35a