Commits · a99300bda69edba0082a9038143ecd66de4d078b · OpenDAS / vllm_cscc · GitLab

28 Aug, 2025 2 commits
- [bugfix] [spec-decoding] fix data race in sample_recovered_tokens_kernel (vLLM v1) (#23829) · 57d4ede5
  Jingkai He authored Aug 29, 2025
```
Signed-off-by: He-Jingkai <he-jingkai@outlook.com>
```
  57d4ede5
- [BugFix][Spec Decode] Use float64 for uniform_probs (#23803) · a3432f18
  Woosuk Kwon authored Aug 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  a3432f18
27 Aug, 2025 2 commits
- [Docs] Fix warnings in `mkdocs build` (continued) (#23743) · 4e4d017b
  Hyogeun Oh (오효근) authored Aug 28, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
Signed-off-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
```
  4e4d017b
- [LogitsProcs] Deduplicate built-in LP implementation logic (#23362) · 3ce8285d
  Nick Hill authored Aug 27, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  3ce8285d
23 Aug, 2025 2 commits
- [BugFix] Fix `MinPLogitsProcessor.update_states()` (#23401) · add1adfe
  Nick Hill authored Aug 22, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  add1adfe
- [BugFix] Fix batch updates for pooling models (#23398) · c80c53a3
  Nick Hill authored Aug 22, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c80c53a3
21 Aug, 2025 2 commits

[Misc] Misc code cleanup/simplification (#23304) · 603fbbbc
Nick Hill authored Aug 21, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
603fbbbc

[Sampler] Support returning final logprobs (#22387) · f571ff8e

22quinn authored Aug 20, 2025


Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

f571ff8e

16 Aug, 2025 1 commit

[V1] Logits processors extensibility (#19912) · bf7f470b

afeldman-nm authored Aug 16, 2025


Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Signed-off-by: Andrew Feldman <afeld2012@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Andrew Feldman <afeld2012@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

bf7f470b

07 Aug, 2025 2 commits
- [feat]支持mtp模型full_cuda_graph · f2218895
  zhuwenwen authored Aug 07, 2025
  
  f2218895
- [Bugfix] Add proper comparison for package versions (#22314) · 609b533c
  Syed Muhammad Bin Asif authored Aug 07, 2025
```
Signed-off-by: Syed Muhammad Bin Asif <syedmba7@connect.hku.hk>
```
  609b533c
06 Aug, 2025 2 commits
- Revert "Revert "[feat]1.支持mtp模型 full_cuda_graph; 2.优化mtp拒绝采样"" · 467490e6
  zhuwenwen authored Aug 06, 2025
```
This reverts commit 33485749.
```
  467490e6
- Revert "[feat]1.支持mtp模型 full_cuda_graph; 2.优化mtp拒绝采样" · 33485749
  zhuwenwen authored Aug 06, 2025
```
This reverts commit 93fae6b1.
```
  33485749
05 Aug, 2025 1 commit
- [feat]1.支持mtp模型 full_cuda_graph; 2.优化mtp拒绝采样 · 93fae6b1
  zhuwenwen authored Aug 05, 2025
  
  93fae6b1
28 Jul, 2025 1 commit
- [Logs] Change flashinfer sampler logs to once (#21759) · 34a20c49
  Michael Goin authored Jul 28, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  34a20c49
25 Jul, 2025 1 commit
- [Bugfix][Logprobs] Fix logprobs op to support more backend (#21591) · f3a683b7
  Mengqing Cao authored Jul 25, 2025
```
Signed-off-by: MengqingCao <cmq0113@163.com>
```
  f3a683b7
23 Jul, 2025 1 commit
- [Sampler] Introduce logprobs mode for logging (#21398) · accac829
  Lu Fang authored Jul 23, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  accac829
22 Jul, 2025 1 commit
- [Core] Optimize update checks in LogitsProcessor (#21245) · a3223766
  Jialin Ouyang authored Jul 22, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  a3223766
21 Jul, 2025 1 commit
- [v1][sampler] Inplace logprobs comparison to get the token rank (#21283) · 8d0a01a5
  Lu Fang authored Jul 21, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  8d0a01a5
12 Jul, 2025 1 commit
- Remove extra tensor on CPU (#20693) · 5de8d9f1
  Maximilien de Bayser authored Jul 12, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  5de8d9f1
05 Jul, 2025 1 commit
- [v1] Re-add fp32 support to v1 engine through FlexAttention (#19754) · 32c9be22
  Isotr0py authored Jul 05, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  32c9be22
04 Jul, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
02 Jul, 2025 1 commit

[V1] LogitsProcessor programming model (#16728) · 48fb076c

afeldman-nm authored Jul 02, 2025


Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

48fb076c

18 Jun, 2025 1 commit
- [V1] Decouple GPU and TPU `InputBatch` (#19778) · 19a53b27
  afeldman-nm authored Jun 18, 2025
```
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
```
  19a53b27
06 Jun, 2025 1 commit
- improve logits bias (#19041) · 8267f991
  Yu Guo authored Jun 06, 2025
  
  8267f991
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
26 May, 2025 1 commit
- [V1][Sampler] Improve performance of FlashInfer sampling by sampling logits... · e7523c2e
  Lukas Geiger authored May 26, 2025
```
[V1][Sampler] Improve performance of FlashInfer sampling by sampling logits instead of probs (#18608)
```
  e7523c2e
16 May, 2025 1 commit
- [Sampler] Adapt to FlashInfer 0.2.3 sampler API (#15777) · 7fdfa015
  Bowen Wang authored May 16, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  7fdfa015
06 May, 2025 1 commit
- [Bugfix] Fix triton import with local TritonPlaceholder (#17446) · f9bc5a06
  Mengqing Cao authored May 06, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  f9bc5a06
05 May, 2025 1 commit
- [TPU][V1] Add support for top-logprobs (#17072) · 5941e0b7
  Nicolò Lucchesi authored May 05, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  5941e0b7
04 May, 2025 1 commit
- Add full API docs and improve the UX of navigating them (#17485) · d6484ef3
  Harry Mellor authored May 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6484ef3
23 Apr, 2025 1 commit
- [V1][Spec Decode] Always use argmax for sampling draft tokens (#16899) · 41fb013d
  Woosuk Kwon authored Apr 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  41fb013d
22 Apr, 2025 1 commit

[TPU][V1] Enable Top-P (#16843) · fa3bba2a

Nicolò Lucchesi authored Apr 22, 2025


Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

fa3bba2a

17 Apr, 2025 1 commit

[V1][TPU] Enable Top K (#15489) · eb5819b2

Nicolò Lucchesi authored Apr 17, 2025


Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Hyesoo Yang <hyeygit@gmail.com>
Co-authored-by: Hyesoo Yang <hyeygit@gmail.com>

eb5819b2

12 Apr, 2025 1 commit
- [Bugfix] Validate logit biases to prevent out of vocab ids crashing engine (#16529) · 6c11ecf8
  Ryan McConville authored Apr 12, 2025
```
Signed-off-by: Ryan McConville <ryan@ryanmcconville.com>
```
  6c11ecf8
10 Apr, 2025 2 commits
- [TPU][V1] Disable per-request seed/Generator (#16172) · 3cc9af88
  Nicolò Lucchesi authored Apr 10, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  3cc9af88
- [TPU][V1] Refine tpu_model_runner to mitigate future recompilation issues (#16275) · a4547485
  Chengji Yao authored Apr 09, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  a4547485
03 Apr, 2025 1 commit

[V1][TPU] TPU-optimized top-p implementation (avoids scattering). (#15736) · 1b84eff0

Hyesoo Yang authored Apr 02, 2025


Signed-off-by: Hyesoo Yang <hyeygit@gmail.com>
Co-authored-by: root <root@t1v-n-822696b7-w-0.us-central2-b.c.tpu-prod-env-large-adhoc.internal>

1b84eff0

02 Apr, 2025 1 commit
- [V1] Fix: make sure `k_index` is int64 for `apply_top_k_only` (#15907) · 6efb195a
  Brayden Zhong authored Apr 01, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  6efb195a
29 Mar, 2025 1 commit
- [V1][Minor] Simplify rejection sampler's parse_output (#15741) · 2bc4be4e
  Woosuk Kwon authored Mar 29, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2bc4be4e