Commits · 504d91431499e302bbd5a3d8a1432cd427ec8d5d · OpenDAS / vllm_cscc · GitLab

24 Aug, 2025 2 commits
- [Misc] Remove unused slot_mapping buffer (#23502) · ad788684
  Woosuk Kwon authored Aug 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  ad788684
- [New Model]Donut model (#23229) · 416f0592
  汪志鹏 authored Aug 24, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  416f0592
23 Aug, 2025 2 commits
- [BugFix] Fix `MinPLogitsProcessor.update_states()` (#23401) · add1adfe
  Nick Hill authored Aug 22, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  add1adfe
- [BugFix] Fix batch updates for pooling models (#23398) · c80c53a3
  Nick Hill authored Aug 22, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c80c53a3
22 Aug, 2025 8 commits
- [NVIDIA][torch.compile] Support Flashinfer TRTLLM FP8-q/kv NVFP4-out Attention Kernel (#22703) · 24d0c9e6
  elvischenv authored Aug 23, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  24d0c9e6
- [Doc]: fix various typos in multiple files (#23179) · 22cf679a
  Didier Durand authored Aug 22, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  22cf679a
- [Misc] local import code clean (#23420) · 325aa3de
  Ning Xie authored Aug 22, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  325aa3de
- [Attention] Allow V1 flash_attn to support cross-attention (#23297) · 281710ef
  Russell Bryant authored Aug 22, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  281710ef
- [Misc] Move M-RoPE init logic to _init_mrope_positions (#23422) · 808d2e9a
  Woosuk Kwon authored Aug 22, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  808d2e9a
- [Attention] Refactor AttentionMetadata Preparation for Encoder-only Models (#23154) · 17373dcd
  Chen Zhang authored Aug 21, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  17373dcd
- [Kernel] Add FP8 support with FlashMLA backend (#22668) · 19fe1a05
  Matthew Bonanni authored Aug 21, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  19fe1a05
- [Core] Support custom executor qualname (#23314) · 480bdf5a
  22quinn authored Aug 21, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  480bdf5a
21 Aug, 2025 11 commits
- [Structured Outputs] Refactor bitmask construction into get_grammar_bitmask (#23361) · 800349c2
  Woosuk Kwon authored Aug 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  800349c2
- [Core] Always use tensor cores for Flashinfer Decode Wrapper (#23214) · 1d353b63
  Pavani Majety authored Aug 21, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  1d353b63
- [Misc] Misc code cleanup/simplification (#23304) · 603fbbbc
  Nick Hill authored Aug 21, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  603fbbbc
- [Bugfix] Fix port conflict by obtaining a list of open ports upfront (#21894) · 10f535c0
  Ming Yang authored Aug 21, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  10f535c0
- [Multimodal] Always enable hashing mm data (#23308) · 79f05e44
  Roger Wang authored Aug 21, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  79f05e44
- [Performance] V1 Pooling Models E2E Performance Optimization (#23162) · d70a1662
  wang.yuqi authored Aug 21, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  d70a1662
- [Refactor] Simplify code for MM budget (#23310) · 0c6e40bb
  Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0c6e40bb
- [Model] Add LFM2 architecture (#22845) · 2e2000f3
  Paul Pak authored Aug 21, 2025
```
Signed-off-by: Paul Pak <paulpak58@gmail.com>
```
  2e2000f3
- [Sampler] Support returning final logprobs (#22387) · f571ff8e
  22quinn authored Aug 20, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  f571ff8e
- [V1][Mamba1] - Full CUDA and Piecewise CUDA Graphs Support (#23035) · 3663870c
  Asaf Joseph Gardin authored Aug 21, 2025
```
Signed-off-by: asafg <asafg@ai21.com>
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
Co-authored-by: asafg <asafg@ai21.com>
```
  3663870c
- [Optimization] Make new_block_ids None if empty (#23262) · b029de99
  Woosuk Kwon authored Aug 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  b029de99
20 Aug, 2025 11 commits
- Feature/mla tests (#23195) · 10cc12ba
  Matthew Bonanni authored Aug 20, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  10cc12ba
- Remove chunked_prefill_enabled flag in V1 MLA (#23183) · a4fbb32f
  Matthew Bonanni authored Aug 20, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  a4fbb32f
- [Feature] use --eplb_config to set eplb param (#20562) · 4fbda0b2
  rongfu.leng authored Aug 21, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4fbda0b2
- [FIXBUG ] Allow disabling rocm_aiter_fa backend for ROCm GPUs not compatible with AITER (#22795) · 3b11b26b
  JartX authored Aug 20, 2025
```
Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  3b11b26b
- [Misc] Add max_seq_len to CommonAttentionMetadata (#23216) · d6d13bd4
  Woosuk Kwon authored Aug 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  d6d13bd4
- [Model][V1] Support Ernie MTP (#22169) · 7cd17e22
  xyxinyang authored Aug 20, 2025
```
Signed-off-by: zhouchong <zhouchong03@baidu.com>
Co-authored-by: zhouchong <zhouchong03@baidu.com>
```
  7cd17e22
- fix cuda graph (#22721) · d983769c
  who who who authored Aug 20, 2025
```
Signed-off-by: fsx950223 <fsx950223@outlook.com>
```
  d983769c
- [BugFix] Fix stuck stats/metrics after requests are aborted (#22995) · 8fd92092
  Nick Hill authored Aug 19, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8fd92092
- [Attention] Optimize make_local_attention_virtual_batches for Flash Attention (#23185) · a634733f
  Zebing Lin authored Aug 19, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
  a634733f
- [Core] Add torch profiler CPU traces for AsyncLLM. (#21794) · e58c5a97
  Chenheli Hua authored Aug 19, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  e58c5a97
- [Core] Optimize scheduler request removal for single completions (#21917) · 0167efe2
  633WHU authored Aug 20, 2025
```
Signed-off-by: chiliu <chiliu@paypal.com>
Signed-off-by: chiliu <cliu_whu@yeah.net>
Co-authored-by: chiliu <chiliu@paypal.com>
```
  0167efe2
19 Aug, 2025 6 commits
- [BugFix] fix CUTLASS MLA full cudagraph (#23200) · 14e2b073
  Lucas Wilkinson authored Aug 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  14e2b073
- [Misc] Minor refactoring for FlashInfer backend (#23147) · e61bac87
  Woosuk Kwon authored Aug 19, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e61bac87
- [Misc] Enable yapf for FlashInfer backend (#23193) · 5b5f350d
  Woosuk Kwon authored Aug 19, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  5b5f350d
- [NVIDIA] Support Flashinfer TRTLLM FP8-q/kv/out Attention Kernel (#21716) · 03752dba
  elvischenv authored Aug 19, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  03752dba
- [Misc] Fix seq_lens for graph capture (#23175) · 40f26734
  Woosuk Kwon authored Aug 19, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  40f26734
- [Misc] Avoid accessing req_ids inside a loop (#23159) · 21bcc826
  Woosuk Kwon authored Aug 19, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  21bcc826