Commits · 913249f9078076ff2f11f38ce09f80b5d08de68c · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "0c63c34f725f0b519fa094fbeca6e3cf12c911c1"

26 Sep, 2025 1 commit
- [fix] pp+mtp bs 1 correctness · df49168d
  zhuwenwen authored Sep 26, 2025
  
  df49168d
24 Sep, 2025 1 commit
- fix scheduler issu in pp + mtp · ad477f82
  zhuwenwen authored Sep 24, 2025
  
  ad477f82
18 Sep, 2025 1 commit
- [Model] Add LongCat-Flash · 50281e36
  zhuwenwen authored Sep 18, 2025
  
  50281e36
11 Sep, 2025 5 commits
- fix some typos (#24616) · e26fef83
  co63oc authored Sep 12, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  e26fef83
- Allow users to specify kv cache memory size (#21489) · 94e6b2d5
  Boyuan Feng authored Sep 11, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  94e6b2d5
- Move `LoRAConfig` from `config/__init__.py` to `config/lora.py` (#24644) · 5f5271f1
  Harry Mellor authored Sep 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5f5271f1
- Add the support for the qwen3 next model (a hybrid attention model). (#24526) · e93f4cc9
  Tao He authored Sep 11, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  e93f4cc9
- [BugFix] Fix pipeline parallel (#24621) · e2d8c27f
  Nick Hill authored Sep 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  e2d8c27f
10 Sep, 2025 5 commits

[Perf] Warmup FlashInfer attention during startup (#23439) · fba78565

Michael Goin authored Sep 10, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni001@gmail.com>

fba78565

[v1] Add Whisper model support (encoder-decoder) (#21088) · 37e8182b
Russell Bryant authored Sep 10, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
```
37e8182b
[BugFix] Ensure integrity of reused CPU tensors during async scheduling (#24527) · f4f1a8df
Nick Hill authored Sep 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: guoze.lin <guozelin@tencent.com>
```
f4f1a8df

[Attention] add DCP support for FLASH_ATTN_MLA backend (#24453) · 0ae43dbf

Lucas Wilkinson authored Sep 10, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

0ae43dbf

[Bugfix] Guard `_may_reorder_batch` for encoder-only models on CPU (#24319) (#24348) · feaf202e
Remy authored Sep 10, 2025
```
Signed-off-by: Remy <eunhwan.shin@dtonic.io>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
feaf202e

09 Sep, 2025 2 commits
- [TPU] Fix tpu structured decoding in mixed batches (#24458) · c3f9773b
  Chenyaaang authored Sep 09, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  c3f9773b
- [Core] Run garbage collector after CUDA graph capture to fix throughput regression (#24128) · 1c63a16b
  Micah Williamson authored Sep 09, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  1c63a16b
08 Sep, 2025 3 commits
- [Doc]: fix typos in Python comments (#24417) · f4962a6d
  Didier Durand authored Sep 08, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  f4962a6d
- [P/D] Add a shutdown method to the Connector API (#22699) · 61aa4b29
  Chauncey authored Sep 08, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  61aa4b29
- [Sampler] Support returning all prompt logprobs (#23868) · b3d7e3c8
  Xingyu Liu authored Sep 07, 2025
```
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  b3d7e3c8
07 Sep, 2025 3 commits
- Skip MM Encoder for non-first PP ranks (#24387) · 2e5d2137
  Woosuk Kwon authored Sep 07, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2e5d2137
- fix precision issue in mtp · 9ebe3034
  zhuwenwen authored Sep 07, 2025
  
  9ebe3034
- [attention][DCP] use AttentionImpl.need_to_return_lse_for_decode (#24372) · 558f0907
  youkaichao authored Sep 07, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  558f0907
06 Sep, 2025 7 commits
- break execute_model in gpu_model_runner into sub-functions for custom scopes (#24265) · 848562bd
  Bangsheng Tang authored Sep 06, 2025
```
Co-authored-by: Bangsheng Tang <bangsheng@meta.com>
```
  848562bd
- refactor: Turn GPUModelRunner.inputs_embeds to a CpuGpuBuffer (#24345) · 305a1cc0
  Andrew Sansom authored Sep 06, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  305a1cc0
- [Feature] Support Decode Context Parallel (DCP) for MLA (#23734) · ac201a0e
  yzds authored Sep 06, 2025
```
Signed-off-by: hongchao <hongchao@msh.team>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: hongchao <hongchao@msh.team>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  ac201a0e
- [Doc]: fix typos in Python comments (#24294) · 35bf1938
  Didier Durand authored Sep 06, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  35bf1938
- [Perf][V1] Fully overlap model execution (#23569) · cee182b2
  Benjamin Chislett authored Sep 05, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
  cee182b2
- fix performance issues caused by enabling TBO · 5692ab61
  zhuwenwen authored Sep 06, 2025
  
  5692ab61
- 暂时去掉profilling标志位，避免影响其他模型 · f42ed372
  zhuwenwen authored Sep 06, 2025
  
  f42ed372
05 Sep, 2025 1 commit

[XPU][P/D] Add XPU support in NixlConnector (#22436) · e599e2c6

liuzhenwei authored Sep 05, 2025


Signed-off-by: zhenwei <zhenwei.liu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

e599e2c6

03 Sep, 2025 6 commits
- [Kernels] Overlap shared experts with send/recv (#23273) · e9b92dcd
  bnellnm authored Sep 03, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  e9b92dcd
- fix deepseek pp + mtp issue · bfd0c5b8
  zhuwenwen authored Sep 03, 2025
  
  bfd0c5b8
- [Doc]: fix typos in Python comments (#24115) · 02d411fd
  Didier Durand authored Sep 03, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  02d411fd
- [Doc]: fix typos in Python comments (#24093) · d7e1e599
  Didier Durand authored Sep 03, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  d7e1e599
- fix some typos (#24071) · 1bd007f2
  co63oc authored Sep 03, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  1bd007f2
- Upgrade xgrammar to 0.1.23 (#22988) · e32a0e86
  Russell Bryant authored Sep 02, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  e32a0e86
02 Sep, 2025 2 commits
- [Log] Only Print Profiler Results on Rank 0 (#23370) · 98aee612
  Wentao Ye authored Sep 02, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  98aee612
- Remove runtime checks based on pooling params (#24051) · d59c9864
  Maximilien de Bayser authored Sep 02, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  d59c9864
01 Sep, 2025 3 commits
- [Misc] refactor code by import as for torch._inductor.config (#23677) · 499b074b
  Ning Xie authored Sep 01, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  499b074b
- [Misc] Move fast prefill logic to separate method (#24013) · b5571368
  Woosuk Kwon authored Aug 31, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b5571368
- [Misc] Avoid redundant copy for encoder-only models (#24012) · 8c742a66
  Woosuk Kwon authored Aug 31, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  8c742a66