Commits · 044931f97b39975cce6dbef3df94586d83893758 · OpenDAS / vllm_cscc

21 Aug, 2025 31 commits
- Make sure that vectorize_with_alignment produced vectorized global loads (#23182) · 044931f9
  Elvir Crnčević authored Aug 21, 2025
  
  044931f9
- [Core] Always use tensor cores for Flashinfer Decode Wrapper (#23214) · 1d353b63
  Pavani Majety authored Aug 21, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  1d353b63
- [Misc] Convert VLLM_TORCH_PROFILER_DIR path to absolute (#23191) · 34962746
  Ning Xie authored Aug 22, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  34962746
- [BugFix][gpt-oss] Fix Chat Completion with Multiple Output Message (#23318) · 8a193031
  Chen Zhang authored Aug 21, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  8a193031
- [Misc] Misc code cleanup/simplification (#23304) · 603fbbbc
  Nick Hill authored Aug 21, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  603fbbbc
- [Bugfix] Fix port conflict by obtaining a list of open ports upfront (#21894) · 10f535c0
  Ming Yang authored Aug 21, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  10f535c0
- [Bug] Fix R1 Accuracy 0 Bug (#23294) · 48bfb0c9
  Wentao Ye authored Aug 21, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  48bfb0c9
- add tg-mxfp4-moe-test (#22540) · f8ce0229
  Lain authored Aug 21, 2025
```
Signed-off-by: siyuanf <siyuanf@nvidia.com>
Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  f8ce0229
- Fix nvfp4 swizzling (#23140) · 0278f1ac
  Yi Liu authored Aug 22, 2025
```
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  0278f1ac
- Migrate MolmoImageInputs to TensorSchema (#22022) · a482e4e7
  Benji Beck authored Aug 21, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  a482e4e7
- [ci/build] Fix abi tag for aarch64 (#23329) · e0b056e4
  youkaichao authored Aug 21, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  e0b056e4
- [Multimodal] Always enable hashing mm data (#23308) · 79f05e44
  Roger Wang authored Aug 21, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  79f05e44
- [Bugfix] set system_message in phi4mini chat template (#23309) · f8daddcc
  jerryzhuang authored Aug 22, 2025
```
Signed-off-by: zhuangqh <zhuangqhc@gmail.com>
```
  f8daddcc
- [V1] Remove unnecessary check for main thread (#23298) · c8e33c72
  Robert Shaw authored Aug 21, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  c8e33c72
- [Performance] V1 Pooling Models E2E Performance Optimization (#23162) · d70a1662
  wang.yuqi authored Aug 21, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  d70a1662
- [Doc] Fix batch-level DP example (#23325) · 5cc54f7c
  Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  5cc54f7c
- [Refactor] Simplify code for MM budget (#23310) · 0c6e40bb
  Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0c6e40bb
- [Model] Add LFM2 architecture (#22845) · 2e2000f3
  Paul Pak authored Aug 21, 2025
```
Signed-off-by: Paul Pak <paulpak58@gmail.com>
```
  2e2000f3
- [BugFix] Fix Python 3.9 Support (#23306) · 31282401
  Jared O'Connell authored Aug 21, 2025
```
Signed-off-by: Jared O'Connell <46976761+jaredoconnell@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  31282401
- [Bugfix] Fix extra whitespace in strings caused by newline (#23272) · 0c31e28e
  Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0c31e28e
- [Sampler] Support returning final logprobs (#22387) · f571ff8e
  22quinn authored Aug 20, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  f571ff8e
- [CI] Block the cu126 wheel build while broken (#23285) · f64ee61d
  Michael Goin authored Aug 21, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f64ee61d
- [CI] Delete images older than 24h. (#23291) · 8993073d
  QiliangCui authored Aug 21, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  8993073d
- [Model][VLM] Support R-4B Model (#23246) · 655a09f6
  杨奇(yann qi) authored Aug 21, 2025
```
Signed-off-by: yannqi <yannqi@qq.com>
Signed-off-by: 杨奇(yann qi) <51905299+yannqi@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: yannqiyang <yannqiyang@tencent.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  655a09f6
- [Compile] Fix Compile Warning SM100 Cutlass MLA (#23287) · f94bf9b9
  Wentao Ye authored Aug 20, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  f94bf9b9
- [V1][Mamba1] - Full CUDA and Piecewise CUDA Graphs Support (#23035) · 3663870c
  Asaf Joseph Gardin authored Aug 21, 2025
```
Signed-off-by: asafg <asafg@ai21.com>
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
Co-authored-by: asafg <asafg@ai21.com>
```
  3663870c
- [CI/Build] Split out mm processor tests (#23260) · 2461d9e5
  Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2461d9e5
- [CPU] Refactor CPU W8A8 scaled_mm (#23071) · 7be5d113
  Li, Jiang authored Aug 21, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7be5d113
- [Optimization] Make new_block_ids None if empty (#23262) · b029de99
  Woosuk Kwon authored Aug 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  b029de99
- [CI Bugfix] Fix CI by fully removing --enable-prompt-adapter (#23284) · bbea1cef
  Michael Goin authored Aug 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  bbea1cef
- Remove duplicate entry in vllm.attention.__all__ (#23296) · f5aa307d
  Russell Bryant authored Aug 20, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  f5aa307d
20 Aug, 2025 9 commits

[EP] Add logging for experts map (#22685) · 4b795020

22quinn authored Aug 20, 2025


Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

4b795020

[Fix] remove is_marlin param in benchmark_moe (#23286) · c86af22f
shixianc authored Aug 20, 2025

c86af22f

Feature/mla tests (#23195) · 10cc12ba

Matthew Bonanni authored Aug 20, 2025


Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>

10cc12ba

Remove chunked_prefill_enabled flag in V1 MLA (#23183) · a4fbb32f
Matthew Bonanni authored Aug 20, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
a4fbb32f
[misc] fix multiple arch wheels for the nightly index (#23110) · 1b125004
youkaichao authored Aug 21, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
1b125004

[Feature] use --eplb_config to set eplb param (#20562) · 4fbda0b2

rongfu.leng authored Aug 21, 2025


Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

4fbda0b2

Do not use eval() to convert unknown types (#23266) · 4e51fa8c
Russell Bryant authored Aug 20, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
4e51fa8c

[Perf] Speed up function `_convert_tokens_to_string_with_added_encoders` by 13.7x (#20413) · bf7c99df

Saurabh Misra authored Aug 20, 2025

Signed-off-by: Saurabh Misra <misra.saurabh1@gmail.com>
Signed-off-by: Aseem Saxena <aseem.bits@gmail.com>
Co-authored-by: codeflash-ai[bot] <148906541+codeflash-ai[bot]@users.noreply.github.com>
Co-authored-by: Aseem Saxena <aseem.bits@gmail.com>

bf7c99df

[Frontend] improve error logging of chat completion (#22957) · b95697d7
Chen Zhang authored Aug 20, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
b95697d7