Commits · a482e4e7696141cba45180d7463ddde691d512ae · OpenDAS / vllm_cscc

"tests/models/utils.py" did not exist on "df29793dc73a83f3c86c19de967adffda1a28a93"

21 Aug, 2025 22 commits
- Migrate MolmoImageInputs to TensorSchema (#22022) · a482e4e7
  Benji Beck authored Aug 21, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  a482e4e7
- [ci/build] Fix abi tag for aarch64 (#23329) · e0b056e4
  youkaichao authored Aug 21, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  e0b056e4
- [Multimodal] Always enable hashing mm data (#23308) · 79f05e44
  Roger Wang authored Aug 21, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  79f05e44
- [Bugfix] set system_message in phi4mini chat template (#23309) · f8daddcc
  jerryzhuang authored Aug 22, 2025
```
Signed-off-by: zhuangqh <zhuangqhc@gmail.com>
```
  f8daddcc
- [V1] Remove unnecessary check for main thread (#23298) · c8e33c72
  Robert Shaw authored Aug 21, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  c8e33c72
- [Performance] V1 Pooling Models E2E Performance Optimization (#23162) · d70a1662
  wang.yuqi authored Aug 21, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  d70a1662
- [Doc] Fix batch-level DP example (#23325) · 5cc54f7c
  Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  5cc54f7c
- [Refactor] Simplify code for MM budget (#23310) · 0c6e40bb
  Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0c6e40bb
- [Model] Add LFM2 architecture (#22845) · 2e2000f3
  Paul Pak authored Aug 21, 2025
```
Signed-off-by: Paul Pak <paulpak58@gmail.com>
```
  2e2000f3
- [BugFix] Fix Python 3.9 Support (#23306) · 31282401
  Jared O'Connell authored Aug 21, 2025
```
Signed-off-by: Jared O'Connell <46976761+jaredoconnell@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  31282401
- [Bugfix] Fix extra whitespace in strings caused by newline (#23272) · 0c31e28e
  Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0c31e28e
- [Sampler] Support returning final logprobs (#22387) · f571ff8e
  22quinn authored Aug 20, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  f571ff8e
- [CI] Block the cu126 wheel build while broken (#23285) · f64ee61d
  Michael Goin authored Aug 21, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f64ee61d
- [CI] Delete images older than 24h. (#23291) · 8993073d
  QiliangCui authored Aug 21, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  8993073d
- [Model][VLM] Support R-4B Model (#23246) · 655a09f6
  杨奇(yann qi) authored Aug 21, 2025
```
Signed-off-by: yannqi <yannqi@qq.com>
Signed-off-by: 杨奇(yann qi) <51905299+yannqi@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: yannqiyang <yannqiyang@tencent.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  655a09f6
- [Compile] Fix Compile Warning SM100 Cutlass MLA (#23287) · f94bf9b9
  Wentao Ye authored Aug 20, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  f94bf9b9
- [V1][Mamba1] - Full CUDA and Piecewise CUDA Graphs Support (#23035) · 3663870c
  Asaf Joseph Gardin authored Aug 21, 2025
```
Signed-off-by: asafg <asafg@ai21.com>
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
Co-authored-by: asafg <asafg@ai21.com>
```
  3663870c
- [CI/Build] Split out mm processor tests (#23260) · 2461d9e5
  Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2461d9e5
- [CPU] Refactor CPU W8A8 scaled_mm (#23071) · 7be5d113
  Li, Jiang authored Aug 21, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7be5d113
- [Optimization] Make new_block_ids None if empty (#23262) · b029de99
  Woosuk Kwon authored Aug 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  b029de99
- [CI Bugfix] Fix CI by fully removing --enable-prompt-adapter (#23284) · bbea1cef
  Michael Goin authored Aug 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  bbea1cef
- Remove duplicate entry in vllm.attention.__all__ (#23296) · f5aa307d
  Russell Bryant authored Aug 20, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  f5aa307d
20 Aug, 2025 18 commits
- [EP] Add logging for experts map (#22685) · 4b795020
  22quinn authored Aug 20, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  4b795020
- [Fix] remove is_marlin param in benchmark_moe (#23286) · c86af22f
  shixianc authored Aug 20, 2025
  
  c86af22f
- Feature/mla tests (#23195) · 10cc12ba
  Matthew Bonanni authored Aug 20, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  10cc12ba
- Remove chunked_prefill_enabled flag in V1 MLA (#23183) · a4fbb32f
  Matthew Bonanni authored Aug 20, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  a4fbb32f
- [misc] fix multiple arch wheels for the nightly index (#23110) · 1b125004
  youkaichao authored Aug 21, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  1b125004
- [Feature] use --eplb_config to set eplb param (#20562) · 4fbda0b2
  rongfu.leng authored Aug 21, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4fbda0b2
- Do not use eval() to convert unknown types (#23266) · 4e51fa8c
  Russell Bryant authored Aug 20, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  4e51fa8c
- [Perf] Speed up function `_convert_tokens_to_string_with_added_encoders` by 13.7x (#20413) · bf7c99df
  Saurabh Misra authored Aug 20, 2025
```
Signed-off-by: Saurabh Misra <misra.saurabh1@gmail.com>
Signed-off-by: Aseem Saxena <aseem.bits@gmail.com>
Co-authored-by: codeflash-ai[bot] <148906541+codeflash-ai[bot]@users.noreply.github.com>
Co-authored-by: Aseem Saxena <aseem.bits@gmail.com>
```
  bf7c99df
- [Frontend] improve error logging of chat completion (#22957) · b95697d7
  Chen Zhang authored Aug 20, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  b95697d7
- [Fix] correct tool_id for kimi-k2 when use tool_choice=required (#21259) · 582bbe6b
  bigmoyan authored Aug 21, 2025
```
Co-authored-by: wangzhengtao <wangzhengtao@msh.team>
```
  582bbe6b
- [Kernel/Quant] Remove the original marlin format and qqq (#23204) · 0cdbf5e6
  Michael Goin authored Aug 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0cdbf5e6
- Small fix for Command-A-Vision (#23268) · ebe56a00
  dongluw authored Aug 20, 2025
```
Signed-off-by: donglu <donglu@cohere.com>
```
  ebe56a00
- Limit HTTP header count and size (#23267) · f77a0802
  Russell Bryant authored Aug 20, 2025
```
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
```
  f77a0802
- Migrate Mistral3ImagePixelInputs to TensorSchema (#21945) · c4477f55
  Benji Beck authored Aug 20, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  c4477f55
- [torch.compile] Support conditional torch.compile per module (#22269) · dfd23820
  Yong Hoon Shin authored Aug 20, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  dfd23820
- [FIXBUG ] Allow disabling rocm_aiter_fa backend for ROCm GPUs not compatible with AITER (#22795) · 3b11b26b
  JartX authored Aug 20, 2025
```
Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  3b11b26b
- [Misc] Add max_seq_len to CommonAttentionMetadata (#23216) · d6d13bd4
  Woosuk Kwon authored Aug 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  d6d13bd4
- [CLI][Doc] Formalize `--mm-encoder-tp-mode` (#23190) · 5efd6905
  Cyrus Leung authored Aug 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5efd6905