Commits · 8896eb72ebe90be6f1b83f32b3d3d0c379db4f82 · OpenDAS / vllm_cscc · GitLab

22 Aug, 2025 3 commits
- [Deprecation] Remove `prompt_token_ids` arg fallback in `LLM.generate` and `LLM.embed` (#18800) · 8896eb72
  Cyrus Leung authored Aug 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8896eb72
- [Kernel] Add FP8 support with FlashMLA backend (#22668) · 19fe1a05
  Matthew Bonanni authored Aug 21, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  19fe1a05
- [Core] Support custom executor qualname (#23314) · 480bdf5a
  22quinn authored Aug 21, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  480bdf5a
21 Aug, 2025 37 commits
- [Feature][Responses API] Support logprobs(non-stream) (#23319) · 5368f768
  Kebe authored Aug 22, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  5368f768
- Always use cache mounts when installing vllm to avoid populating pip cache in... · 8ef6b8a3
  tvalentyn authored Aug 22, 2025
```
Always use cache mounts when installing vllm to avoid populating pip cache in the image. Also remove apt cache. (#23270)
Signed-off-by: Valentyn Tymofieiev <valentyn@google.com>
```
  8ef6b8a3
- [Perf] Small optimizations for silu_mul_fp8_quant_deep_gemm (#23265) · 3bbe11cc
  Michael Goin authored Aug 21, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  3bbe11cc
- [CI] improve pr comments bot (#23380) · c5041f89
  Simon Mo authored Aug 21, 2025
  
  c5041f89
- [CI] Clean up actions: remove helm, publish workflows and improve pr … (#23377) · 8b5fe6eb
  Simon Mo authored Aug 21, 2025
  
  8b5fe6eb
- [Structured Outputs] Refactor bitmask construction into get_grammar_bitmask (#23361) · 800349c2
  Woosuk Kwon authored Aug 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  800349c2
- Make sure that vectorize_with_alignment produced vectorized global loads (#23182) · 044931f9
  Elvir Crnčević authored Aug 21, 2025
  
  044931f9
- [Core] Always use tensor cores for Flashinfer Decode Wrapper (#23214) · 1d353b63
  Pavani Majety authored Aug 21, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  1d353b63
- [Misc] Convert VLLM_TORCH_PROFILER_DIR path to absolute (#23191) · 34962746
  Ning Xie authored Aug 22, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  34962746
- [BugFix][gpt-oss] Fix Chat Completion with Multiple Output Message (#23318) · 8a193031
  Chen Zhang authored Aug 21, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  8a193031
- [Misc] Misc code cleanup/simplification (#23304) · 603fbbbc
  Nick Hill authored Aug 21, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  603fbbbc
- [Bugfix] Fix port conflict by obtaining a list of open ports upfront (#21894) · 10f535c0
  Ming Yang authored Aug 21, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  10f535c0
- [Bug] Fix R1 Accuracy 0 Bug (#23294) · 48bfb0c9
  Wentao Ye authored Aug 21, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  48bfb0c9
- add tg-mxfp4-moe-test (#22540) · f8ce0229
  Lain authored Aug 21, 2025
```
Signed-off-by: siyuanf <siyuanf@nvidia.com>
Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  f8ce0229
- Fix nvfp4 swizzling (#23140) · 0278f1ac
  Yi Liu authored Aug 22, 2025
```
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  0278f1ac
- Migrate MolmoImageInputs to TensorSchema (#22022) · a482e4e7
  Benji Beck authored Aug 21, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  a482e4e7
- [ci/build] Fix abi tag for aarch64 (#23329) · e0b056e4
  youkaichao authored Aug 21, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  e0b056e4
- [Multimodal] Always enable hashing mm data (#23308) · 79f05e44
  Roger Wang authored Aug 21, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  79f05e44
- [Bugfix] set system_message in phi4mini chat template (#23309) · f8daddcc
  jerryzhuang authored Aug 22, 2025
```
Signed-off-by: zhuangqh <zhuangqhc@gmail.com>
```
  f8daddcc
- [V1] Remove unnecessary check for main thread (#23298) · c8e33c72
  Robert Shaw authored Aug 21, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  c8e33c72
- [Performance] V1 Pooling Models E2E Performance Optimization (#23162) · d70a1662
  wang.yuqi authored Aug 21, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  d70a1662
- [Doc] Fix batch-level DP example (#23325) · 5cc54f7c
  Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  5cc54f7c
- [Refactor] Simplify code for MM budget (#23310) · 0c6e40bb
  Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0c6e40bb
- [Model] Add LFM2 architecture (#22845) · 2e2000f3
  Paul Pak authored Aug 21, 2025
```
Signed-off-by: Paul Pak <paulpak58@gmail.com>
```
  2e2000f3
- [BugFix] Fix Python 3.9 Support (#23306) · 31282401
  Jared O'Connell authored Aug 21, 2025
```
Signed-off-by: Jared O'Connell <46976761+jaredoconnell@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  31282401
- [Bugfix] Fix extra whitespace in strings caused by newline (#23272) · 0c31e28e
  Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0c31e28e
- [Sampler] Support returning final logprobs (#22387) · f571ff8e
  22quinn authored Aug 20, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  f571ff8e
- [CI] Block the cu126 wheel build while broken (#23285) · f64ee61d
  Michael Goin authored Aug 21, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f64ee61d
- [CI] Delete images older than 24h. (#23291) · 8993073d
  QiliangCui authored Aug 21, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  8993073d
- [Model][VLM] Support R-4B Model (#23246) · 655a09f6
  杨奇(yann qi) authored Aug 21, 2025
```
Signed-off-by: yannqi <yannqi@qq.com>
Signed-off-by: 杨奇(yann qi) <51905299+yannqi@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: yannqiyang <yannqiyang@tencent.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  655a09f6
- [Compile] Fix Compile Warning SM100 Cutlass MLA (#23287) · f94bf9b9
  Wentao Ye authored Aug 20, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  f94bf9b9
- [V1][Mamba1] - Full CUDA and Piecewise CUDA Graphs Support (#23035) · 3663870c
  Asaf Joseph Gardin authored Aug 21, 2025
```
Signed-off-by: asafg <asafg@ai21.com>
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
Co-authored-by: asafg <asafg@ai21.com>
```
  3663870c
- [CI/Build] Split out mm processor tests (#23260) · 2461d9e5
  Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2461d9e5
- [CPU] Refactor CPU W8A8 scaled_mm (#23071) · 7be5d113
  Li, Jiang authored Aug 21, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7be5d113
- [Optimization] Make new_block_ids None if empty (#23262) · b029de99
  Woosuk Kwon authored Aug 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  b029de99
- [CI Bugfix] Fix CI by fully removing --enable-prompt-adapter (#23284) · bbea1cef
  Michael Goin authored Aug 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  bbea1cef
- Remove duplicate entry in vllm.attention.__all__ (#23296) · f5aa307d
  Russell Bryant authored Aug 20, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  f5aa307d