Commits · eb08487b18f4be3cc8dbe6776c2d69d223b3737c · OpenDAS / vllm_cscc · GitLab

14 Aug, 2025 3 commits
- [BugFix] Threadsafe close async zmq sockets (#22877) · eb08487b
  Nick Hill authored Aug 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  eb08487b
- [Bugfix] Fix `PixtralHFImagePixelInputs` dynamic shape check (#22827) · 7c3a0741
  Isotr0py authored Aug 14, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  7c3a0741
- [CI] Fix `tests/distributed/test_ca_buffer_sharing.py` (#22849) · 1d20c347
  Ilya Markov authored Aug 14, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  1d20c347
13 Aug, 2025 26 commits
- [Core] [N-gram SD Optimization][1/n] Propose tokens with a single KMP (#22437) · 31a500c8
  Jialin Ouyang authored Aug 13, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  31a500c8
- [CI/Build] Update VLM common tests (#22841) · c9232d41
  Cyrus Leung authored Aug 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c9232d41
- [Bugfix] Fix MiniCPMV Image input inference failed (#22813) · 9bd9294f
  HWH authored Aug 14, 2025
```
Signed-off-by: HWH <67449739+jio-H@users.noreply.github.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  9bd9294f
- [Misc] clear and separate error messages for input too long and input +... · da270519
  Roger Wang authored Aug 13, 2025
```
[Misc] clear and separate error messages for input too long and input + max-tokens too long (#22803)
Signed-off-by: Roger Wang <hey@rogerw.me>
```
  da270519
- [Core] Use individual MM items in P0/P1 cache and model runner (#22570) · 19b927e5
  Cyrus Leung authored Aug 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  19b927e5
- [Frontend] Multithreaded async multimodal load_bytes (#22710) · 20d65aa7
  milesial authored Aug 13, 2025
```
Signed-off-by: Alexandre Milesi <30204471+milesial@users.noreply.github.com>
Co-authored-by: Alexandre Milesi <30204471+milesial@users.noreply.github.com>
```
  20d65aa7
- Fix GGUF loader for Qwen3 MoE. (#22785) · b159c0a6
  Gh0u1L5 authored Aug 13, 2025
```
Signed-off-by: Gh0u1L5 <Gh0u1L5@outlook.com>
```
  b159c0a6
- Remove unnecessary CUDA sync of qwen image and video preprocess (#22792) · 6772bb0f
  Yuanyuan Chen authored Aug 13, 2025
```
Signed-off-by: cyy <cyyever@outlook.com>
Signed-off-by: Yuanyuan Chen <cyyever@outlook.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  6772bb0f
- [Bugfix][mamba] Fix type annotation of Mamba2Metadata (#22787) · fceafaf5
  Chen Zhang authored Aug 13, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  fceafaf5
- [FEATURE] support custom vllm tuned config path for fused moe triton kernels (#22791) · 98deac38
  Chi Zhang authored Aug 13, 2025
```
Signed-off-by: Chi Zhang <zhangchi.usc1992@bytedance.com>
```
  98deac38
- [Frontend] Add chunked processing to handle long inputs in embedding models (#22280) · 653124bd
  Kdump authored Aug 13, 2025
```
Signed-off-by: x22x22 <wadeking@qq.com>
Signed-off-by: Kdump <rootshellexp@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Maximilien de Bayser <maxdebayser@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  653124bd
- [Platform] Custom ops support for FusedMoe (#22509) · 0b1bdac6
  wangxiyuan authored Aug 13, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  0b1bdac6
- [V1] Add tree drafting tests for eagle spec decoding (#22705) · d94e3026
  Giancarlo Delfin authored Aug 13, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
```
  d94e3026
- [Bugfix] Fix Nemotron VL image processing (#22739) · a01e0018
  Duc-Viet Hoang authored Aug 13, 2025
```
Co-authored-by: ducviet00-h2 <viet.d.hoang@h2corporation.jp>
```
  a01e0018
- [Model] Add missing prefix to glm4_1v (#22716) · 9e7e5baa
  Yuxuan Zhang authored Aug 13, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  9e7e5baa
- [Model] Add option to run Step3VisionEncoder in DP (#22697) · d16aa3da
  zzh142857 authored Aug 13, 2025
```
Signed-off-by: zzh142857 <chaorenzhaozhenghao@gmail.com>
```
  d16aa3da
- [gpt-oss] upgrade gpt-oss to v0.0.3 and add version check (#22768) · 6807af8f
  Chen Zhang authored Aug 12, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  6807af8f
- [Bug] Fix Unexpected Keyword Argument 'w1_bias' (#22757) · 77a6bf07
  Wentao Ye authored Aug 13, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  77a6bf07
- Remove unneeded ROCm platform import when using CUDA (#22765) · 4082338a
  Michael Goin authored Aug 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4082338a
- Force TRTLLM attention for gpt-oss on SM100 (#22678) · c6b92879
  Michael Goin authored Aug 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  c6b92879
- [Bugfix] Fix default enable for CUTLASS MLA on SM100 (#22738) · b1361c72
  Michael Goin authored Aug 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b1361c72
- Fix cuda illegal mem access with Llama4 TP8 + rms_norm custom op (#22701) · 4f0f844b
  Po-Han Huang (NVIDIA) authored Aug 13, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
```
  4f0f844b
- [V0 Deprecation] Remove args for multi-step scheduling (#22779) · c5830381
  Woosuk Kwon authored Aug 12, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  c5830381
- [V0 Deprecation] Remove multi-step scheduling (#22138) · 71683ca6
  Woosuk Kwon authored Aug 12, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  71683ca6
- [Model] Decouple glm4v (#22751) · fde0b611
  Jee Jee Li authored Aug 13, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  fde0b611
- Fix Transformers backend tensor parallel for multimodal models (#22673) · d0a63015
  Harry Mellor authored Aug 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d0a63015
12 Aug, 2025 11 commits
- Fix torch version check for SM100 mxfp4 (#22535) · 6534d2fc
  zifeitong authored Aug 12, 2025
```
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  6534d2fc
- [CI][Nixl] Check kv cache layout during handshake (#22745) · 422f22e0
  Nicolò Lucchesi authored Aug 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  422f22e0
- [Kernel][AMD] Avoid D2H copy and cumsum kernel (#22683) · 6bd8ebf0
  Xiaozhu Meng authored Aug 12, 2025
```
Signed-off-by: Xiaozhu <mxz297@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  6bd8ebf0
- Add: `SupportsEagle3` interface for explicit EAGLE3 support (#22642) · 5a4b4b37
  Rahul Tuli authored Aug 12, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
  5a4b4b37
- Fix Llama4 FlashInfer FP4 MoE issues (#22511) · 67c153b8
  Po-Han Huang (NVIDIA) authored Aug 12, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
```
  67c153b8
- [CI Failure] fix tests/entrypoints/openai/test_skip_tokenizer.py (#22708) · f7ad6a1e
  wang.yuqi authored Aug 12, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  f7ad6a1e
- Officially support SmolLM3 using the Transformers backend (#22665) · 80bb1e8a
  Harry Mellor authored Aug 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  80bb1e8a
- [BugFix][Nixl][PD] Fix heterogenous TP (#22663) · d030b015
  Nicolò Lucchesi authored Aug 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  d030b015
- [gpt-oss] Enable gpt-oss on ampere (#22714) · 007dd908
  Yongye Zhu authored Aug 12, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  007dd908
- [Bugfix] Mamba2 SSD varlen bug fix initstates decay, improve test, assert chunk pwr 2 (#21783) · 46ae7f66
  RishiAstra authored Aug 12, 2025
```
Signed-off-by: Rishi Astra <40644327+RishiAstra@users.noreply.github.com>
```
  46ae7f66
- Fix: AWQ Marlin get_quant_method does not recognize "modules_to_not_convert" (#21888) · 1ece7f30
  Jun-Howie authored Aug 12, 2025
```
Signed-off-by: JunHowie <JunHowie@aliyun.com>
Co-authored-by: JunHowie <JunHowie@aliyun.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  1ece7f30