Commits · ed733802f0446ba7170dbb921ec6689016d1fa3a · OpenDAS / vllm_cscc

"vllm/model_executor/models/minicpm.py" did not exist on "f0d4e145575bf6fb96c141d776ce92c9bfc79c49"

09 Apr, 2026 18 commits
- Fix NUMA binding on non-CDMM Grace-Blackwell systems (#39361) · ed733802
  Qidong Su authored Apr 09, 2026
```
Signed-off-by: Qidong Su <soodoshll@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  ed733802
- [ROCm] Remove unnecessary fp8 roundtrip in gather cache NHD dequant (#39122) · 8a34c508
  Andrew Barnes authored Apr 09, 2026
```
Signed-off-by: Bortlesboat <bortstheboat@gmail.com>
```
  8a34c508
- [Perf] Optimize redundant sync for pooling model, 3.7% Throughput Improvement (#39113) · ed2f282b
  Wentao Ye authored Apr 09, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  ed2f282b
- [Docker] Add fastsafetensors to NVIDIA Dockerfile (#38950) · 9e785557
  Zhewen Li authored Apr 08, 2026
  
  9e785557
- [XPU] Skip VLLM_BATCH_INVARIANT for XPU in EAGLE DP test (#39164) · e80e6339
  sihao_li authored Apr 09, 2026
```
Signed-off-by: sihao.li <sihao.li@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  e80e6339
- [Multimodal] Fix nested_tensors_equal: add length check for lists and tuple support (#38388) · 490f17d0
  Khairul Kabir authored Apr 08, 2026
```
Signed-off-by: khairulkabir1661 <khairulkabir1661@users.noreply.github.com>
Co-authored-by: khairulkabir1661 <khairulkabir1661@users.noreply.github.com>
```
  490f17d0
- [Refactor] Improve indexer decode path metadata preparation (#38865) · 2e984060
  Yongye Zhu authored Apr 08, 2026
  
  2e984060
- [PD][HeteroArch]Fix accuracy issue with CPU_ATTN as Decoder and Flash_ATTN as prefiller (#38935) · ef5a2268
  Chendi.Xue authored Apr 08, 2026
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  ef5a2268
- [CI] Fix mypy for `vllm/v1/ops` (#39219) · aec18492
  Wentao Ye authored Apr 08, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  aec18492
- Fix Responses JSON schema alias serialization (#38519) · 2a49284c
  noobHappylife authored Apr 09, 2026
```
Signed-off-by: noobhappylife <aratar1991@hotmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
```
  2a49284c
- [Model] Update ColModernVBERT to support latest HF checkpoint (#39307) · d37b3787
  Ilya Boytsov authored Apr 09, 2026
```
Signed-off-by: Ilya Boytsov <ilyaboytsov1805@gmail.com>
```
  d37b3787
- [Bug] Fix routing bias dtype for trtllm per-block fp8 moe (#38989) · 92fbec39
  Wei Zhao authored Apr 08, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  92fbec39
- [Bugfix] Fix cpu-offload-gb assertion with non-default block sizes (#36461) · 2f41d6c0
  Ajay Anubolu authored Apr 08, 2026
```
Signed-off-by: AjAnubolu <anuboluajay@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  2f41d6c0
- [Gemma4] Support quantized MoE (#39045) · 3aecdf08
  Dipika Sikka authored Apr 08, 2026
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
```
  3aecdf08
- [UX] Integrate DeepGEMM into vLLM wheel via CMake (#37980) · eb4205fe
  Michael Goin authored Apr 09, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  eb4205fe
- [XPU][UT] update UTs in CI (#39296) · 83aea214
  liuzhenwei authored Apr 09, 2026
```
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  83aea214
- [W8A8 Block Linear Refactor][2/N] Remove W8A8Fp8BlockLinearOp and adopt Fp8... · 2e9034c9
  Maral authored Apr 09, 2026
```
[W8A8 Block Linear Refactor][2/N] Remove W8A8Fp8BlockLinearOp and adopt Fp8 block linear kernel selections. (#33892)
Signed-off-by: maral <maralbahari.98@gmail.com>
Signed-off-by: Maral <maralbahari.98@gmail.com>
```
  2e9034c9
- [Bugfix] FlashInfer MXINT4 MoE crashes, missing do_finalize (#39315) · 8332078c
  Benjamin Chislett authored Apr 08, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  8332078c
08 Apr, 2026 22 commits
- [torch.compile] Allow usage of Opaque Objects in PyTorch 2.11 (#39286) · ba4a78eb
  Richard Zou authored Apr 09, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  ba4a78eb
- [Bugfix]Fix EP precision for Qwen3.5, Qwen3-Next (#39181) · f3c7941e
  Kai Song authored Apr 09, 2026
```
Signed-off-by: Song Kai <songkai05@baidu.com>
```
  f3c7941e
- [CI Bug] Fix pre-commit issue in main (#39347) · 3352bf8b
  Wentao Ye authored Apr 08, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  3352bf8b
- [BugFix] --max-model-len=-1 causes over-limit requests to hang and starve the... · 7c94ae16
  triangleXIV authored Apr 09, 2026
```
[BugFix] --max-model-len=-1 causes over-limit requests to hang and starve the entire service (#39102)
Signed-off-by: triangle14 <y1019026570@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  7c94ae16
- `tests/v1/e2e/spec_decode`: assert async scheduling is used (#39206) · ad05edfb
  Rishi Puri authored Apr 08, 2026
```
Signed-off-by: Rishi Puri <riship@nvidia.com>
Signed-off-by: Rishi Puri <puririshi98@berkeley.edu>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
```
  ad05edfb
- [Feature] Batch invariant nvfp4 linear support (#39322) · 20181372
  Wentao Ye authored Apr 08, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  20181372
- [MoE] Move DEEP_GEMM into experts/ subdirectory (#39005) · a776a48b
  Jackmin801 authored Apr 08, 2026
```
Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  a776a48b
- [Tool] `adjust_request` to reasoning parser, and Gemma4 fixes (#39027) · 8477fe42
  Ben Browning authored Apr 08, 2026
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  8477fe42
- [Attention] relax the head dim 512 and paged kv for sm90+FA4 (#38835) · e24e0a43
  Lain authored Apr 08, 2026
```
Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  e24e0a43
- [Perf][Kernel] Persistent TopK scheduler: unified CUDAGraph-safe kernel with... · b55d830e
  Roberto L. Castro authored Apr 08, 2026
```
[Perf][Kernel] Persistent TopK scheduler: unified CUDAGraph-safe kernel with dynamic per-row dispatch - DeepSeek-V3.2 DSA decode (#37421)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
```
  b55d830e
- [Feature] NUMA binding support for GPU workers (#38635) · 75e01a39
  Shengqi Chen authored Apr 09, 2026
```
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
Co-authored-by: Jason Li <jasonlizhengjian@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  75e01a39
- [kv_offload+HMA][5/N]: Track group block hashes and block IDs (#37109) · 512c5eb4
  Or Ozeri authored Apr 08, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  512c5eb4
- [Bugfix] Fix Gemma4 streaming tool call corruption for split boolean/number values (#39114) · 13151a4d
  Flora Feng authored Apr 08, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  13151a4d
- [ROCm] Enable fused_silu_mul_block_quant on ROCm (#38817) · 56c976c1
  Gregory Shtrasberg authored Apr 08, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  56c976c1
- [Core] Use tuple_return in split_module for tuple-conformant subgraphs (#38752) · d74a306c
  Frederik Gossen authored Apr 08, 2026
```
Signed-off-by: Frederik Gossen <frgossen@meta.com>
Co-authored-by: Boyuan Feng <boyuan@meta.com>
```
  d74a306c
- [ROCm][CI-Build] Cherry pick triton BUFFER_OPS fix and update AITER (#38580) · 0e9f0a51
  Gregory Shtrasberg authored Apr 08, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  0e9f0a51
- [Bugfix] Fix V1 logprobs empty strings for multi-byte UTF-8 tokens when logprobs > 0 (#34875) · 8904fc4d
  haosdent authored Apr 08, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  8904fc4d
- [Bugfix] Add missing ASRDataset import and CLI args in benchmarks/throughput.py (#38114) · 1a2c1763
  nemanjaudovic authored Apr 08, 2026
```
Signed-off-by: nemanjaudovic <nudovic@amd.com>
```
  1a2c1763
- [FlashAttention] Symlink FA4 instead of copying when using `VLLM_FLASH_ATTN_SRC_DIR` (#38814) · 308cec58
  Matthew Bonanni authored Apr 08, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  308cec58
- [CI Failure] pin nomic-embed-text-v1 revision (#39292) · 4e2ab186
  wang.yuqi authored Apr 08, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  4e2ab186
- [Bugfix] Cuda Clean up scales Kvcache fp8/int8_per_token_head (#39224) · 140cbb11
  JartX authored Apr 08, 2026
```
Signed-off-by: JartX <sagformas@epdcenter.es>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  140cbb11
- [Bugfix][Docs] Fix ReadTheDocs build crash from mocked torch decorator (#39284) · 6155bbd1
  Kevin H. Luu authored Apr 08, 2026
```
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  6155bbd1