Commits · 70022ffc002dabc59b936d3fc001b94b81ba08db · OpenDAS / vllm_cscc

24 Oct, 2025 1 commit

Granite 4.0 quark quantization support (#26944) · 70022ffc

xiao-llm authored Oct 23, 2025


Signed-off-by: Xiao YU <Xiao.YU@xilinx.com>
Signed-off-by: Xiao Yu <xiao.yu.dc@outlook.com>
Co-authored-by: Xiao YU <Xiao.YU@xilinx.com>

70022ffc

23 Oct, 2025 31 commits
- [Hardware][POWERPC] Disable oneDNN path in vllm/model_executor/layers/utils.py for Powerpc (#27422) · f417746a
  Akash kaothalkar authored Oct 24, 2025
```
Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
```
  f417746a
- [Model] Siglip Embedding Support (#27324) · 0552cfb1
  Yu Jiaqi authored Oct 24, 2025
```
Signed-off-by: piood <2477084691@qq.com>
```
  0552cfb1
- [Bugfix][DP] Fix creating too many DP Placement Groups (#26880) · 51dd14ac
  Kebe authored Oct 24, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>
```
  51dd14ac
- [Attention] Fix FlashMLA metadata builder arguments for q_len > 1 (#27368) · dbfbf9f3
  Matthew Bonanni authored Oct 23, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  dbfbf9f3
- [Chore] Separate out `vllm.utils.platform_utils.py` (#27374) · ca76486a
  Jonathan Chen authored Oct 23, 2025
```
Signed-off-by: Jonathan <chenleejonathan@gmail.com>
```
  ca76486a
- [Misc] Add triton_kernels dependency (#27370) · a9f55dc5
  Varun Sundar Rabindranath authored Oct 23, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  a9f55dc5
- [Bugfix] Fix AWQ marlin layer skipping (#27416) · 81d5bb76
  Isotr0py authored Oct 24, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  81d5bb76
- [Bugfix][ROCm][DeepSeek] Fix for forward_hip in rope for DeepSeek (#27373) · 0825197b
  Gregory Shtrasberg authored Oct 23, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  0825197b
- [Bugfix] Fix dp_chunking enablement logic in FusedMoE layer (#27220) · 9ef3d5b8
  Alexander Matveev authored Oct 23, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  9ef3d5b8
- Mirroring the test definitions (2025-10-22) (#27362) · 295c7f02
  Alexei-V-Ivanov-AMD authored Oct 23, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  295c7f02
- [Frontend][4/N] Improve all pooling task | Add plugin pooling task (#26973) · 3fa2c121
  wang.yuqi authored Oct 23, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Christian Pinto <christian.pinto@ibm.com>
```
  3fa2c121
- [CI/Build] Remove unnecessary flags from test registry (#27353) · fe2016de
  Cyrus Leung authored Oct 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fe2016de
- [Misc] Remove use of CUDA_VISIBLE_DEVICES for device selection (fix DP slow... · 237cf6d3
  Ilya Markov authored Oct 23, 2025
```
[Misc] Remove use of CUDA_VISIBLE_DEVICES for device selection (fix DP slow startup time &c) (#26709)
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  237cf6d3
- [Feature] Pydantic validation for speculative.py (#27156) · faee3ccd
  Navya Srivastava authored Oct 23, 2025
```
Signed-off-by: Navya Srivastava <navya.srivastava1707@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  faee3ccd
- [Bugfix] Honor --mm_encoder_attn_backend when used (#27124) · 570c3e1c
  Bradley D authored Oct 23, 2025
```
Co-authored-by: Bradley D <4551889+bradleyhd@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  570c3e1c
- Run mypy on the lowest supported Python version instead of system Python (#27048) · 3a4255c7
  Harry Mellor authored Oct 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3a4255c7
- [Model] Add MoE support for NemotronH (#25863) · 61089465
  tomeras91 authored Oct 23, 2025
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
  61089465
- [Metrics] [KVConnector] Add connector prefix cache hit rate stats (#26245) · 88afa110
  Tova Movshovitz authored Oct 23, 2025
```
Signed-off-by: tovam <tovam@pliops.com>
```
  88afa110
- [CI] Reorganize entrypoints tests (#27403) · d00ce29d
  Chauncey authored Oct 23, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  d00ce29d
- add SLA information into comparison graph for vLLM Benchmark Suite (#25525) · 3b7bdf98
  Louie Tsai authored Oct 23, 2025
```
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Signed-off-by: louie-tsai <louie.tsai@intel.com>
Signed-off-by: Louie Tsai <louie.tsai@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  3b7bdf98
- [CI/Build] Fix AMD CI: test_cpu_gpu.py (#27388) · 50b788a1
  Zhewen Li authored Oct 23, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  50b788a1
- [Bugfix] Fix args settings for guided decoding args (#27375) · fc059c70
  Lucia Fang authored Oct 23, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
```
  fc059c70
- [CI/Build] Fix Prithvi plugin test (#27393) · bfb240cc
  Cyrus Leung authored Oct 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  bfb240cc
- [Chore] Remove duplicate `has_` functions in vllm.utils (#27372) · e255d929
  Jonathan Chen authored Oct 23, 2025
```
Signed-off-by: Jonathan <chenleejonathan@gmail.com>
```
  e255d929
- [Model] Add num_cached_tokens for PoolingRequestOutput (#27378) · 3729ed00
  wang.yuqi authored Oct 23, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  3729ed00
- [V1][spec decode] return logprobs for spec decoding (#26060) · 6644796b
  Giancarlo Delfin authored Oct 22, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  6644796b
- [CORE] Support Prefix Caching with Prompt Embeds (#27219) · ff93cc8c
  Andrew Sansom authored Oct 23, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  ff93cc8c
- [Bugfix][Core] running queue index leakage exception (#26754) · 243ed7d3
  PiteXChen authored Oct 23, 2025
```
Signed-off-by: CLFutureX <chenyongqyl@163.com>
```
  243ed7d3
- [Bugfix] Fix incorrect kv cache metrics in grafana.json (#27133) · 7e094105
  fangpings authored Oct 22, 2025
```
Signed-off-by: Fangping Shi <fangping_shi@apple.com>
Co-authored-by: Fangping Shi <fangping_shi@apple.com>
```
  7e094105
- [Bugfix] Fix SLA tuner initialization (#27355) · 6738e4a0
  Cyrus Leung authored Oct 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6738e4a0
- [Bugfix] Fix deepseek-ocr multi-image inference and add... · 2566dca2
  Isotr0py authored Oct 23, 2025
```
[Bugfix] Fix deepseek-ocr multi-image inference and add `merge_by_field_config=True` with tensor schema support (#27361)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  2566dca2
22 Oct, 2025 8 commits
- [MLA] Bump FlashMLA (#27354) · b4fda58a
  Matthew Bonanni authored Oct 22, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  b4fda58a
- [Chore] Separate out system utilities from vllm.utils (#27201) · a0003b56
  dongbo910220 authored Oct 23, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a0003b56
- [BugFix] bugfix for Flash Attention MLA with full cuda graph IMA following pr-25490 (#27128) · 5beacce2
  Daisy-Ma-coder authored Oct 22, 2025
```
Signed-off-by: qqma <qqma@amazon.com>
Co-authored-by: qqma <qqma@amazon.com>
```
  5beacce2
- [Feature] publisher default set zmq in kv_event config (#26915) · 8669c69a
  rongfu.leng authored Oct 23, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  8669c69a
- [Prefix Cache] Use LoRA name for consistent KV-cache block hashing (#27211) · 1651003c
  Sage authored Oct 22, 2025
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  1651003c
- [Doc] Fix numbering sequence in prefix caching (#27357) · 1cb8c6c5
  William Song authored Oct 23, 2025
```
Signed-off-by: William Song <jinwook@umich.edu>
```
  1cb8c6c5
- [Model] Revert PR #26715: Restore custom PaliGemma and Gemma3-MM impl… (#27309) · e05a6754
  Luciano Martins authored Oct 22, 2025
```
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
```
  e05a6754
- [Bugfix] Disable FlexAttention direct block mask building for encoder-only models (#27344) · 084a9dae
  Isotr0py authored Oct 23, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  084a9dae