Commits · 5e4e0e51f4fbb6d6fbf7a94feef07bd3617bfa5f · OpenDAS / vllm_cscc

23 Jan, 2026 1 commit

[torch.compile] Compile `CustomOp.forward_native` for `SiluAndMul` and... · 5e4e0e51

Luka Govedič authored Jan 22, 2026


[torch.compile] Compile `CustomOp.forward_native` for `SiluAndMul` and `QuantFP8` to avoid raw torch ops inside opaque custom ops (#32806)
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

5e4e0e51

22 Jan, 2026 24 commits
- [MoE Refactor] Move `select_experts` from `FusedMoEQuantMethod` -> `FusedMoE` (#31996) · dc917cce
  bnellnm authored Jan 22, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  dc917cce
- [Perf] Create TMA-aligned input scale tensor for DeepGemm on Hopper (#32619) · d08b356e
  Xin Yang authored Jan 22, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  d08b356e
- Add llmcompressor fp8 kv-cache quant (per-tensor and per-attn_head) (#30141) · 44f08af3
  Eldar Kurtić authored Jan 22, 2026
```
Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
Signed-off-by: eldarkurtic <8884008+eldarkurtic@users.noreply.github.com>
```
  44f08af3
- Support custom URI schemes and trace handlers for profiler (#32393) · 3a63be0f
  David Ramon Prados authored Jan 22, 2026
  
  3a63be0f
- [Hardware][AMD][CI][Bugfix] Fix regressions from deprecated env vars (#32837) · c517d8c9
  Matt authored Jan 22, 2026
```
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
```
  c517d8c9
- Support bge-m3 sparse embeddings and colbert embeddings (#14526) · ff365eea
  Maximilien de Bayser authored Jan 22, 2026
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
```
  ff365eea
- [Misc] Bump opencv-python dependecy version to 4.13 (#32668) · 444e2e7e
  Isotr0py authored Jan 22, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  444e2e7e
- [torch.compile] Improve Cold Start for MoEs (#32805) · 654a71fc
  Richard Zou authored Jan 22, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  654a71fc
- [Misc][BE] Turn on strict type coverage for vllm/compilation (#31756) · 15e302df
  Lucas Kabela authored Jan 22, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  15e302df
- [Frontend] Introduce Renderer for processing chat messages (using `ModelConfig`) (#30200) · d117a4d1
  Cyrus Leung authored Jan 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d117a4d1
- OffloadingConnector: Support kernel_block_size != block_size (#30692) · 421012b6
  Or Ozeri authored Jan 22, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  421012b6
- [Bugfix] Fix Whisper/encoder-decoder GPU memory leak (#32789) · ea6102b8
  Nicolò Lucchesi authored Jan 22, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  ea6102b8
- [Frontend][2/n] Make pooling entrypoints request schema consensus | ChatRequest (#32574) · 328cbb27
  wang.yuqi authored Jan 22, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  328cbb27
- Enable Cross layers KV cache layout at NIXL Connector (#30207) · 64e3d67a
  liranschour authored Jan 22, 2026
```
Signed-off-by: Liran Schour <lirans@il.ibm.com>
Signed-off-by: liranschour <liranschour@users.noreply.github.com>
Co-authored-by: Or Ozeri <or@ozery.com>
```
  64e3d67a
- [AMD][ROCm] MoRI EP: a high-performance all2all backend (#28664) · 49a12622
  Alex Sun authored Jan 22, 2026
```
Signed-off-by: Alex Sun <alex.s@amd.com>
```
  49a12622
- [Model] Extend `collect_children` and `no_init_weights` contexts (#32757) · 2b8a38b6
  Cyrus Leung authored Jan 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2b8a38b6
- [ROCm][CI][Docs] Add comment explaining TRITON_ATTN fallback for ROCm (#32835) · a8102998
  Andreas Karatzas authored Jan 22, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  a8102998
- [ROCm][CI] Fix AITER test flakiness by using explicit attention backend (#32346) · eb1629da
  Andreas Karatzas authored Jan 21, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
```
  eb1629da
- [ROCm][CI] Lower Acceptance Len Threshold For test_draft_model_quantization (#32731) · 019e2c3b
  Micah Williamson authored Jan 21, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  019e2c3b
- Upgrade transformers-4.57.5 (#32287) · f5fdec8c
  Huy Do authored Jan 21, 2026
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  f5fdec8c
- [FlashMLA] Update FlashMLA to expose new arguments (#32810) · 889722f3
  Lucas Wilkinson authored Jan 21, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  889722f3
- [ROCm][CI] fix get_valid_backends (#32787) · 49d96538
  Divakar Verma authored Jan 21, 2026
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  49d96538
- [EC Connector] Optimize remote cache check in scheduler (#32585) · 378385b9
  knlnguyen1802 authored Jan 22, 2026
```
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
```
  378385b9
- [Deprecation] Remove deprecated environment variables (#32812) · 6437ff1f
  Wentao Ye authored Jan 21, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  6437ff1f
21 Jan, 2026 12 commits
- [Kernel] Add topk_sigmoid kernel (#31246) · 63227acc
  Xin Yang authored Jan 21, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  63227acc
- Bump Flashinfer to v0.6.1 (#30993) · 808d6fd7
  elvischenv authored Jan 22, 2026
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  808d6fd7
- [PluggableLayer][1/N] Define PluggableLayer (Fix ci) (#32744) · 1861ae8a
  whx authored Jan 22, 2026
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
  1861ae8a
- [Quantization][Deprecation] Remove RTN (#32697) · 4e31b7f2
  Robert Shaw authored Jan 21, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  4e31b7f2
- [Quantization][Deprecation] Deprecate HQQ (#32681) · 85f55c94
  Robert Shaw authored Jan 21, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  85f55c94
- [MoE Refactor] Oracle Select FP8+NVFP4 Kernels In Priority (#32414) · 42135d68
  Robert Shaw authored Jan 21, 2026
  
  42135d68
- [Model] Add Eagle2.5-8B Vision-Language Model support (#32456) · 7727ce35
  Kim Hee Su authored Jan 21, 2026
```
Signed-off-by: kimheesu <wlskaka4@gmail.com>
```
  7727ce35
- Update FlashMLA (#32491) · b4f64e5b
  Lucas Wilkinson authored Jan 20, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  b4f64e5b
- [Cleanup] Remove unused `KVConnectorModelRunnerMixin` methods (#32077) · 6f067b1f
  Nick Hill authored Jan 20, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  6f067b1f
- [Bugfix] Fix Granite Vision / Don't use Siglip Pooling Head Nested Models by Default (#32299) · 27b81e01
  Alex Brooks authored Jan 20, 2026
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  27b81e01
- OffloadingConnector: Prevent redundant loads (#29087) · 7013e9ac
  Or Ozeri authored Jan 21, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  7013e9ac
- Revert "[PluggableLayer][1/N] Define PluggableLayer" (#32725) · c78ee240
  Robert Shaw authored Jan 20, 2026
  
  c78ee240
20 Jan, 2026 3 commits
- fp8 online quant: split out Fp8OnlineLinearMethod (#32189) · d2389c12
  Vasiliy Kuznetsov authored Jan 20, 2026
  
  d2389c12
- [Misc] Remove pad_for_cudagraphs from config (#30143) · 22613408
  Lucas Wilkinson authored Jan 20, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
```
  22613408
- [AOT compilation] support torch.compile inductor artifacts in VllmCompiledFunction (#25205) · 7c5dedc2
  dolpm authored Jan 20, 2026
```
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
```
  7c5dedc2