Commits · b8bf5c45bbbb1249bd1656557603da71e9d4c3b9 · OpenDAS / vllm_cscc · GitLab

10 Jan, 2026 21 commits
- [Kernel] Optimize Sliding Window Attention in 3D Triton Kernel (#31984) · b8bf5c45
  jvlunteren authored Jan 10, 2026
```
Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
```
  b8bf5c45
- [Quant] Support MXFP4 W4A16 for compressed-tensors dense models (#31926) · e6c6f2c7
  Michael Goin authored Jan 10, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  e6c6f2c7
- [Bugfix] Fix integer overflow in Gemma3n audio processing (#31657) · 07286ec5
  Jeremy Teboul authored Jan 10, 2026
```
Signed-off-by: Jeremy Teboul <jeremyte@meta.com>
```
  07286ec5
- [Bugfix] fix offline chat output prompt (#32076) · 14fc7a68
  Ning Xie authored Jan 10, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  14fc7a68
- [Benchmark][1/2] Generalize SLA criterion validation from binary flags to margins (#32075) · 5f2385a4
  Cyrus Leung authored Jan 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5f2385a4
- [Bugfix] fix encoder cache leak of waiting requests in scheduler to solve... · a01a1c0d
  Frelam authored Jan 10, 2026
```
[Bugfix] fix encoder cache leak of waiting requests in scheduler to solve stuck in CPU scheduling (#31857)
Signed-off-by: frelam <frelam112233@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  a01a1c0d
- [Misc] Delay deprecation of CommonAttentionMetadata properties (#32074) · da6709c9
  Lucas Wilkinson authored Jan 10, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  da6709c9
- [ROCm][CI] Fix flaky `test_function_calling_with_stream` and reduce schema test examples (#32063) · d83becd5
  Andreas Karatzas authored Jan 09, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  d83becd5
- Update modelopt KV cache quantization resolution to new scheme (#31895) · 0c961487
  roikoren755 authored Jan 10, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  0c961487
- [Refactor] Separate sequence and token pooling types (#32026) · 583a90e0
  Cyrus Leung authored Jan 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  583a90e0
- [Core] Refactor ColumnParallelLinear: remove unused parameter and optimize forward (#31939) · 52d42829
  maang authored Jan 10, 2026
```
Signed-off-by: maang <maang_h@163.com>
```
  52d42829
- [Bugfix][Hardware][AMD] Use dynamic WARP_SIZE in sampler vectorized_process (#31295) · c60578de
  Kevin McKay authored Jan 09, 2026
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
```
  c60578de
- Fuse RoPE and MLA KV-cache write (#25774) · 80fead8b
  PatrykSaffer authored Jan 10, 2026
```
Signed-off-by: Patryk Saffer <patryk.saffer99@gmail.com>
Signed-off-by: PatrykSaffer <patryk.saffer@mistral.ai>
Co-authored-by: Patryk Saffer <patryk.saffer99@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  80fead8b
- feature/issac 0.2 (#31550) · e45946bd
  Akshat Shrivastava authored Jan 09, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  e45946bd
- [Misc][LLaMa4] Compile LLaMa Vision Encoder (#30709) · ea6d067a
  Lucas Kabela authored Jan 09, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  ea6d067a
- resolve pydantic error in startup benchmark (#31348) · abd92242
  Ning Xie authored Jan 10, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  abd92242
- [Bugfix] Narrow broad exceptions in compilation backends (#31616) · 4dc0d606
  Kevin McKay authored Jan 09, 2026
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  4dc0d606
- [CI] Allow Deprecated Quantization For LM Eval Tests (#32065) · ac0675ff
  Micah Williamson authored Jan 09, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  ac0675ff
- [Perf] Optimize async scheduling placeholder using empty (#32056) · e18464a5
  Wentao Ye authored Jan 09, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e18464a5
- [Core] Use weights_only=True with torch.load (#32045) · 1963245e
  Russell Bryant authored Jan 09, 2026
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  1963245e
- [2/N][Attention] Fix pre-commit errors (#32052) · 03089019
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  03089019
09 Jan, 2026 19 commits
- [Misc][BE] Type coverage for vllm/compilation [2/3] (#31744) · aaf4b70a
  Lucas Kabela authored Jan 09, 2026
  
  aaf4b70a
- [Misc] Enable async scheduling by default with spec decoding (#31998) · 3adffd5b
  Nick Hill authored Jan 09, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  3adffd5b
- [perf][async] support non cpu sync get logprob tensors for spec (#31336) · 97ba96fb
  zhrrr authored Jan 10, 2026
```
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  97ba96fb
- [NIXL] refine decoder side post process for heterogeneous BlockSize and kv_layout (#30275) · 94578127
  Chendi.Xue authored Jan 09, 2026
  
  94578127
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
- [responsesAPI] fix incomplete_messages for simple/parsable context (#31836) · 1f8b7c53
  Andrew Xia authored Jan 09, 2026
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  1f8b7c53
- [Quant] Make static quant support all group shapes (#30833) · 0a0aa077
  Lucas Wilkinson authored Jan 09, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  0a0aa077
- [fix] add cutedsl to global sf (#32001) · f9e2a75a
  jiahanc authored Jan 09, 2026
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
```
  f9e2a75a
- Add unpermute-aware fused MoE path and small-batch fallback (#29354) · a4d5d663
  Runkai Tao authored Jan 09, 2026
```
Signed-off-by: Runkai Tao <rt572@physics.rutgers.edu>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a4d5d663
- [Fix] Introduce audio channels spec (#31595) · 657e9c0e
  Jeremy Teboul authored Jan 09, 2026
```
Signed-off-by: Jeremy Teboul <jeremyte@meta.com>
```
  657e9c0e
- [Perf] Optimize cutlass moe problem size calculation, 5.3% E2E Throughput... · 308feab3
  Wentao Ye authored Jan 09, 2026
```
[Perf] Optimize cutlass moe problem size calculation, 5.3% E2E Throughput improvement, 2.2% TTFT improvement (#31830)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  308feab3
- [Refactor] Remove numpy split in async scheduling (#32034) · 28ae32a5
  Wentao Ye authored Jan 09, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  28ae32a5
- [Frontend][gpt-oss] Allow system message to overwrite model identity (#31737) · f32c629e
  Andrew Xia authored Jan 09, 2026
```
Signed-off-by: lacora <hyelacora@gmail.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: lacora <hyelacora@gmail.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  f32c629e
- [Feat][Core] Support multiple KV cache groups in Hybrid KV Coordinator (#31707) · cd4a95e3
  Yifan Qiao authored Jan 09, 2026
```
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
```
  cd4a95e3
- [UX] Add vLLM model inspection view (#29450) · d5ec6c05
  Michael Goin authored Jan 09, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  d5ec6c05
- [Doc] Add developer guide for CustomOp (#30886) · 08d954f0
  Shanshan Shen authored Jan 10, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  08d954f0
- Rename --exclude-log-deltas to --enable-log-deltas (#32020) · ac9f9330
  Kevin Šuc authored Jan 09, 2026
```
Signed-off-by: Catacomba <kevinsuc16@gmail.com>
```
  ac9f9330
- [Doc] Remove hardcoded Whisper in example openai translation client (#32027) · 2d0c5b63
  Isotr0py authored Jan 09, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  2d0c5b63
- [Perf][Kernel] Fused SiLU+Mul+Quant kernel for NVFP4 cutlass_moe (#31832) · 34cd32fe
  Michael Goin authored Jan 09, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  34cd32fe