Commits · d117a4d1a915c7acf124563f9b337de5c0aa2c2f · OpenDAS / vllm_cscc · GitLab

22 Jan, 2026 25 commits
- [Frontend] Introduce Renderer for processing chat messages (using `ModelConfig`) (#30200) · d117a4d1
  Cyrus Leung authored Jan 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d117a4d1
- OffloadingConnector: Support kernel_block_size != block_size (#30692) · 421012b6
  Or Ozeri authored Jan 22, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  421012b6
- [Frontend] add prompt_cache_key for openresponses (#32824) · 841d53aa
  Chauncey authored Jan 22, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  841d53aa
- [CI] refactor release pipeline config into groups (#32833) · 1752262e
  Shengqi Chen authored Jan 22, 2026
```
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
```
  1752262e
- [Bugfix] Fix Whisper/encoder-decoder GPU memory leak (#32789) · ea6102b8
  Nicolò Lucchesi authored Jan 22, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  ea6102b8
- [Frontend][2/n] Make pooling entrypoints request schema consensus | ChatRequest (#32574) · 328cbb27
  wang.yuqi authored Jan 22, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  328cbb27
- Enable Cross layers KV cache layout at NIXL Connector (#30207) · 64e3d67a
  liranschour authored Jan 22, 2026
```
Signed-off-by: Liran Schour <lirans@il.ibm.com>
Signed-off-by: liranschour <liranschour@users.noreply.github.com>
Co-authored-by: Or Ozeri <or@ozery.com>
```
  64e3d67a
- [Benchmark] Don't default to `temperature==0` in `vllm bench serve` (#32723) · 098b2d66
  Nick Hill authored Jan 22, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  098b2d66
- [Misc] Replace urllib's `urlparse` with urllib3's `parse_url` (#32746) · 8ebf271b
  Isotr0py authored Jan 22, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8ebf271b
- [AMD][ROCm] MoRI EP: a high-performance all2all backend (#28664) · 49a12622
  Alex Sun authored Jan 22, 2026
```
Signed-off-by: Alex Sun <alex.s@amd.com>
```
  49a12622
- [Model] Extend `collect_children` and `no_init_weights` contexts (#32757) · 2b8a38b6
  Cyrus Leung authored Jan 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2b8a38b6
- [bench] add start_times field to vllm bench serve json result (#32667) · 1bf1a34b
  Kebe authored Jan 22, 2026
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  1bf1a34b
- [ROCm][CI][Docs] Add comment explaining TRITON_ATTN fallback for ROCm (#32835) · a8102998
  Andreas Karatzas authored Jan 22, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  a8102998
- [ROCm][CI] Fix AITER test flakiness by using explicit attention backend (#32346) · eb1629da
  Andreas Karatzas authored Jan 21, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
```
  eb1629da
- [ROCm][CI] Lower Acceptance Len Threshold For test_draft_model_quantization (#32731) · 019e2c3b
  Micah Williamson authored Jan 21, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  019e2c3b
- Upgrade transformers-4.57.5 (#32287) · f5fdec8c
  Huy Do authored Jan 21, 2026
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  f5fdec8c
- [Llama.py -> mistral.py] Extract mistral-only relevant code into separate file (#32780) · 1579c9b5
  Patrick von Platen authored Jan 22, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  1579c9b5
- [FlashMLA] Update FlashMLA to expose new arguments (#32810) · 889722f3
  Lucas Wilkinson authored Jan 21, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  889722f3
- [ROCm][CI] fix get_valid_backends (#32787) · 49d96538
  Divakar Verma authored Jan 21, 2026
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  49d96538
- [Docs] Remove outdated async_scheduling limitation with speculative decoding (#32775) · a1d82466
  Ifta khairul Alam Adil authored Jan 22, 2026
```
Signed-off-by: Ifta Khairul Alam Adil <ikaadil007@gmail.com>
Signed-off-by: Ifta khairul Alam Adil <25082512+ikaadil@users.noreply.github.com>
```
  a1d82466
- Cleanup some huggingface_hub-related stuff (#32788) · 24a163ed
  Lucain authored Jan 22, 2026
  
  24a163ed
- [EC Connector] Optimize remote cache check in scheduler (#32585) · 378385b9
  knlnguyen1802 authored Jan 22, 2026
```
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
```
  378385b9
- [Bugfix] Fix potential EAGLE spec decode segfault during graph capture (#32818) · c5487e2b
  Matt authored Jan 21, 2026
```
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
```
  c5487e2b
- [Deprecation] Remove deprecated environment variables (#32812) · 6437ff1f
  Wentao Ye authored Jan 21, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  6437ff1f
- [Model Runner V2] Do not error on attention backends (#32820) · 5e00b561
  Woosuk Kwon authored Jan 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  5e00b561
21 Jan, 2026 15 commits
- [Model Runner V2] Refactor Prompt Logprobs (#32811) · 408195ec
  Woosuk Kwon authored Jan 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  408195ec
- [Kernel] Add topk_sigmoid kernel (#31246) · 63227acc
  Xin Yang authored Jan 21, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  63227acc
- [Misc] Add Helion version check to collect_env (#32797) · e675dda6
  Yanan Cao authored Jan 21, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  e675dda6
- [ModelRunner V2] Don't pin reused flashinfer tensors (#32799) · 24dc30f7
  Nick Hill authored Jan 21, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  24dc30f7
- [ROCm] fix import for on_gfx9 (#32783) · 180fba65
  Divakar Verma authored Jan 21, 2026
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  180fba65
- Add missing import of fused_topk to benchmark_moe (#32784) · f9995398
  danisereb authored Jan 21, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  f9995398
- [Model Runner V2] Minor refactor for `compute_slot_mappings` (#32794) · e1da249c
  Woosuk Kwon authored Jan 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e1da249c
- [Misc] Omit "disable NCCL for DP sync" startup log when not applicable (#32707) · 9b693d02
  Nick Hill authored Jan 21, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  9b693d02
- Bump Flashinfer to v0.6.1 (#30993) · 808d6fd7
  elvischenv authored Jan 22, 2026
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  808d6fd7
- [PluggableLayer][1/N] Define PluggableLayer (Fix ci) (#32744) · 1861ae8a
  whx authored Jan 22, 2026
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
  1861ae8a
- [Quantization][Deprecation] Remove RTN (#32697) · 4e31b7f2
  Robert Shaw authored Jan 21, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  4e31b7f2
- [ROCm][Deepseekv3.2] Refactor Sparse Indexer as CustomOp (#29287) · 6c20e89c
  Pleaplusone authored Jan 21, 2026
```
Signed-off-by: ganyi <ygan@amd.com>
```
  6c20e89c
- [Quantization][Deprecation] Deprecate HQQ (#32681) · 85f55c94
  Robert Shaw authored Jan 21, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  85f55c94
- [Quantization][Deprecation] Remove `DeepSpeedFp8` (#32679) · cea3c754
  Robert Shaw authored Jan 21, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  cea3c754
- [MoE Refactor] Oracle Select FP8+NVFP4 Kernels In Priority (#32414) · 42135d68
  Robert Shaw authored Jan 21, 2026
  
  42135d68