Commits · c656ba3b4d2cda82ca753eefde4b10cbf04c0a3f · OpenDAS / vllm_cscc · GitLab

17 Feb, 2026 11 commits
- [Kernel] Triton-based Top-k and Top-p sampler kernels (#33538) · c656ba3b
  Jongseok Park authored Feb 17, 2026
```
Signed-off-by: js_park <cakeng@naver.com>
Signed-off-by: Jongseok Park <37990712+cakeng@users.noreply.github.com>
Signed-off-by: Sunga Kim <sunga.kim@berkeley.edu>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Sunga Kim <sunga.kim@berkeley.edu>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  c656ba3b
- [Bugfix][MTP][Sparse MLA] Allow sparse MLA with MTP to run with FULL cudagraphs (#34457) · dc5fa77a
  Matthew Bonanni authored Feb 17, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  dc5fa77a
- [Renderer] Move InputPreprocessor into Renderer (2/2) (#34560) · 574fe752
  Cyrus Leung authored Feb 17, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  574fe752
- Fix docs build warning (#34686) · 28bffe94
  Harry Mellor authored Feb 17, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  28bffe94
- [Ray] Propagate third-party env vars to Ray workers via prefix matching (#34383) · c464b573
  kourosh hakhamaneshi authored Feb 17, 2026
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  c464b573
- [Model Runner V2] Minor refactoring for penalties (#34662) · d00df624
  Woosuk Kwon authored Feb 16, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  d00df624
- [Model Runner V2] Minor simplification for BadWordsState (#34669) · 9752da9d
  Woosuk Kwon authored Feb 16, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  9752da9d
- [Model Runner V2] Minor cleanup for PP (#34666) · 04925b22
  Woosuk Kwon authored Feb 16, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  04925b22
- [Model Runner V2] Fix unintended CPU-GPU sync in make_dummy (#34667) · d74278fb
  Woosuk Kwon authored Feb 16, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  d74278fb
- [Core] Pipeline Parallel support for Model Runner V2 (#33960) · 9a8853f7
  zhanqiuhu authored Feb 16, 2026
```
Signed-off-by: Zhanqiu Hu <zh338@cornell.edu>
```
  9a8853f7
- [Model Runner V2] support bad_words sampling param (#33433) · 387a1898
  zhrrr authored Feb 17, 2026
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
```
  387a1898
16 Feb, 2026 3 commits
- [CI] Enable mypy coverage for individual excluded files (#34292) · a3205bef
  Lucas Kabela authored Feb 16, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a3205bef
- [Bugfix] Fix ARC touch KeyError for non-ready T1 blocks in kv offload (#34576) · bc56a1d5
  Yiqi Xue authored Feb 16, 2026
```
Signed-off-by: Yiqi Xue <xuey666@gmail.com>
```
  bc56a1d5
- [Scheduler][ASR] Fix CrossAttn blocks per-request for Variable length encoder inputs (#31058) · cd81cdb3
  Ekagra Ranjan authored Feb 16, 2026
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  cd81cdb3
15 Feb, 2026 3 commits
- [MM Encoder] Add Triton ViT attention backend (#32183) · 71cd8926
  Isotr0py authored Feb 15, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  71cd8926
- [KV Connector] Add temporary, off-by-default... · 79c7e092
  Seiji Eicher authored Feb 14, 2026
```
[KV Connector] Add temporary, off-by-default `VLLM_DISABLE_REQUEST_ID_RANDOMIZATION` workaround (#34415)
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  79c7e092
- [Model Runner V2] Minor cleanup for Sampler (#34563) · 9ca768c7
  Woosuk Kwon authored Feb 14, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  9ca768c7
14 Feb, 2026 4 commits
- [Hybrid] Enable mamba prefix cache "align" mode with async scheduling (#33997) · d5fe3f70
  Thomas Parnell authored Feb 14, 2026
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  d5fe3f70
- [Renderer] Move InputPreprocessor into Renderer (1/2) (#34510) · 73391a1b
  Cyrus Leung authored Feb 15, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  73391a1b
- [CI] Heavy refactoring of Voxtral multimodal audio model tests (#34294) · de42abb3
  Andreas Karatzas authored Feb 13, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  de42abb3
- [Feature][Perf] Support Selective CPU Weight Offloading (#34535) · b37b6797
  Wei Zhao authored Feb 13, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
```
  b37b6797
13 Feb, 2026 12 commits
- [GDN] Use CPU tensors to build GDN metadata (#34498) · 0916e796
  Woosuk Kwon authored Feb 13, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  0916e796
- [Feature] Pipeline Parallel Async send/recv, 2.9% E2E throughput improvement (#33368) · 3d2a026f
  Wentao Ye authored Feb 13, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  3d2a026f
- [Core] Move pause and resume functions into engine (#34125) · dddbff46
  Aaron Hao authored Feb 13, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Signed-off-by: hao-aaron <ahao@anyscale.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  dddbff46
- [Bug Fix] Fix MambaManager.cache_blocks() crash on null blocks in align mode (#34418) · 4137c5df
  haosdent authored Feb 13, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  4137c5df
- [BugFix] Fix and optimize max_num_blocks_per_req calculation for MambaSpec (#34440) · 7a8a46dd
  Harry Huang authored Feb 13, 2026
```
Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
```
  7a8a46dd
- [Refactor] Pass full VllmConfig to Renderer (#34485) · 2f308214
  Cyrus Leung authored Feb 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2f308214
- [Hybrid] Fix and optimize block-aligned splitting in mamba cache align mode (#33706) · bf37812c
  Harry Huang authored Feb 13, 2026
```
Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
```
  bf37812c
- [Refactor] Simplify BOS/EOS token handling (#34435) · ea5ff3a1
  Cyrus Leung authored Feb 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ea5ff3a1
- Fix num_logprobs parameter description in sampler.py (#34451) · d707678d
  Zhuohan Li authored Feb 12, 2026
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  d707678d
- [Core] Profiler improvements and lazy initialization (#33198) · 4453ba8d
  Jaewon authored Feb 12, 2026
```
Signed-off-by: Jaewon Lee <jaewon@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  4453ba8d
- [Core] Add sleep level 0 mode with enqueue/wait pattern (#33195) · aa181c92
  Jaewon authored Feb 12, 2026
```
Signed-off-by: Jaewon Lee <jaewon@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  aa181c92
- Use paged_attention_v1 for sliding window decode in rocm_aiter_fa (#34378) · 9ea1f598
  Mengtao (Martin) Yuan authored Feb 12, 2026
```
Signed-off-by: Martin Yuan <myuan@meta.com>
Co-authored-by: Martin Yuan <myuan@meta.com>
```
  9ea1f598
12 Feb, 2026 5 commits
- [Attention] Add FlashInfer Sparse MLA backend (#33451) · f2c47886
  Matthew Bonanni authored Feb 12, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
```
  f2c47886
- [BUG] Reset running requests when clearing cache for pause/resume (#34382) · 7b5a8b4a
  Aaron Hao authored Feb 12, 2026
```
Signed-off-by: hao-aaron <ahao@anyscale.com>
```
  7b5a8b4a
- [Refactor] Pass Renderer to Input Processor (#34329) · b96f7314
  Cyrus Leung authored Feb 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b96f7314
- [Refactor] Move validation to params definitions (#34362) · ced2a92f
  Cyrus Leung authored Feb 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ced2a92f
- [Bugfix] Fix MTP accuracy for GLM-5 (#34385) · ec12d39d
  Michael Goin authored Feb 11, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  ec12d39d
11 Feb, 2026 2 commits
- [Model Runner V2] Init cuda graph pool when necessary (#33217) · ffb3d553
  Xinyu Chen authored Feb 12, 2026
```
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
```
  ffb3d553
- [ROCm] [aiter] Split KV cache update for AiterFlashAttention (#33681) · 64f570ab
  kliuae authored Feb 12, 2026
```
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
```
  64f570ab