Commits · f8bd8394e3d06c18088d3f1a1944ca6001142400 · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "c3fd4d669a4446578ea83bf7c330112339d2d8e1"

12 Jan, 2026 33 commits
- [NIXL][Bugfix] Failure logging overhaul + early metadata free on failure (#32031) · f8bd8394
  Nicolò Lucchesi authored Jan 12, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  f8bd8394
- [Model Runner V2] Support logit_bias, allowed_token_ids, min_tokens (#32163) · ca81811b
  Woosuk Kwon authored Jan 12, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  ca81811b
- [Misc][BE] Type coverage for vllm/compilation [3/3] (#31748) · ad8818bb
  Lucas Kabela authored Jan 12, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  ad8818bb
- [Misc] Change log level for batch queue log (#32192) · 08e8e99c
  Nicolò Lucchesi authored Jan 12, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  08e8e99c
- [BugFix] scheduler: Fix ordering preserving of skipped requests (#32173) · 2be765b6
  Or Ozeri authored Jan 12, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  2be765b6
- [Misc] Set default torch num threads for input processing (#31879) · 16abe6b8
  Roger Wang authored Jan 12, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  16abe6b8
- [Refactor] EPLB rebalance algo to NumPy (#30697) · 1eb61ab3
  Ilya Markov authored Jan 12, 2026
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
  1eb61ab3
- [BugFix] fix FusedMoE.make_expert_params_mapping in EXAONE-MoE (#32196) · 3d962d72
  Kyungmin Lee authored Jan 13, 2026
```
Signed-off-by: lkm2835 <lkm2835@gmail.com>
```
  3d962d72
- [3/N][Attention] Move AttentionMetadata-related code from utils.py to backend.py (#32054) · 20228cb8
  Matthew Bonanni authored Jan 12, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  20228cb8
- [Benchmark] Share data between SLA runs (#32184) · 7c0d3c51
  Cyrus Leung authored Jan 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7c0d3c51
- [Misc][PD] Fix `get_attn_backend` usage in transfer connectors (#31988) · 5b681074
  Nicolò Lucchesi authored Jan 12, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  5b681074
- [Bugfix] Fix stale SSM state for new Mamba requests scheduled as decode (#32118) · 8fb2c135
  Asaf Joseph Gardin authored Jan 12, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
  8fb2c135
- [Model] Standardize pooling heads (#32148) · 8863c2b2
  Cyrus Leung authored Jan 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8863c2b2
- [FIX] Add NO_MUL activation support for modular kernel path (#31528) · 3f72639d
  danielafrimi authored Jan 12, 2026
```
Signed-off-by: dafrimi <dafrimi@nvidia.com>
Signed-off-by: <>
Co-authored-by: root <root@gpu-267.slurm-workers-slurm.slurm.svc.cluster.local>
Co-authored-by: root <root@gpu-537.slurm-workers-slurm.slurm.svc.cluster.local>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: root <root@pool0-01777.cm.cluster>
```
  3f72639d
- [MODEL] New model support for kakaocorp/kanana-1.5-v-3b-instruct (#29384) · 6bc9c847
  Jaehyun An authored Jan 13, 2026
```
Signed-off-by: Jaehyun An <steve.ai@kakaocorp.com>
```
  6bc9c847
- Add K-EXAONE-236B-A23B (#31621) · 63ed2409
  Kyungmin Lee authored Jan 13, 2026
```
Signed-off-by: lkm2835 <lkm2835@gmail.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: lgai-exaone <exaonemodels@lgresearch.ai>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  63ed2409
- doc: Update model references in supported_models.md (#32188) · 95e53d90
  Andy Zhang authored Jan 13, 2026
  
  95e53d90
- [ROCm] [Bugfix] Fix order of mori build in Dockerfile.rocm_base (#32179) · 0346396e
  TJian authored Jan 12, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  0346396e
- doc: Update model name for Qwen3-Coder in documentation (#32185) · e68b0dad
  Andy Zhang authored Jan 12, 2026
```
Signed-off-by: Andy Zhang <xiazhang@microsoft.com>
```
  e68b0dad
- OffloadingConnector: Add cpu_bytes_to_use configuration (#24498) · 9cddbdba
  Or Ozeri authored Jan 12, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  9cddbdba
- [Feature] Support recording expert indices for rollout router replay (#28284) · 49e6b86c
  Hongxin Xu authored Jan 12, 2026
```
Signed-off-by: xhx1022 <1737006628@qq.com>
Signed-off-by: Hongxin Xu <70438206+xhx1022@users.noreply.github.com>
Signed-off-by: arlenxu <arlenxu@tencent.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: arlenxu <arlenxu@tencent.com>
```
  49e6b86c
- [P/D] Refactor mooncake connector sender thread using async coroutines (#31573) · 0565f1fd
  dtc authored Jan 12, 2026
```
Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
```
  0565f1fd
- [Bugfix] Fix missing scale passing for encoder Triton Attention implementation (#32149) · 9dbe1fe9
  Isotr0py authored Jan 12, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  9dbe1fe9
- [Doc] Add documentation for offline API docs feature (#32134) · a5f89ae2
  RickyChen / 陳昭儒 authored Jan 12, 2026
```
Signed-off-by: rickychen-infinirc <ricky.chen@infinirc.com>
```
  a5f89ae2
- [Doc] Improve LoRA docs (#32159) · 05e89812
  Jee Jee Li authored Jan 12, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  05e89812
- [doc] fix broken links (#32158) · 899541bd
  XlKsyt authored Jan 12, 2026
```
Signed-off-by: minimAluminiumalism <caixuesen@outlook.com>
```
  899541bd
- [Frontend] Fix Flaky MCP Streaming Test (#32153) · d7b2e570
  daniel-salib authored Jan 12, 2026
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
```
  d7b2e570
- [cpu][bench] Add Fused MoE Micro Benchmark for CPU Backend (#32092) · 5e034f2e
  Andika Rachman authored Jan 12, 2026
```
Signed-off-by: andikarachman <andika.rachman.y@gmail.com>
```
  5e034f2e
- [Misc] Disable default `--ready-check-timeout-sec` extra call in vllm bench (#30975) · 22970c16
  Nicolò Lucchesi authored Jan 12, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  22970c16
- [Model] Remove incorrect `SupportsPP` from MTP models (#32150) · 600aaab8
  Cyrus Leung authored Jan 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  600aaab8
- [Model] Improve multimodal pooling examples (#32085) · 60446cd6
  wang.yuqi authored Jan 12, 2026
```
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  60446cd6
- [Model] Avoid hardcoding pooling type (#32119) · 9101dc75
  Cyrus Leung authored Jan 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9101dc75
- [Model Runner V2] Remove async barrier (#32083) · 025a32f9
  Woosuk Kwon authored Jan 11, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  025a32f9
11 Jan, 2026 7 commits
- [Model Runner V2] Skip building deprecated fields in attn metadata (#32132) · 19504ac0
  Woosuk Kwon authored Jan 11, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  19504ac0
- [CI] fix `test_concat_and_cache_mla_rope_fused` (#32117) · 3df619ac
  Jiangyun Zhu authored Jan 11, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  3df619ac
- fix offline inference chat response prompt (#32088) · d74132ca
  Ning Xie authored Jan 11, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  d74132ca
- [FixBug] Improve exception string in `tensorizer.py` (#31680) · a34abc49
  maang authored Jan 11, 2026
```
Signed-off-by: maang <maang_h@163.com>
Signed-off-by: maang-h <55082429+maang-h@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  a34abc49
- [Misc] fix this log format not space (#32112) · d70249e2
  rongfu.leng authored Jan 11, 2026
```
Signed-off-by: lengrongfu <lenronfu@gmail.com>
```
  d70249e2
- [CI/Build] Separate out flaky responses API tests (#32110) · a3745321
  Cyrus Leung authored Jan 11, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a3745321
- [Misc] Make `scipy` as optional audio/benchmark dependency (#32096) · cee7436a
  Isotr0py authored Jan 11, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  cee7436a