Commits · 89a385d79fb511f439f8ebe9d38d6811b5b24a91 · OpenDAS / vllm_cscc

07 Feb, 2026 1 commit

[Feat][RL] Pause and Resume with keep requests for single engine (#32351) · 89a385d7

Aaron Hao authored Feb 06, 2026


Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

89a385d7

06 Feb, 2026 14 commits
- [bugfix] [ROCm] Fix premature CUDA initialization in platform detection (#33941) · 4a2d00ea
  kourosh hakhamaneshi authored Feb 06, 2026
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  4a2d00ea
- [Fix] Fix `logprobs=0` handling for `/inference/v1/generate` endpoint (#34010) · ae2e93f8
  Sumanth R Hegde authored Feb 06, 2026
```
Signed-off-by: SumanthRH <sumanthrh99@gmail.com>
```
  ae2e93f8
- [Refactor] Remove align block size logic in `moe_permute` (#33449) · 77c09e11
  Wentao Ye authored Feb 06, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  77c09e11
- [KV Connector] Add missing method overrides to MultiConnector (#33292) · aca59674
  Seiji Eicher authored Feb 06, 2026
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  aca59674
- [Refactor] Consolidate sequence normalization and enc-dec parsing (#33928) · cd8b405b
  Cyrus Leung authored Feb 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cd8b405b
- [ROCm][AITER] Fix AITER import regression for explicit backend selection (#33749) · 350ca72c
  Andreas Karatzas authored Feb 06, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  350ca72c
- [Bugfix] Fix models and tests for transformers v5 (#33977) · 85ee1d96
  Raushan Turganbay authored Feb 06, 2026
```
Signed-off-by: raushan <raushan@huggingface.co>
Signed-off-by: Raushan Turganbay <raushan.turganbay@alumni.nu.edu.kz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  85ee1d96
- [Bugfix][Model] Support LoRA on Qwen3 Output Embedding (#29816) · 2991dd3d
  Kurt Shuster authored Feb 06, 2026
```
Signed-off-by: kurt <kurt@thinkingmachines.ai>
```
  2991dd3d
- [torch.compile] Reorganize vllm/compilation and tests/compile (0/N for vLLM IR) (#33731) · ac32e66c
  Luka Govedič authored Feb 06, 2026
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: ProExpertProg <luka.govedic@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  ac32e66c
- support view_from_cpu_tensor on XPU (#33868) · e969a169
  Xinyu Chen authored Feb 06, 2026
```
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
```
  e969a169
- Onboard voyage-4-nano (#33720) · 96552566
  chengchengpei authored Feb 05, 2026
```
Signed-off-by: Chengcheng Pei <chengchengpei@outlook.com>
Signed-off-by: chengchengpei <5881383+chengchengpei@users.noreply.github.com>
Co-authored-by: chengchengpei <5881383+chengchengpei@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  96552566
- feat(frontend): early-fail tokenization guard for user requests (#31366) · a32cb49b
  Mingliang Li authored Feb 06, 2026
```
Signed-off-by: limingliang <limingliang@stepfun.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: limingliang <limingliang@stepfun.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a32cb49b
- [Perf] Disable clean_logits in deepgemm fp8_mqa_logits kernel (#33568) · 79028d43
  Xin Yang authored Feb 05, 2026
  
  79028d43
- [Feature] OTEL tracing during loading (#31162) · 325ab6b0
  emricksini-h authored Feb 06, 2026
  
  325ab6b0
05 Feb, 2026 18 commits

Adds padding and perf improvements to wvSplitK_fp8 (#33527) · d5c48001
Hashem Hashemi authored Feb 05, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
d5c48001
[Bugfix] Make MM batching more robust (#33817) · 116880a5
Cyrus Leung authored Feb 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
116880a5
Fix tokenizer test for renamed attr on Transformers v5 (#33902) · 1887acca
Harry Mellor authored Feb 05, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
1887acca
[Moe Refactor] Make Inplace Flag for FusedMoEModularKernel part of the constructor (#33375) · a57c8228
bnellnm authored Feb 05, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
a57c8228
[Spec Decode] Unified Parallel Drafting (#32887) · af3162d3
Benjamin Chislett authored Feb 05, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
af3162d3

[Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943) · c1858b7e

Aaron Hao authored Feb 05, 2026


Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: SumanthRH <sumanthrh99@gmail.com>

c1858b7e

[Bugfix] Fix step3p5 parser when using mtp (#33690) · 82914d2a
Mario Hong authored Feb 06, 2026
```
Signed-off-by: mariohong <mariohong128@gmail.com>
```
82914d2a
[Bugfix] Fix corner case of sparse embedding (#33886) · 1c3a221d
wang.yuqi authored Feb 05, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
1c3a221d

Enable Cross layers KV cache layout at NIXL Connector V2 (#33339) · 8322d4e4

liranschour authored Feb 05, 2026


Signed-off-by: Liran Schour <lirans@il.ibm.com>
Signed-off-by: liranschour <liranschour@users.noreply.github.com>
Co-authored-by: Or Ozeri <or@ozery.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

8322d4e4

[ROCm][Bugfix][CI] Fix hybrid models and their tests (Mamba/Jamba/Bamba) (#32710) · 3e472e81

Andreas Karatzas authored Feb 05, 2026


Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>

3e472e81

[Refactor] Move `task` outside of `PoolingParams.verify` (#33796) · 038914b7

Cyrus Leung authored Feb 05, 2026


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

038914b7

[KV Connector][Metrics] Do not count local prefix cache hits in connector queries (#30522) · 2abd9759
Mark McLoughlin authored Feb 05, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
2abd9759

[Bugfix] Fix ScoreMultiModalParam multi-document scoring returning single result (#33837) · 1f70313e

Andreas Karatzas authored Feb 05, 2026


Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

1f70313e

[CI][AMD][BugFix] Ensure VLLM_ROCM_USE_AITER is set so test_rocm_aiter_topk.py... · c1395f72

rasmith authored Feb 04, 2026


[CI][AMD][BugFix] Ensure VLLM_ROCM_USE_AITER is set so test_rocm_aiter_topk.py can run correctly (#33840)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>

c1395f72

[Minor] Include `StreamingInput` in inputs package (#33856) · add9f1fb
Nick Hill authored Feb 04, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
add9f1fb
[CI][Bugfix]: return McpCall for built-in MCP tools in non-streaming mode (#32762) · fb1270f1
Andreas Karatzas authored Feb 04, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
fb1270f1

[CI][torch.compile] Reduce e2e fusion test time (#33293) · 4d951353

Luka Govedič authored Feb 04, 2026


Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: ProExpertProg <luka.govedic@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

4d951353

feat: Add ColBERT late interaction model support (#33686) · 439afa4e

Ilya Boytsov authored Feb 05, 2026


Signed-off-by: Ilya Boytsov <ilyaboytsov1805@gmail.com>
Signed-off-by: Ilya Boytsov <boytsovpanamera@mail.ru>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

439afa4e

04 Feb, 2026 7 commits
- [Core] Don't schedule spec tokens with prefill chunks (#33652) · fa4e0fb0
  Nick Hill authored Feb 04, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  fa4e0fb0
- Revert "[torch.compile] Significantly speed up cold start times" (#33820) · 9f14c922
  Richard Zou authored Feb 04, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  9f14c922
- [Bugfix] Support `RotaryEmbedding` CustomOp for gpt-oss (#33800) · 4292c90a
  Simon Danielsson authored Feb 04, 2026
```
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
```
  4292c90a
- [rocm][ray] Fix: Unify Ray device visibility handling across CUDA and ROCm (#33308) · 2f6d17cb
  kourosh hakhamaneshi authored Feb 04, 2026
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  2f6d17cb
- [Bugfix] Fix interns1-pro initialization and PP (#33793) · 192ad464
  Isotr0py authored Feb 05, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  192ad464
- [Bugfix] Fix `normalize` still being passed to `PoolerConfig` (#33794) · 80f921ba
  Cyrus Leung authored Feb 04, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  80f921ba
- [KV Connector][BugFix] scheduler: Delay freeing blocks of aborted async loads (#32255) · 8e326908
  Or Ozeri authored Feb 04, 2026
```
Fixes a not-yet-reported case where it was possible for blocks to be
freed by an abort before an async transfer completed, resulting
in corrupted KV data.
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  8e326908