Commits · db4ede97434300e2dea211f7234024dd7fe34bfc · OpenDAS / vllm_cscc

07 Feb, 2026 8 commits
- [Model] Enable Step3p5ForCausalLM testing (#33755) · db4ede97
  Jee Jee Li authored Feb 07, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  db4ede97
- [Frontend]Add support for transcriptions and translations to run_batch (#33934) · 2cb2340f
  Pooya Davoodi authored Feb 07, 2026
```
Signed-off-by: Pooya Davoodi <pooya.davoodi@parasail.io>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  2cb2340f
- [torch.compile] Stop compiling identical artifacts (#34003) · 81fe69ca
  Richard Zou authored Feb 07, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  81fe69ca
- [Renderer] Define `render_cmpl` and `render_chat` (#34039) · edb359cc
  Cyrus Leung authored Feb 07, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  edb359cc
- Fix spelling errors (#33978) · 15a0b9e5
  lukec authored Feb 07, 2026
  
  15a0b9e5
- [Misc] Make `PlaceholderRange.get_num_embeds` a method (#34035) · 48312e57
  Cyrus Leung authored Feb 07, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  48312e57
- [Bugfix] Fix QK Norm+RoPE fusion pattern matching on B200+FP8 (#33967) · 90607718
  Ikenna authored Feb 06, 2026
```
Signed-off-by: Ikenna <ikennachifo@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  90607718
- [Feat][RL] Pause and Resume with keep requests for single engine (#32351) · 89a385d7
  Aaron Hao authored Feb 06, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  89a385d7
06 Feb, 2026 14 commits
- [bugfix] [ROCm] Fix premature CUDA initialization in platform detection (#33941) · 4a2d00ea
  kourosh hakhamaneshi authored Feb 06, 2026
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  4a2d00ea
- [Fix] Fix `logprobs=0` handling for `/inference/v1/generate` endpoint (#34010) · ae2e93f8
  Sumanth R Hegde authored Feb 06, 2026
```
Signed-off-by: SumanthRH <sumanthrh99@gmail.com>
```
  ae2e93f8
- [Refactor] Remove align block size logic in `moe_permute` (#33449) · 77c09e11
  Wentao Ye authored Feb 06, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  77c09e11
- [KV Connector] Add missing method overrides to MultiConnector (#33292) · aca59674
  Seiji Eicher authored Feb 06, 2026
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  aca59674
- [Refactor] Consolidate sequence normalization and enc-dec parsing (#33928) · cd8b405b
  Cyrus Leung authored Feb 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cd8b405b
- [ROCm][AITER] Fix AITER import regression for explicit backend selection (#33749) · 350ca72c
  Andreas Karatzas authored Feb 06, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  350ca72c
- [Bugfix] Fix models and tests for transformers v5 (#33977) · 85ee1d96
  Raushan Turganbay authored Feb 06, 2026
```
Signed-off-by: raushan <raushan@huggingface.co>
Signed-off-by: Raushan Turganbay <raushan.turganbay@alumni.nu.edu.kz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  85ee1d96
- [Bugfix][Model] Support LoRA on Qwen3 Output Embedding (#29816) · 2991dd3d
  Kurt Shuster authored Feb 06, 2026
```
Signed-off-by: kurt <kurt@thinkingmachines.ai>
```
  2991dd3d
- [torch.compile] Reorganize vllm/compilation and tests/compile (0/N for vLLM IR) (#33731) · ac32e66c
  Luka Govedič authored Feb 06, 2026
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: ProExpertProg <luka.govedic@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  ac32e66c
- support view_from_cpu_tensor on XPU (#33868) · e969a169
  Xinyu Chen authored Feb 06, 2026
```
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
```
  e969a169
- Onboard voyage-4-nano (#33720) · 96552566
  chengchengpei authored Feb 05, 2026
```
Signed-off-by: Chengcheng Pei <chengchengpei@outlook.com>
Signed-off-by: chengchengpei <5881383+chengchengpei@users.noreply.github.com>
Co-authored-by: chengchengpei <5881383+chengchengpei@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  96552566
- feat(frontend): early-fail tokenization guard for user requests (#31366) · a32cb49b
  Mingliang Li authored Feb 06, 2026
```
Signed-off-by: limingliang <limingliang@stepfun.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: limingliang <limingliang@stepfun.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a32cb49b
- [Perf] Disable clean_logits in deepgemm fp8_mqa_logits kernel (#33568) · 79028d43
  Xin Yang authored Feb 05, 2026
  
  79028d43
- [Feature] OTEL tracing during loading (#31162) · 325ab6b0
  emricksini-h authored Feb 06, 2026
  
  325ab6b0
05 Feb, 2026 18 commits

Adds padding and perf improvements to wvSplitK_fp8 (#33527) · d5c48001
Hashem Hashemi authored Feb 05, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
d5c48001
[Bugfix] Make MM batching more robust (#33817) · 116880a5
Cyrus Leung authored Feb 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
116880a5
Fix tokenizer test for renamed attr on Transformers v5 (#33902) · 1887acca
Harry Mellor authored Feb 05, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
1887acca
[Moe Refactor] Make Inplace Flag for FusedMoEModularKernel part of the constructor (#33375) · a57c8228
bnellnm authored Feb 05, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
a57c8228
[Spec Decode] Unified Parallel Drafting (#32887) · af3162d3
Benjamin Chislett authored Feb 05, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
af3162d3

[Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943) · c1858b7e

Aaron Hao authored Feb 05, 2026


Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: SumanthRH <sumanthrh99@gmail.com>

c1858b7e

[Bugfix] Fix step3p5 parser when using mtp (#33690) · 82914d2a
Mario Hong authored Feb 06, 2026
```
Signed-off-by: mariohong <mariohong128@gmail.com>
```
82914d2a
[Bugfix] Fix corner case of sparse embedding (#33886) · 1c3a221d
wang.yuqi authored Feb 05, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
1c3a221d

Enable Cross layers KV cache layout at NIXL Connector V2 (#33339) · 8322d4e4

liranschour authored Feb 05, 2026


Signed-off-by: Liran Schour <lirans@il.ibm.com>
Signed-off-by: liranschour <liranschour@users.noreply.github.com>
Co-authored-by: Or Ozeri <or@ozery.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

8322d4e4

[ROCm][Bugfix][CI] Fix hybrid models and their tests (Mamba/Jamba/Bamba) (#32710) · 3e472e81

Andreas Karatzas authored Feb 05, 2026


Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>

3e472e81

[Refactor] Move `task` outside of `PoolingParams.verify` (#33796) · 038914b7

Cyrus Leung authored Feb 05, 2026


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

038914b7

[KV Connector][Metrics] Do not count local prefix cache hits in connector queries (#30522) · 2abd9759
Mark McLoughlin authored Feb 05, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
2abd9759

[Bugfix] Fix ScoreMultiModalParam multi-document scoring returning single result (#33837) · 1f70313e

Andreas Karatzas authored Feb 05, 2026


Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

1f70313e

[CI][AMD][BugFix] Ensure VLLM_ROCM_USE_AITER is set so test_rocm_aiter_topk.py... · c1395f72

rasmith authored Feb 04, 2026


[CI][AMD][BugFix] Ensure VLLM_ROCM_USE_AITER is set so test_rocm_aiter_topk.py can run correctly (#33840)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>

c1395f72

[Minor] Include `StreamingInput` in inputs package (#33856) · add9f1fb
Nick Hill authored Feb 04, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
add9f1fb
[CI][Bugfix]: return McpCall for built-in MCP tools in non-streaming mode (#32762) · fb1270f1
Andreas Karatzas authored Feb 04, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
fb1270f1

[CI][torch.compile] Reduce e2e fusion test time (#33293) · 4d951353

Luka Govedič authored Feb 04, 2026


Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: ProExpertProg <luka.govedic@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

4d951353

feat: Add ColBERT late interaction model support (#33686) · 439afa4e

Ilya Boytsov authored Feb 05, 2026


Signed-off-by: Ilya Boytsov <ilyaboytsov1805@gmail.com>
Signed-off-by: Ilya Boytsov <boytsovpanamera@mail.ru>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

439afa4e