Commits · 3fb4b5fa7442f98d864a0563e50837292172a713 · OpenDAS / vllm_cscc

16 Mar, 2026 1 commit

[ROCm][P/D][MORI][BugFix] Add transfer_id for moriio_connector so... · 0024f39a

rasmith authored Mar 15, 2026


[ROCm][P/D][MORI][BugFix] Add transfer_id for moriio_connector so moriio_connector to restore P/D functionality (#34907)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>

0024f39a

12 Mar, 2026 2 commits
- [Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
  Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  53ec16a7
- [KV Connector] Support using FlexKV as KV Cache Offloading option. (#34328) · 8cb24d3a
  sfeiqiang authored Mar 12, 2026
```
Signed-off-by: phaedonsun <phaedonsun@tencent.com>
Co-authored-by: phaedonsun <phaedonsun@tencent.com>
```
  8cb24d3a
11 Mar, 2026 3 commits

Fix routed experts capture for hybrid models (Mamba + Attention) (#35744) · bea02cdf

Hongxin Xu authored Mar 11, 2026


Signed-off-by: arlenxu <arlenxu@tencent.com>
Signed-off-by: xhx1022 <1737006628@qq.com>
Co-authored-by: arlenxu <arlenxu@tencent.com>

bea02cdf

[Bugfix] Fix Mistral-small `--format` (#36782) · f33251ff
Silvia Colabrese authored Mar 11, 2026
```
Signed-off-by: 12010486 <silvia.colabrese@intel.com>
```
f33251ff

[Model] Add support for moonshotai/Kimi-Audio-7B-Instruct (#36127) · 42fadebe

tunglinwood authored Mar 11, 2026


Signed-off-by: tunglinwood <tunglinwood@gmail.com>
Signed-off-by: tunglinwood <tomwu.tunglin@gmail.com>
Signed-off-by: tunglinwood <113751333+tunglinwood@users.noreply.github.com>

42fadebe

10 Mar, 2026 1 commit
- Fix Qwen2.5-VL test for Transformers v5 (#36532) · c8851008
  Harry Mellor authored Mar 10, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c8851008
09 Mar, 2026 2 commits

[Examples][1/n] Resettle basic examples. (#35579) · dcf8862f

wang.yuqi authored Mar 09, 2026

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

dcf8862f

Allow `markdownlint` to run locally (#36398) · a0f44bb6
Harry Mellor authored Mar 09, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a0f44bb6

06 Mar, 2026 1 commit
- [Bugfix] Fix simple Mistral-Small example (#36156) · de00ebea
  Cyrus Leung authored Mar 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  de00ebea
05 Mar, 2026 2 commits

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

[Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
66a22096

04 Mar, 2026 4 commits
- docs: add README for logits_processor examples (#35933) · 3417ba56
  Dr Alex Mitre authored Mar 04, 2026
  
  3417ba56
- [BugFix] Fix implicit and incorrect assumption on ECConnector is_producer (#34783) · 6aa6ad89
  Qi Wang authored Mar 04, 2026
```
Signed-off-by: Qi Wang <qiwa@nvidia.com>
```
  6aa6ad89
- [Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d
  Kunshang Ji authored Mar 04, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  16d2ad1d
- [ROCm][CI] Support async weight transfer example with platform-aware determinism (#35710) · f7da9cdf
  Andreas Karatzas authored Mar 03, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  f7da9cdf
03 Mar, 2026 1 commit
- [Model] Add support for nvidia/llama-nemotron-rerank-vl-1b-v2 (#35735) · c8b678e5
  Jakub Zakrzewski authored Mar 03, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
  c8b678e5
02 Mar, 2026 2 commits
- [BUG] Fix rlhf_async example (#35788) · cad21918
  Aaron Hao authored Mar 02, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  cad21918
- [Spec Decode] Add hidden states extraction system (#33736) · 9433acb8
  Fynn Schmitt-Ulms authored Mar 02, 2026
```
Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
```
  9433acb8
27 Feb, 2026 1 commit

[Feat][RL][2/2] Native Weight Syncing API: IPC (#34171) · 2ce6f3cf

Aaron Hao authored Feb 27, 2026


Signed-off-by: hao-aaron <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Signed-off-by: ahao-anyscale <ahao@anyscale.com>

2ce6f3cf

26 Feb, 2026 2 commits
- [WideEP] Remove pplx all2all backend (#33724) · eb19955c
  Tyler Michael Smith authored Feb 26, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  eb19955c
- [Model] Add nvidia/llama-nemotron-embed-vl-1b-v2 multimodal embedding model (#35297) · 111d8690
  Jakub Zakrzewski authored Feb 26, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
  111d8690
23 Feb, 2026 1 commit
- [RL] Validation for pause_mode='keep' (#34992) · 596ed1f0
  Aaron Hao authored Feb 23, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  596ed1f0
22 Feb, 2026 1 commit

[New Model] Add ColModernVBERT (#34558) · 970861ac

Athrael Soju authored Feb 22, 2026


Signed-off-by: Athrael Soju <athrael.soju@gmail.com>
Signed-off-by: athrael-soju <athrael-soju@users.noreply.github.com>

970861ac

21 Feb, 2026 4 commits
- [PD] Change kv_load_failure_policy Default from "recompute" to "fail" (#34896) · ab6f3487
  Nicolò Lucchesi authored Feb 21, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  ab6f3487
- [feat] Add per-block extra_keys to KV events (#33304) · a0fe7ea2
  zhongdaor-nv authored Feb 20, 2026
```
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a0fe7ea2
- [Frontend] Support multimodal inputs for late-interaction scoring (ColQwen3) +... · 5719a4e4
  Kata Coder authored Feb 21, 2026
```
[Frontend] Support multimodal inputs for late-interaction scoring (ColQwen3) + NewModel: nvidia/nemotron-colembed (#34574)
Signed-off-by: craftsangjae <craftsangjae@gmail.com>
```
  5719a4e4
- [CI/Build] Add opentelemetry libs in default vllm build (requirements/common.txt) (#34466) · e739c29e
  Vlad Tiberiu Mihailescu authored Feb 20, 2026
```
Signed-off-by: Vlad Mihailescu <vtmihailescu@gmail.com>
```
  e739c29e
17 Feb, 2026 2 commits
- [CI][BugFix] ShellCheck cleanup to remove baseline and preserve runtime behavior (#34514) · c61a98f5
  junuxyz authored Feb 17, 2026
```
Signed-off-by: junuxyz <216036880+junuxyz@users.noreply.github.com>
```
  c61a98f5
- [Bugfix] Fix 'remove_instance_endpoint' method logic in disagg_proxy_demo (#32922) · ad65177a
  ChenqianCao authored Feb 17, 2026
```
Signed-off-by: ChenqianCao <39755070+ChenqianCao@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ad65177a
16 Feb, 2026 1 commit
- (bugfix): Fixed encode in LLM entrypoint for IOProcessr plugin prompts (#34618) · 6930becd
  Christian Pinto authored Feb 16, 2026
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  6930becd
14 Feb, 2026 2 commits

[Misc] Update tests and examples for Prithvi/Terratorch models (#34416) · 342a7cda
Christian Pinto authored Feb 14, 2026
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
342a7cda

[new model] add COLQwen3 code & Inference (#34398) · d1ea65d0

Kata Coder authored Feb 14, 2026


Signed-off-by: craftsangjae <craftsangjae@gmail.com>
Signed-off-by: katacoder <craftsangjae@gmail.com>

d1ea65d0

13 Feb, 2026 2 commits

Extend ColBERT support to non-standard BERT backbones (#34170) · 071d863e
Ilya Boytsov authored Feb 13, 2026
```
Signed-off-by: Ilya Boytsov <ilya.boytsov@aleph-alpha.com>
```
071d863e

[Core] Move pause and resume functions into engine (#34125) · dddbff46

Aaron Hao authored Feb 13, 2026


Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Signed-off-by: hao-aaron <ahao@anyscale.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

dddbff46

11 Feb, 2026 2 commits
- [model] support FunASR model (#33247) · 21dfb842
  AllenDou authored Feb 11, 2026
```
Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>
```
  21dfb842
- [Misc] Add run one batch script that supports profiling (#32968) · ba0511fd
  Lucas Wilkinson authored Feb 10, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  ba0511fd
10 Feb, 2026 3 commits
- [Docs] Fix format error in KV load failure recovery doc (#34137) · cbea11c9
  zzaebok authored Feb 10, 2026
```
Signed-off-by: Jaebok Lee <jaebok9541@naver.com>
```
  cbea11c9
- [Bugfix] Fix `--trust-remote-code` conflict (#34218) · 2c32558a
  Cyrus Leung authored Feb 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2c32558a
- [Doc] Update usage of `--limit-mm-per-prompt` (#34148) · 25e48a3a
  Cyrus Leung authored Feb 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  25e48a3a