Commits · 4ff8c3c8f9ece010a1d0e376f5cc1b468b95f366 · OpenDAS / vllm_cscc

09 Mar, 2026 2 commits

[Examples][1/n] Resettle basic examples. (#35579) · dcf8862f

wang.yuqi authored Mar 09, 2026

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

dcf8862f

Allow `markdownlint` to run locally (#36398) · a0f44bb6
Harry Mellor authored Mar 09, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a0f44bb6

06 Mar, 2026 1 commit
- [Bugfix] Fix simple Mistral-Small example (#36156) · de00ebea
  Cyrus Leung authored Mar 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  de00ebea
05 Mar, 2026 2 commits

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

[Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
66a22096

04 Mar, 2026 4 commits
- docs: add README for logits_processor examples (#35933) · 3417ba56
  Dr Alex Mitre authored Mar 04, 2026
  
  3417ba56
- [BugFix] Fix implicit and incorrect assumption on ECConnector is_producer (#34783) · 6aa6ad89
  Qi Wang authored Mar 04, 2026
```
Signed-off-by: Qi Wang <qiwa@nvidia.com>
```
  6aa6ad89
- [Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d
  Kunshang Ji authored Mar 04, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  16d2ad1d
- [ROCm][CI] Support async weight transfer example with platform-aware determinism (#35710) · f7da9cdf
  Andreas Karatzas authored Mar 03, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  f7da9cdf
03 Mar, 2026 1 commit
- [Model] Add support for nvidia/llama-nemotron-rerank-vl-1b-v2 (#35735) · c8b678e5
  Jakub Zakrzewski authored Mar 03, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
  c8b678e5
02 Mar, 2026 2 commits
- [BUG] Fix rlhf_async example (#35788) · cad21918
  Aaron Hao authored Mar 02, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  cad21918
- [Spec Decode] Add hidden states extraction system (#33736) · 9433acb8
  Fynn Schmitt-Ulms authored Mar 02, 2026
```
Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
```
  9433acb8
27 Feb, 2026 1 commit

[Feat][RL][2/2] Native Weight Syncing API: IPC (#34171) · 2ce6f3cf

Aaron Hao authored Feb 27, 2026


Signed-off-by: hao-aaron <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Signed-off-by: ahao-anyscale <ahao@anyscale.com>

2ce6f3cf

26 Feb, 2026 2 commits
- [WideEP] Remove pplx all2all backend (#33724) · eb19955c
  Tyler Michael Smith authored Feb 26, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  eb19955c
- [Model] Add nvidia/llama-nemotron-embed-vl-1b-v2 multimodal embedding model (#35297) · 111d8690
  Jakub Zakrzewski authored Feb 26, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
  111d8690
23 Feb, 2026 1 commit
- [RL] Validation for pause_mode='keep' (#34992) · 596ed1f0
  Aaron Hao authored Feb 23, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  596ed1f0
22 Feb, 2026 1 commit

[New Model] Add ColModernVBERT (#34558) · 970861ac

Athrael Soju authored Feb 22, 2026


Signed-off-by: Athrael Soju <athrael.soju@gmail.com>
Signed-off-by: athrael-soju <athrael-soju@users.noreply.github.com>

970861ac

21 Feb, 2026 4 commits
- [PD] Change kv_load_failure_policy Default from "recompute" to "fail" (#34896) · ab6f3487
  Nicolò Lucchesi authored Feb 21, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  ab6f3487
- [feat] Add per-block extra_keys to KV events (#33304) · a0fe7ea2
  zhongdaor-nv authored Feb 20, 2026
```
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a0fe7ea2
- [Frontend] Support multimodal inputs for late-interaction scoring (ColQwen3) +... · 5719a4e4
  Kata Coder authored Feb 21, 2026
```
[Frontend] Support multimodal inputs for late-interaction scoring (ColQwen3) + NewModel: nvidia/nemotron-colembed (#34574)
Signed-off-by: craftsangjae <craftsangjae@gmail.com>
```
  5719a4e4
- [CI/Build] Add opentelemetry libs in default vllm build (requirements/common.txt) (#34466) · e739c29e
  Vlad Tiberiu Mihailescu authored Feb 20, 2026
```
Signed-off-by: Vlad Mihailescu <vtmihailescu@gmail.com>
```
  e739c29e
17 Feb, 2026 2 commits
- [CI][BugFix] ShellCheck cleanup to remove baseline and preserve runtime behavior (#34514) · c61a98f5
  junuxyz authored Feb 17, 2026
```
Signed-off-by: junuxyz <216036880+junuxyz@users.noreply.github.com>
```
  c61a98f5
- [Bugfix] Fix 'remove_instance_endpoint' method logic in disagg_proxy_demo (#32922) · ad65177a
  ChenqianCao authored Feb 17, 2026
```
Signed-off-by: ChenqianCao <39755070+ChenqianCao@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ad65177a
16 Feb, 2026 1 commit
- (bugfix): Fixed encode in LLM entrypoint for IOProcessr plugin prompts (#34618) · 6930becd
  Christian Pinto authored Feb 16, 2026
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  6930becd
14 Feb, 2026 2 commits

[Misc] Update tests and examples for Prithvi/Terratorch models (#34416) · 342a7cda
Christian Pinto authored Feb 14, 2026
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
342a7cda

[new model] add COLQwen3 code & Inference (#34398) · d1ea65d0

Kata Coder authored Feb 14, 2026


Signed-off-by: craftsangjae <craftsangjae@gmail.com>
Signed-off-by: katacoder <craftsangjae@gmail.com>

d1ea65d0

13 Feb, 2026 2 commits

Extend ColBERT support to non-standard BERT backbones (#34170) · 071d863e
Ilya Boytsov authored Feb 13, 2026
```
Signed-off-by: Ilya Boytsov <ilya.boytsov@aleph-alpha.com>
```
071d863e

[Core] Move pause and resume functions into engine (#34125) · dddbff46

Aaron Hao authored Feb 13, 2026


Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Signed-off-by: hao-aaron <ahao@anyscale.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

dddbff46

11 Feb, 2026 2 commits
- [model] support FunASR model (#33247) · 21dfb842
  AllenDou authored Feb 11, 2026
```
Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>
```
  21dfb842
- [Misc] Add run one batch script that supports profiling (#32968) · ba0511fd
  Lucas Wilkinson authored Feb 10, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  ba0511fd
10 Feb, 2026 3 commits
- [Docs] Fix format error in KV load failure recovery doc (#34137) · cbea11c9
  zzaebok authored Feb 10, 2026
```
Signed-off-by: Jaebok Lee <jaebok9541@naver.com>
```
  cbea11c9
- [Bugfix] Fix `--trust-remote-code` conflict (#34218) · 2c32558a
  Cyrus Leung authored Feb 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2c32558a
- [Doc] Update usage of `--limit-mm-per-prompt` (#34148) · 25e48a3a
  Cyrus Leung authored Feb 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  25e48a3a
09 Feb, 2026 1 commit
- [Frontend][last/5] Make pooling entrypoints request schema consensus. (#31127) · 22b64948
  wang.yuqi authored Feb 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  22b64948
07 Feb, 2026 1 commit

[Feat][RL] Pause and Resume with keep requests for single engine (#32351) · 89a385d7

Aaron Hao authored Feb 06, 2026


Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

89a385d7

06 Feb, 2026 1 commit

[Docs] Improve documentation (#33799) · 6e7b1c4b

SorenDreano authored Feb 06, 2026


Co-authored-by: Soren Dreano <soren@numind.ai>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

6e7b1c4b

05 Feb, 2026 3 commits

[Spec Decode] Unified Parallel Drafting (#32887) · af3162d3
Benjamin Chislett authored Feb 05, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
af3162d3

[Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943) · c1858b7e

Aaron Hao authored Feb 05, 2026


Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: SumanthRH <sumanthrh99@gmail.com>

c1858b7e

feat: Add ColBERT late interaction model support (#33686) · 439afa4e

Ilya Boytsov authored Feb 05, 2026


Signed-off-by: Ilya Boytsov <ilyaboytsov1805@gmail.com>
Signed-off-by: Ilya Boytsov <boytsovpanamera@mail.ru>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

439afa4e

04 Feb, 2026 1 commit
- [Frontend][4/n] Make pooling entrypoints request schema consensus | ScoreRequest (#33060) · 1b8fe6f7
  wang.yuqi authored Feb 04, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  1b8fe6f7