Commits · 8317cedc7718301866963400646b1d624a6471ea · OpenDAS / vllm_cscc

22 Apr, 2026 3 commits

[Fix][MoRI] Align MoRI-IO message format with P2pNcclConnector and vllm-router (#39565) · ac58e2a1
Simon Danielsson authored Apr 23, 2026
```
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Matvei Pashkovskii <mpashkov@amd.com>
```
ac58e2a1

support hotwords for FunASR model (#39674) · 9047288b

AllenDou authored Apr 22, 2026


Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>

9047288b

[ROCm][P/D][MORI][BugFix] Ensure correct api is used when making requests to... · cefa5281

rasmith authored Apr 21, 2026


[ROCm][P/D][MORI][BugFix] Ensure correct api is used when making requests to prefill / decode nodes (#39835)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>

cefa5281

21 Apr, 2026 3 commits

Add Granite 4.1 Vision as built-in multimodal model (#40282) · d249a9e9

artem-spector authored Apr 21, 2026


Signed-off-by: Artem Spector <artems@il.ibm.com>
Signed-off-by: artemspector <artems@il.ibm.com>
Co-authored-by: artemspector <artems@il.ibm.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

d249a9e9

[Frontend] Remove frontend pooling multi task support. (#37861) · d2e2e856

wang.yuqi authored Apr 21, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

d2e2e856

[MM][Misc] Support image+video mixed inputs (per prompt) for VLM examples (#40335) · b4784001
Shanshan Shen authored Apr 21, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
b4784001

18 Apr, 2026 2 commits

[Refactor] Drop direct dependency on librosa (#39079) · 153ba7f0
Nick Cao authored Apr 18, 2026
```
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
153ba7f0

[Frontend] Add multimodal support to /inference/v1/generate endpoint (#38405) · 80b18230

Nithin Chalapathi authored Apr 17, 2026


Signed-off-by: Nithin Chalapathi <nithin.ch10@gmail.com>
Signed-off-by: Nithin Chalapathi <nithinc@berkeley.edu>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

80b18230

17 Apr, 2026 1 commit
- [Examples] Resettle Observability examples. (#40123) · 8d2cff81
  wang.yuqi authored Apr 17, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  8d2cff81
12 Apr, 2026 1 commit
- [HMA] [KVEvent] Enable GPU-side KV events for HMA (#37688) · cc07dad7
  Martin Hickey authored Apr 12, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: Or Ozeri <or@ozery.com>
```
  cc07dad7
10 Apr, 2026 3 commits

[New Model]: jinaai/jina-reranker-v3 (#38800) · cb5f7501
wang.yuqi authored Apr 10, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
cb5f7501

[model] support FireRedLID (#39290) · 967146e7

PatchyTIS authored Apr 10, 2026


Signed-off-by: PatchouliTaisa <patchychen@tencent.com>
Co-authored-by: PatchouliTaisa <patchychen@tencent.com>

967146e7

Add EXAONE-4.5 (#39388) · e7a1387e

Kyungmin Lee authored Apr 10, 2026


Signed-off-by: lkm2835 <lkm2835@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

e7a1387e

08 Apr, 2026 2 commits

[Tool] `adjust_request` to reasoning parser, and Gemma4 fixes (#39027) · 8477fe42

Ben Browning authored Apr 08, 2026


Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Cursor <cursoragent@cursor.com>

8477fe42

[Docs] Add Phi-4-reasoning-vision to supported models + examples (#39232) · 7b80cd8a
Varun Sundar Rabindranath authored Apr 07, 2026
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
7b80cd8a

02 Apr, 2026 1 commit

[Model] Add support for Cheers multimodal model (#38788) · c0817e4d

bsliu authored Apr 02, 2026


Signed-off-by: bsliu <1187291748@qq.com>
Signed-off-by: 吴炳贤 <wubingxian24@mails.ucas.ac.cn>

c0817e4d

01 Apr, 2026 1 commit
- Fix shape comment in extract_hidden_states example (#38723) · fa246d52
  Fynn Schmitt-Ulms authored Apr 01, 2026
```
Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
```
  fa246d52
31 Mar, 2026 2 commits
- [EPD] update EPD script arguments (#36742) · 0c637391
  liuzhenwei authored Mar 31, 2026
```
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
```
  0c637391
- Fix document of torchrun_example.py (#31113) · aae3e688
  Maosheng Liao authored Mar 31, 2026
  
  aae3e688
29 Mar, 2026 1 commit
- [Feature] Add Qwen3-ForcedAligner support via token classification pooling (#35367) · d39b8daf
  haosdent authored Mar 29, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  d39b8daf
26 Mar, 2026 1 commit
- Add `/v1/chat/completions/batch` endpoint for batched chat completions (#38011) · 29080945
  Matej Rojec authored Mar 26, 2026
```
Signed-off-by: Matej Rojec <64556640+MatejRojec@users.noreply.github.com>
```
  29080945
25 Mar, 2026 3 commits
- [Cohere] Enable Cohere-Transcribe (#38120) · 7b54f60d
  Ekagra Ranjan authored Mar 25, 2026
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
  7b54f60d
- [Misc] Reorganize inputs (#35182) · ba2f0acc
  Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ba2f0acc
- [Mypy] Better fixes for the `mypy` issues in `vllm/config` (#37902) · d215d1ef
  Harry Mellor authored Mar 25, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d215d1ef
23 Mar, 2026 1 commit
- Fix AudioFlamingo3/MusicFlamingo HF parity and RoTE handling (#37643) · e7767ecc
  Lasha Koroshinadze authored Mar 22, 2026
```
Signed-off-by: Lasha <26011196+lashahub@users.noreply.github.com>
```
  e7767ecc
19 Mar, 2026 2 commits
- Comment fix for async rl example (#35244) · 4ee847e4
  Aaron Hao authored Mar 19, 2026
```
Signed-off-by: hao-aaron <ahao@anyscale.com>
```
  4ee847e4
- [BUG] Exclude SKIP_TENSORS from get_layer_size() + new weight sync example for dpep (#37334) · 5f82706a
  Aaron Hao authored Mar 18, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  5f82706a
18 Mar, 2026 1 commit

[docs] Add docs for new RL flows (#36188) · 47a1f11b

Aaron Hao authored Mar 18, 2026

Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

47a1f11b

17 Mar, 2026 3 commits
- [Model] Add ColQwen3.5 4.5B support (#36887) · c0745a85
  Athrael Soju authored Mar 17, 2026
```
Signed-off-by: Athrael Soju <athrael.soju@gmail.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  c0745a85
- [Models] Cohere ASR (#35809) · b5ca9c35
  Ekagra Ranjan authored Mar 17, 2026
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
  b5ca9c35
- [Chore] Replace all base64 usages with faster pybase64 package (#37290) · a836524d
  Isotr0py authored Mar 17, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a836524d
16 Mar, 2026 1 commit

[ROCm][P/D][MORI][BugFix] Add transfer_id for moriio_connector so... · 0024f39a

rasmith authored Mar 15, 2026


[ROCm][P/D][MORI][BugFix] Add transfer_id for moriio_connector so moriio_connector to restore P/D functionality (#34907)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>

0024f39a

12 Mar, 2026 2 commits
- [Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
  Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  53ec16a7
- [KV Connector] Support using FlexKV as KV Cache Offloading option. (#34328) · 8cb24d3a
  sfeiqiang authored Mar 12, 2026
```
Signed-off-by: phaedonsun <phaedonsun@tencent.com>
Co-authored-by: phaedonsun <phaedonsun@tencent.com>
```
  8cb24d3a
11 Mar, 2026 3 commits

Fix routed experts capture for hybrid models (Mamba + Attention) (#35744) · bea02cdf

Hongxin Xu authored Mar 11, 2026


Signed-off-by: arlenxu <arlenxu@tencent.com>
Signed-off-by: xhx1022 <1737006628@qq.com>
Co-authored-by: arlenxu <arlenxu@tencent.com>

bea02cdf

[Bugfix] Fix Mistral-small `--format` (#36782) · f33251ff
Silvia Colabrese authored Mar 11, 2026
```
Signed-off-by: 12010486 <silvia.colabrese@intel.com>
```
f33251ff

[Model] Add support for moonshotai/Kimi-Audio-7B-Instruct (#36127) · 42fadebe

tunglinwood authored Mar 11, 2026


Signed-off-by: tunglinwood <tunglinwood@gmail.com>
Signed-off-by: tunglinwood <tomwu.tunglin@gmail.com>
Signed-off-by: tunglinwood <113751333+tunglinwood@users.noreply.github.com>

42fadebe

10 Mar, 2026 1 commit
- Fix Qwen2.5-VL test for Transformers v5 (#36532) · c8851008
  Harry Mellor authored Mar 10, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c8851008
09 Mar, 2026 2 commits

[Examples][1/n] Resettle basic examples. (#35579) · dcf8862f

wang.yuqi authored Mar 09, 2026

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

dcf8862f

Allow `markdownlint` to run locally (#36398) · a0f44bb6
Harry Mellor authored Mar 09, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a0f44bb6