Commits · 84ac1d27a013814b49afadad241f2dc795cc2c4a · OpenDAS / vllm_cscc

09 May, 2026 1 commit
- add step3p5 mtp3 · 84ac1d27
  zhangning3 authored May 09, 2026
  
  84ac1d27
24 Mar, 2026 1 commit
- sync v0.18.0 · eefa41c1
  zhuwenwen authored Mar 24, 2026
  
  eefa41c1
18 Mar, 2026 1 commit

[docs] Add docs for new RL flows (#36188) · 47a1f11b

Aaron Hao authored Mar 18, 2026

Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

47a1f11b

17 Mar, 2026 1 commit

[Models] Cohere ASR (#35809) · b5ca9c35

Ekagra Ranjan authored Mar 17, 2026


Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>

b5ca9c35

12 Mar, 2026 1 commit
- [KV Connector] Support using FlexKV as KV Cache Offloading option. (#34328) · 8cb24d3a
  sfeiqiang authored Mar 12, 2026
```
Signed-off-by: phaedonsun <phaedonsun@tencent.com>
Co-authored-by: phaedonsun <phaedonsun@tencent.com>
```
  8cb24d3a
11 Mar, 2026 3 commits

Fix routed experts capture for hybrid models (Mamba + Attention) (#35744) · bea02cdf

Hongxin Xu authored Mar 11, 2026


Signed-off-by: arlenxu <arlenxu@tencent.com>
Signed-off-by: xhx1022 <1737006628@qq.com>
Co-authored-by: arlenxu <arlenxu@tencent.com>

bea02cdf

[Bugfix] Fix Mistral-small `--format` (#36782) · f33251ff
Silvia Colabrese authored Mar 11, 2026
```
Signed-off-by: 12010486 <silvia.colabrese@intel.com>
```
f33251ff

[Model] Add support for moonshotai/Kimi-Audio-7B-Instruct (#36127) · 42fadebe

tunglinwood authored Mar 11, 2026


Signed-off-by: tunglinwood <tunglinwood@gmail.com>
Signed-off-by: tunglinwood <tomwu.tunglin@gmail.com>
Signed-off-by: tunglinwood <113751333+tunglinwood@users.noreply.github.com>

42fadebe

09 Mar, 2026 1 commit

[Examples][1/n] Resettle basic examples. (#35579) · dcf8862f

wang.yuqi authored Mar 09, 2026

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

dcf8862f

06 Mar, 2026 1 commit
- [Bugfix] Fix simple Mistral-Small example (#36156) · de00ebea
  Cyrus Leung authored Mar 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  de00ebea
05 Mar, 2026 1 commit
- [Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
  Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  66a22096
04 Mar, 2026 3 commits
- docs: add README for logits_processor examples (#35933) · 3417ba56
  Dr Alex Mitre authored Mar 04, 2026
  
  3417ba56
- [Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d
  Kunshang Ji authored Mar 04, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  16d2ad1d
- [ROCm][CI] Support async weight transfer example with platform-aware determinism (#35710) · f7da9cdf
  Andreas Karatzas authored Mar 03, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  f7da9cdf
02 Mar, 2026 2 commits
- [BUG] Fix rlhf_async example (#35788) · cad21918
  Aaron Hao authored Mar 02, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  cad21918
- [Spec Decode] Add hidden states extraction system (#33736) · 9433acb8
  Fynn Schmitt-Ulms authored Mar 02, 2026
```
Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
```
  9433acb8
27 Feb, 2026 1 commit

[Feat][RL][2/2] Native Weight Syncing API: IPC (#34171) · 2ce6f3cf

Aaron Hao authored Feb 27, 2026


Signed-off-by: hao-aaron <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Signed-off-by: ahao-anyscale <ahao@anyscale.com>

2ce6f3cf

23 Feb, 2026 1 commit
- [RL] Validation for pause_mode='keep' (#34992) · 596ed1f0
  Aaron Hao authored Feb 23, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  596ed1f0
21 Feb, 2026 1 commit
- [PD] Change kv_load_failure_policy Default from "recompute" to "fail" (#34896) · ab6f3487
  Nicolò Lucchesi authored Feb 21, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  ab6f3487
11 Feb, 2026 1 commit
- [Misc] Add run one batch script that supports profiling (#32968) · ba0511fd
  Lucas Wilkinson authored Feb 10, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  ba0511fd
10 Feb, 2026 3 commits
- [Docs] Fix format error in KV load failure recovery doc (#34137) · cbea11c9
  zzaebok authored Feb 10, 2026
```
Signed-off-by: Jaebok Lee <jaebok9541@naver.com>
```
  cbea11c9
- [Bugfix] Fix `--trust-remote-code` conflict (#34218) · 2c32558a
  Cyrus Leung authored Feb 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2c32558a
- [Doc] Update usage of `--limit-mm-per-prompt` (#34148) · 25e48a3a
  Cyrus Leung authored Feb 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  25e48a3a
07 Feb, 2026 1 commit

[Feat][RL] Pause and Resume with keep requests for single engine (#32351) · 89a385d7

Aaron Hao authored Feb 06, 2026


Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

89a385d7

06 Feb, 2026 1 commit

[Docs] Improve documentation (#33799) · 6e7b1c4b

SorenDreano authored Feb 06, 2026


Co-authored-by: Soren Dreano <soren@numind.ai>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

6e7b1c4b

05 Feb, 2026 3 commits
- [Spec Decode] Unified Parallel Drafting (#32887) · af3162d3
  Benjamin Chislett authored Feb 05, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  af3162d3
- [Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943) · c1858b7e
  Aaron Hao authored Feb 05, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: SumanthRH <sumanthrh99@gmail.com>
```
  c1858b7e
- sync v0.15.1 · c721b814
  zhuwenwen authored Feb 05, 2026
  
  c721b814
03 Feb, 2026 1 commit

[Models] Intern-S1-Pro (#33636) · a3acfa10

zxy authored Feb 03, 2026


Signed-off-by: zxy <zhou0493@e.ntu.edu.sg>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

a3acfa10

02 Feb, 2026 4 commits

[Model] Use mm_position to compute mrope positions for GLM-4.xV (#33039) · 199e3cb4
Yang Liu authored Feb 02, 2026
```
Signed-off-by: Yang <lymailforjob@gmail.com>
```
199e3cb4
[Bugfix] Enable Kimi k25 processor test (#33562) · 4061dcf4
Isotr0py authored Feb 02, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
4061dcf4

[Misc] support arbitrary MM datasets in spec dec bench (#33486) · ba871fb7

Komal Kumar Teru authored Feb 02, 2026


Signed-off-by: kkt-cohere <komal@cohere.com>
Signed-off-by: Komal Kumar Teru <162363718+kkt-cohere@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

ba871fb7

[Model] Support DeepSeek-OCR-2 (#33165) · 808dd87b

RED authored Feb 02, 2026


Signed-off-by: liuli <ll407707@alibaba-inc.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: liuli <ll407707@alibaba-inc.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

808dd87b

31 Jan, 2026 1 commit
- [UX] Use gguf `repo_id:quant_type` syntax for examples and docs (#33371) · 29fba767
  Michael Goin authored Jan 30, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  29fba767
30 Jan, 2026 4 commits

[model] Add support for openPangu7B-VL (#32449) · ba45bedf

hujiaxin0 authored Jan 30, 2026

Signed-off-by: hujiaxin <524446785@qq.com>
Signed-off-by: Emilie1001 <79921183+Emilie1001@users.noreply.github.com>
Co-authored-by: Emilie1001 <79921183+Emilie1001@users.noreply.github.com>

ba45bedf

Explicitly set `return_dict` for `apply_chat_template` (#33372) · 9432ed8c
Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
9432ed8c

[CI][AMD] Skip 4 GPUs testgroup ray tests (#33305) · 070c811d

Ryan Rock authored Jan 29, 2026


Signed-off-by: Ryan Rock <ryan.rock@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

070c811d

[Model][Multimodal] Add explicit MusicFlamingo adapter (#32696) · c46b0cd0
Wang Haoyu authored Jan 30, 2026
```
Signed-off-by: WangHaoyuuu <mailwhaoyu@gmail.com>
```
c46b0cd0

29 Jan, 2026 1 commit
- [Models] Qwen3-ASR (#33312) · 8b3f0a99
  Roger Wang authored Jan 29, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  8b3f0a99
28 Jan, 2026 1 commit

Adds FunAudioChat multimodal audio model support (#2) (#33058) · 36d450e3

ramos authored Jan 28, 2026


Signed-off-by: ramos <49182011+nemoramo@users.noreply.github.com>
Signed-off-by: mayufeng <mayufeng@example.com>
Co-authored-by: mayufeng <mayufeng@example.com>

36d450e3