Commits · 656c24f1b5d8a662e9ec391503d146341def5f18 · OpenDAS / vllm_cscc

28 Jul, 2025 3 commits

[`Ernie 4.5`] Name Change for Base 0.3B Model (#21735) · 656c24f1

Anton Vlasjuk authored Jul 28, 2025


Signed-off-by: vasqu <antonprogamer@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

656c24f1

[Model] Support TP/PP/mamba2 kernel for PLaMo2 (#19674) · c7ffe93d

Shinichi Hemmi authored Jul 28, 2025


Signed-off-by: Shinichi Hemmi <shemmi@preferred.jp>
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
Co-authored-by: Calvin Metzger <metzger@preferred.jp>
Co-authored-by: Sixue Wang <cecilwang@preferred.jp>

c7ffe93d

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f

27 Jul, 2025 3 commits
- [VLM] Add video support for Intern-S1 (#21671) · 3d847a31
  Isotr0py authored Jul 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3d847a31
- [CI/Build][Doc] Clean up more docs that point to old bench scripts (#21667) · 01a395e9
  Ye (Charlotte) Qi authored Jul 26, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  01a395e9
- [VLM] Support HF format Phi-4-MM model (#17121) · eed2f463
  Isotr0py authored Jul 27, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  eed2f463
26 Jul, 2025 4 commits

[CI/Build][Doc] Move existing benchmark scripts in CI/document/example to vllm bench CLI (#21355) · e7c4f9ee
Ye (Charlotte) Qi authored Jul 26, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
e7c4f9ee

Support Intern-S1 (#21628) · 875af38e

Lyu Han authored Jul 26, 2025


Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Your Name <you@example.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

875af38e

[Docs] add offline serving multi-modal video input expamle Qwen2.5-VL (#21530) · 97349fe2
WeiQing Chen authored Jul 26, 2025
```
Signed-off-by: David Chen <530634352@qq.com>
```
97349fe2
Add Unsloth to RLHF.md (#21636) · 41d3082c
Daniel Han authored Jul 25, 2025

41d3082c

25 Jul, 2025 4 commits
- [Docs] add auto-round quantization readme (#21600) · 5ac3168e
  Wenhua Cheng authored Jul 25, 2025
```
Signed-off-by: Wenhua Cheng <wenhua.cheng@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5ac3168e
- [CI] Unifying Dockerfiles for ARM and X86 Builds (#21343) · 396ee941
  Kebe authored Jul 25, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  396ee941
- [MODEL] New model support for naver-hyperclovax/HyperCLOVAX-SEED-Vision-Instruct-3B (#20931) · 29c6fbe5
  bigshanedogg authored Jul 25, 2025
```
Signed-off-by: bigshanedogg <bigshane319@gmail.com>
```
  29c6fbe5
- [Docs] Add `requirements/common.txt` to run unit tests (#21572) · 807a328b
  Zhou Fang authored Jul 24, 2025
```
Signed-off-by: Zhou Fang <fang.github@gmail.com>
```
  807a328b
24 Jul, 2025 8 commits

[Docs] Add Expert Parallelism Initial Documentation (#21373) · a6c7fb8c

Simon Mo authored Jul 24, 2025


Signed-off-by: simon-mo <simon.mo@hey.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

a6c7fb8c

[Docs][minor] Fix broken gh-file link in distributed serving docs (#21543) · a7272c23
Ricardo Decal authored Jul 24, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
a7272c23

[Docs] Rewrite Distributed Inference and Serving guide (#20593) · 68417411

Ricardo Decal authored Jul 24, 2025


Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

68417411

[Docs] Update Tensorizer usage documentation (#21190) · cdb79ee6

Sanger Steel authored Jul 24, 2025


Signed-off-by: Sanger Steel <sangersteel@gmail.com>
Signed-off-by: William Goldby <willgoldby@gmail.com>
Co-authored-by: William Goldby <willgoldby@gmail.com>

cdb79ee6

[Fix] Update mamba_ssm to 2.2.5 (#21421) · 5a19a6c6
elvischenv authored Jul 24, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
5a19a6c6
[Model] Officially support Emu3 with Transformers backend (#21319) · 13abd0ea
Harry Mellor authored Jul 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
13abd0ea

Replace `--expand-tools-even-if-tool-choice-none` with... · 6eca337c

Shintarou Okada authored Jul 24, 2025

Replace `--expand-tools-even-if-tool-choice-none` with `--exclude-tools-when-tool-choice-none` for v0.10.0 (#20544)
Signed-off-by: okada <kokuzen@gmail.com>
Signed-off-by: okada shintarou <okada@preferred.jp>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6eca337c

[Frontend] Set MAX_AUDIO_CLIP_FILESIZE_MB via env var instead of hardcoding (#21374) · 63d92abb
deven-labovitch authored Jul 23, 2025
```
Signed-off-by: Deven Labovitch <deven@videa.ai>
```
63d92abb

23 Jul, 2025 4 commits
- [V0 Deprecation] Remove Prompt Adapters (#20588) · 82ec66f5
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  82ec66f5
- [Model] add Hunyuan V1 Dense Model support. (#21368) · 2671334d
  Asher authored Jul 23, 2025
```
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
```
  2671334d
- [Docs] Clean up v1/metrics.md (#21449) · 2cc5016a
  Michael Yao authored Jul 23, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  2cc5016a
- [Docs] Fix bullets and grammars in tool_calling.md (#21440) · 23637dcd
  Michael Yao authored Jul 23, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  23637dcd
22 Jul, 2025 3 commits
- [feat] Enable mm caching for transformers backend (#21358) · f38ee34a
  Raushan Turganbay authored Jul 22, 2025
```
Signed-off-by: raushan <raushan@huggingface.co>
```
  f38ee34a
- Add arcee model (#21296) · 82b8027b
  Raghav Ravishankar authored Jul 22, 2025
```
Signed-off-by: alyosha-swamy <raghav@arcee.ai>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  82b8027b
- [Doc] Fix CPU doc format (#21316) · 5e70dcd6
  Li, Jiang authored Jul 22, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  5e70dcd6
21 Jul, 2025 5 commits
- [CPU] Enable shared-memory based pipeline parallel for CPU backend (#21289) · a15a50fc
  Li, Jiang authored Jul 22, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  a15a50fc
- [Misc] unify variable for LLM instance (#20996) · d9784107
  Ning Xie authored Jul 21, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  d9784107
- [Docs] Make tables more space efficient in `supported_models.md` (#21291) · e6b90a28
  Harry Mellor authored Jul 21, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e6b90a28
- [Docs] Fix hardcoded links in docs (#21287) · be54a951
  Harry Mellor authored Jul 21, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  be54a951
- [Model][1/N] Support multiple poolers at model level (#21227) · 042af0c8
  Cyrus Leung authored Jul 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  042af0c8
20 Jul, 2025 1 commit

[Model] Support VLMs with transformers backend (#20543) · 9499e26e

Raushan Turganbay authored Jul 20, 2025


Signed-off-by: raushan <raushan@huggingface.co>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

9499e26e

19 Jul, 2025 5 commits
- [Docs] [V1] Update docs to remove enforce_eager limitation for hybrid models. (#21233) · 2b504eb7
  Thomas Parnell authored Jul 20, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  2b504eb7
- GLM-4 Update (#20736) · 10eb24cc
  Yuxuan Zhang authored Jul 20, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Lu Fang <fanglu@fb.com>
```
  10eb24cc
- [V0 Deprecation] Deprecate BlockSparse Attention & Phi3-Small (#21217) · 752c6ade
  Woosuk Kwon authored Jul 19, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  752c6ade
- [Docs] Update the link to the 'Prometheus/Grafana' example (#21225) · 6a971ed6
  Jiayi Yan authored Jul 19, 2025
  
  6a971ed6
- [bugfix] Fix auto thread-binding when world_size > 1 in CPU backend and refactor code (#21032) · e3a0e43d
  Li, Jiang authored Jul 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e3a0e43d