Commits · d70a16625dc74d9517641aa82f4ae7367854da96 · OpenDAS / vllm_cscc

"docs/cli/serve.md" did not exist on "1e55dfa7e552e0995630a2563aeae443945e2e81"

21 Aug, 2025 6 commits

[Performance] V1 Pooling Models E2E Performance Optimization (#23162) · d70a1662
wang.yuqi authored Aug 21, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
d70a1662
[Model] Add LFM2 architecture (#22845) · 2e2000f3
Paul Pak authored Aug 21, 2025
```
Signed-off-by: Paul Pak <paulpak58@gmail.com>
```
2e2000f3
[Bugfix] Fix extra whitespace in strings caused by newline (#23272) · 0c31e28e
Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
0c31e28e

[Model][VLM] Support R-4B Model (#23246) · 655a09f6

杨奇(yann qi) authored Aug 21, 2025

Signed-off-by: yannqi <yannqi@qq.com>
Signed-off-by: 杨奇(yann qi) <51905299+yannqi@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: yannqiyang <yannqiyang@tencent.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

655a09f6

[V1][Mamba1] - Full CUDA and Piecewise CUDA Graphs Support (#23035) · 3663870c

Asaf Joseph Gardin authored Aug 21, 2025


Signed-off-by: asafg <asafg@ai21.com>
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
Co-authored-by: asafg <asafg@ai21.com>

3663870c

[CI/Build] Split out mm processor tests (#23260) · 2461d9e5
Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
2461d9e5

20 Aug, 2025 11 commits
- [Feature] use --eplb_config to set eplb param (#20562) · 4fbda0b2
  rongfu.leng authored Aug 21, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4fbda0b2
- Small fix for Command-A-Vision (#23268) · ebe56a00
  dongluw authored Aug 20, 2025
```
Signed-off-by: donglu <donglu@cohere.com>
```
  ebe56a00
- Migrate Mistral3ImagePixelInputs to TensorSchema (#21945) · c4477f55
  Benji Beck authored Aug 20, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  c4477f55
- [CLI][Doc] Formalize `--mm-encoder-tp-mode` (#23190) · 5efd6905
  Cyrus Leung authored Aug 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5efd6905
- [Bugfix] Ensure correctness of HCXVision processing (#23254) · 44492358
  Cyrus Leung authored Aug 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  44492358
- [Model] Improve olmo and olmo2 (#23228) · c6d80a7a
  Jee Jee Li authored Aug 20, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  c6d80a7a
- [Model][V1] Support Ernie MTP (#22169) · 7cd17e22
  xyxinyang authored Aug 20, 2025
```
Signed-off-by: zhouchong <zhouchong03@baidu.com>
Co-authored-by: zhouchong <zhouchong03@baidu.com>
```
  7cd17e22
- [Bugfix] Ensure correctness of Cohere2Vision processing (#23245) · 68fcd3fa
  Cyrus Leung authored Aug 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  68fcd3fa
- [Model] Support deepseek with eagle (#21086) · 83e69a09
  Xin Yang authored Aug 20, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  83e69a09
- [Model] use autoWeightsLoader for gptoss (#22446) · 103f1ec8
  Calvin Chen authored Aug 20, 2025
```
Signed-off-by: calvin chen <wen.chen@dynamia.ai>
```
  103f1ec8
- [Doc] Update V1 status of various pooling models (#23189) · 64ab3c72
  Cyrus Leung authored Aug 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  64ab3c72
19 Aug, 2025 9 commits

Migrate LlavaOnevisionMultiInputs to TensorSchema (#21844) · a70d0bd0
Benji Beck authored Aug 19, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
a70d0bd0
[Model] Removes redundant all-reduce operation in Qwen3MoeSparseMoeBlock (#23169) · 4f510bc2
yiz-liu authored Aug 20, 2025
```
Signed-off-by: Yizhou Liu <liu_yizhou@outlook.com>
```
4f510bc2

[FEAT] [Performance] Enable DP for ViT in Qwen2.5VL (#22742) · 1298c677

TJian authored Aug 19, 2025


Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

1298c677

[Model] support new model ovis2.5 (#23084) · b87cb97a

myselvess authored Aug 19, 2025


Signed-off-by: myselvess <244285088@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

b87cb97a

[bug fix] Fix llama4 spec decoding (#22691) · 5bfe0dea

qizixi authored Aug 19, 2025


Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>

5bfe0dea

[Bugfix] Fix broken Minimax-01-VL model (#22116) · 31fd3265

Isotr0py authored Aug 19, 2025


Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

31fd3265

Fix GLM-4.5V-FP8 numerical issue (#22949) · 4efd43e9

qizixi authored Aug 19, 2025


Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

4efd43e9

[Model] Support Pipeline Parallelism for moonshotai/Kimi-VL-A3B-Thinking-2506 (#23114) · fda9537c
Jiangyun Zhu authored Aug 19, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
fda9537c
Migrate InternVLImagePixelInputs (in nemotron_vl.py) to TensorSchema (#22023) · e75f3422
Benji Beck authored Aug 18, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
e75f3422

18 Aug, 2025 4 commits
- [Bugfix] Support compile for Transformers multimodal (#23095) · 0e3bb543
  Raushan Turganbay authored Aug 18, 2025
```
Signed-off-by: raushan <raushan@huggingface.co>
```
  0e3bb543
- [Refactor] Get prompt updates earlier (#23097) · d3f71f12
  Cyrus Leung authored Aug 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d3f71f12
- [Refactor] Define MultiModalKwargsItems separate from MultiModalKwargs (#23053) · 27e8d1ea
  Cyrus Leung authored Aug 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27e8d1ea
- [Bugfix] fix Qwen2.5-Omni processor output mapping (#23058) · 9f1c6422
  double7 authored Aug 18, 2025
```
Signed-off-by: double7 <33449816+DoubleVII@users.noreply.github.com>
Co-authored-by: 杨森 <yangsen.double7@bytedance.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  9f1c6422
17 Aug, 2025 4 commits
- [Misc] Remove dead return (#23061) · c55bc1db
  Woosuk Kwon authored Aug 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c55bc1db
- [Bugfix] should use stack instead of concat (#22972) · fe0411fc
  947132885 authored Aug 17, 2025
```
Signed-off-by: 947132885 <947132885@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  fe0411fc
- [Kernel] Add cuda kernel for gpt_oss activation (#22951) · 4d4061b6
  Jee Jee Li authored Aug 17, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4d4061b6
- [Refactor] Defer tensor data construction in MultiModalKwargs (#23030) · 5c32143b
  Cyrus Leung authored Aug 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5c32143b
16 Aug, 2025 3 commits
- [New Model]mBART model (#22883) · 829bbd78
  汪志鹏 authored Aug 16, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  829bbd78
- [Multimodal] Update Tensor schema test to cover arbitrary shape mm inputs (#22867) · cc826a20
  Isotr0py authored Aug 16, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  cc826a20
- [Bugfix] Fix DeepSeek MTP (#22934) · fbd88728
  Benjamin Chislett authored Aug 15, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
  fbd88728
15 Aug, 2025 3 commits

[BugFix] Fix regression caused by mamba state dtype PR (#22998) · f5d412ba
Thomas Parnell authored Aug 16, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
f5d412ba
[Model] Granite-4 support loading quantized checkpoint (#22925) · 6cd69f51
Chih-Chieh Yang authored Aug 15, 2025
```
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
```
6cd69f51

[V1] [Hybrid] Support using float32 for state in Hybrid Models (Mamba2, Mamba1, Minimax) (#22928) · 75531a6c

Thomas Parnell authored Aug 15, 2025


Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Daniel Afrimi <danielafrimi8@gmail.com>
Co-authored-by: Burkhard Ringlein <ngl@zurich.ibm.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

75531a6c