Commits · 6421b66bf4894a3e1e22d17c78901e3974173e09 · OpenDAS / vllm_cscc

26 Aug, 2025 9 commits
- [Docs] Move quant supported hardware table to README (#23663) · 6421b66b
  Harry Mellor authored Aug 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6421b66b
- [doc] Hybrid KV Cache Manager design doc (#22688) · d696f86e
  Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d696f86e
- [Model] Enable video support for InternVL3.5 models (#23658) · 9816b81f
  Isotr0py authored Aug 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  9816b81f
- [Docs] [V1] [Hybrid] Update docs to remove FlashInfer constraint for hybrid models (#23665) · 227e231b
  Thomas Parnell authored Aug 26, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  227e231b
- [Docs] Reduce requirements for docs build (#23651) · 379f828f
  Harry Mellor authored Aug 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  379f828f
- [Doc]: fix various spelling issues in multiple files (#23636) · 7c04779a
  Didier Durand authored Aug 26, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  7c04779a
- [Docs] Fix broken links to `docs/api/summary.md` (#23637) · 164b2273
  Harry Mellor authored Aug 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  164b2273
- Fix CLI parameter documentation inconsistency in pooling_models.md (#23630) · ff77764f
  Raghavan authored Aug 26, 2025
  
  ff77764f
- [Docs] Fix titles for multi-file examples that are rendered in the docs (#23573) · bfc1edc9
  Harry Mellor authored Aug 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  bfc1edc9
25 Aug, 2025 4 commits

[Docs] Update Documentation of Cohere Command-A Models (#23584) · 7b6a8372

Terrence Zhao authored Aug 25, 2025


Signed-off-by: Terrencezzj <terrence@cohere.ai>
Signed-off-by: Abatom <abzhonghua@gmail.com>
Co-authored-by: Zhonghua Deng <abzhonghua@gmail.com>

7b6a8372

[Doc] Add caution for API server scale-out (#23550) · e269be2b
Cyrus Leung authored Aug 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
e269be2b
[misc] add shanghai meetup (#23535) · d0a4a3f6
youkaichao authored Aug 25, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
d0a4a3f6

[Doc: ]fix various typos in multiple files (#23487) · 47455c42

Didier Durand authored Aug 25, 2025

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

47455c42

24 Aug, 2025 2 commits
- [Model] Enable BLOOM on V1 (#23488) · e2db1164
  Cyrus Leung authored Aug 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e2db1164
- [New Model]Donut model (#23229) · 416f0592
  汪志鹏 authored Aug 24, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  416f0592
23 Aug, 2025 2 commits
- Support DeepSeek-V3.1 tool call (#23454) · b8f17f5d
  Xu Wenqing authored Aug 23, 2025
```
Signed-off-by: Xu Wenqing <xuwq1993@qq.com>
```
  b8f17f5d
- [Model] Support DP for ViT on MiniCPM-V-4 (#23327) · 23c939fd
  WeiQing Chen authored Aug 23, 2025
```
Signed-off-by: ycyaw66 <497410282@qq.com>
Co-authored-by: ycyaw66 <497410282@qq.com>
```
  23c939fd
22 Aug, 2025 4 commits

[PERF] PyTorch Symmetric Memory All-Reduce (#20759) · 0313cf85

Ilya Markov authored Aug 22, 2025


Signed-off-by: ilmarkov <imarkov@redhat.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

0313cf85

[Doc] Update the doc for log probs + prefix caching (#23399) · a073be6d

Chen Zhang authored Aug 22, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

a073be6d

[New Model] Add Seed-Oss model (#23241) · 59640693

Bin Jia authored Aug 22, 2025


Signed-off-by: jiabin.00 <jiabin.00@bytedance.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

59640693

[Deprecation] Remove `prompt_token_ids` arg fallback in `LLM.generate` and `LLM.embed` (#18800) · 8896eb72
Cyrus Leung authored Aug 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
8896eb72

21 Aug, 2025 5 commits

[Doc] Fix batch-level DP example (#23325) · 5cc54f7c

Cyrus Leung authored Aug 21, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

5cc54f7c

[Model] Add LFM2 architecture (#22845) · 2e2000f3
Paul Pak authored Aug 21, 2025
```
Signed-off-by: Paul Pak <paulpak58@gmail.com>
```
2e2000f3

[Sampler] Support returning final logprobs (#22387) · f571ff8e

22quinn authored Aug 20, 2025


Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

f571ff8e

[Model][VLM] Support R-4B Model (#23246) · 655a09f6

杨奇(yann qi) authored Aug 21, 2025

Signed-off-by: yannqi <yannqi@qq.com>
Signed-off-by: 杨奇(yann qi) <51905299+yannqi@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: yannqiyang <yannqiyang@tencent.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

655a09f6

[V1][Mamba1] - Full CUDA and Piecewise CUDA Graphs Support (#23035) · 3663870c

Asaf Joseph Gardin authored Aug 21, 2025


Signed-off-by: asafg <asafg@ai21.com>
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
Co-authored-by: asafg <asafg@ai21.com>

3663870c

20 Aug, 2025 4 commits
- [CLI][Doc] Formalize `--mm-encoder-tp-mode` (#23190) · 5efd6905
  Cyrus Leung authored Aug 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5efd6905
- [Model] Improve olmo and olmo2 (#23228) · c6d80a7a
  Jee Jee Li authored Aug 20, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  c6d80a7a
- Fix missing quotes (#23242) · 3aa8c100
  Shiming Zhang authored Aug 20, 2025
```
Signed-off-by: Shiming Zhang <wzshiming@hotmail.com>
```
  3aa8c100
- [Doc] Update V1 status of various pooling models (#23189) · 64ab3c72
  Cyrus Leung authored Aug 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  64ab3c72
19 Aug, 2025 4 commits

[CI/Build] Add support for Python 3.13 (#13164) · 21dce80e

Michael Goin authored Aug 19, 2025


Signed-off-by: mgoin <michael@neuralmagic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

21dce80e

[Model] support new model ovis2.5 (#23084) · b87cb97a

myselvess authored Aug 19, 2025


Signed-off-by: myselvess <244285088@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

b87cb97a

[Doc] use power of 2 (#23172) · 2c3f557f
Tialo authored Aug 19, 2025

2c3f557f
[Model] Support Pipeline Parallelism for moonshotai/Kimi-VL-A3B-Thinking-2506 (#23114) · fda9537c
Jiangyun Zhu authored Aug 19, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
fda9537c

18 Aug, 2025 1 commit
- [Refactor] Define MultiModalKwargsItems separate from MultiModalKwargs (#23053) · 27e8d1ea
  Cyrus Leung authored Aug 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27e8d1ea
17 Aug, 2025 1 commit
- [Misc] fix typo in the multimodal doc (#23051) · 16bff144
  Kevinzz authored Aug 17, 2025
  
  16bff144
16 Aug, 2025 2 commits

[Kernel/Quant] Remove AQLM (#22943) · 4fc722ec

Michael Goin authored Aug 16, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

4fc722ec

[New Model]mBART model (#22883) · 829bbd78
汪志鹏 authored Aug 16, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
829bbd78

15 Aug, 2025 2 commits

[Kernels] Clean up FusedMoeMethodBase and modular kernel setup. Remove extra... · 8ad7285e

bnellnm authored Aug 15, 2025


[Kernels] Clean up FusedMoeMethodBase and modular kernel setup.  Remove extra arguments from modular kernel methods. (#22035)
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

8ad7285e

[Frontend] Expose do_log_stats interval to env (#22905) · a0632a3e

Csrayz authored Aug 15, 2025


Signed-off-by: Csrayz <jover@cmbchina.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

a0632a3e