Commits · 8896eb72ebe90be6f1b83f32b3d3d0c379db4f82 · OpenDAS / vllm_cscc

22 Aug, 2025 1 commit
- [Deprecation] Remove `prompt_token_ids` arg fallback in `LLM.generate` and `LLM.embed` (#18800) · 8896eb72
  Cyrus Leung authored Aug 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8896eb72
21 Aug, 2025 2 commits

[Bugfix] Fix extra whitespace in strings caused by newline (#23272) · 0c31e28e
Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
0c31e28e

[Model][VLM] Support R-4B Model (#23246) · 655a09f6

杨奇(yann qi) authored Aug 21, 2025

Signed-off-by: yannqi <yannqi@qq.com>
Signed-off-by: 杨奇(yann qi) <51905299+yannqi@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: yannqiyang <yannqiyang@tencent.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

655a09f6

19 Aug, 2025 3 commits

[Model] support new model ovis2.5 (#23084) · b87cb97a

myselvess authored Aug 19, 2025


Signed-off-by: myselvess <244285088@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

b87cb97a

[Bugfix] Fix broken Minimax-01-VL model (#22116) · 31fd3265

Isotr0py authored Aug 19, 2025


Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

31fd3265

Fix GLM-4.5V-FP8 numerical issue (#22949) · 4efd43e9

qizixi authored Aug 19, 2025


Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

4efd43e9

16 Aug, 2025 3 commits

[V1] Logits processors extensibility (#19912) · bf7f470b

afeldman-nm authored Aug 16, 2025


Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Signed-off-by: Andrew Feldman <afeld2012@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Andrew Feldman <afeld2012@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

bf7f470b

[Kernel/Quant] Remove AQLM (#22943) · 4fc722ec

Michael Goin authored Aug 16, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

4fc722ec

[New Model]mBART model (#22883) · 829bbd78
汪志鹏 authored Aug 16, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
829bbd78

15 Aug, 2025 2 commits

[Kernels] Clean up FusedMoeMethodBase and modular kernel setup. Remove extra... · 8ad7285e

bnellnm authored Aug 15, 2025


[Kernels] Clean up FusedMoeMethodBase and modular kernel setup.  Remove extra arguments from modular kernel methods. (#22035)
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

8ad7285e

[Structured Output] Make the output of structured output example more complete (#22481) · 48b01fd4
Shanshan Shen authored Aug 16, 2025
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
48b01fd4

12 Aug, 2025 1 commit
- [New Model] Support Command-A-Vision (#22660) · 9f909b89
  dongluw authored Aug 12, 2025
```
Signed-off-by: donglu <donglu@cohere.com>
```
  9f909b89
09 Aug, 2025 1 commit

[Model] Gemma3n MM (#20495) · 5a16fa61

Nicolò Lucchesi authored Aug 09, 2025


Signed-off-by: ShriKode <shrikode@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: ShriKode <shrikode@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.me>

5a16fa61

07 Aug, 2025 2 commits
- [Frontend] Use engine argument to control MM cache size (#22441) · 139d1557
  Cyrus Leung authored Aug 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  139d1557
- [Core] Store only the keys for multi-modal data in P0 (#22198) · 766bc816
  Cyrus Leung authored Aug 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  766bc816
04 Aug, 2025 2 commits
- [Misc] Modify the organization of GLM series (#22171) · a7b8788d
  Jee Jee Li authored Aug 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a7b8788d
- [RLHF] Fix torch.dtype not serializable in example (#22158) · 845420ac
  22quinn authored Aug 03, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  845420ac
01 Aug, 2025 2 commits
- [Doc] Add example for Step3-VL (#22061) · 27a145e8
  Roger Wang authored Aug 01, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
```
  27a145e8
- [Misc] Automatically resolve HF processor init kwargs (#22005) · 82de9b9d
  Cyrus Leung authored Aug 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  82de9b9d
31 Jul, 2025 2 commits
- [Meta] Official Eagle mm support, first enablement on llama4 (#20788) · 9e0726e5
  zhiweiz authored Jul 31, 2025
```
Signed-off-by: morgendave <morgendave@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  9e0726e5
- [Example] Add `async_llm_streaming.py` example for AsyncLLM streaming in python (#21763) · 9cb497bf
  Michael Goin authored Jul 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  9cb497bf
30 Jul, 2025 2 commits
- [Frontend] Add LLM.reward specific to reward models (#21720) · 65f311ce
  wang.yuqi authored Jul 30, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  65f311ce
- [Docs] Switch to better markdown linting pre-commit hook (#21851) · ba5c5e54
  Harry Mellor authored Jul 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ba5c5e54
28 Jul, 2025 2 commits

[Bugfix] fix max-file-size type from str to int (#21675) · 150d9e63
Ning Xie authored Jul 28, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
150d9e63

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f

27 Jul, 2025 3 commits
- [VLM] Add video support for Intern-S1 (#21671) · 3d847a31
  Isotr0py authored Jul 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3d847a31
- [Misc] add default value for file pattern arg (#21659) · 1cbf951b
  Ning Xie authored Jul 27, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  1cbf951b
- [VLM] Support HF format Phi-4-MM model (#17121) · eed2f463
  Isotr0py authored Jul 27, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  eed2f463
26 Jul, 2025 2 commits

Support encoder-only models without KV-Cache (#21270) · 1cd6eaba

Maximilien de Bayser authored Jul 26, 2025


Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

1cd6eaba

Support Intern-S1 (#21628) · 875af38e

Lyu Han authored Jul 26, 2025


Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Your Name <you@example.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

875af38e

25 Jul, 2025 1 commit
- [MODEL] New model support for naver-hyperclovax/HyperCLOVAX-SEED-Vision-Instruct-3B (#20931) · 29c6fbe5
  bigshanedogg authored Jul 25, 2025
```
Signed-off-by: bigshanedogg <bigshane319@gmail.com>
```
  29c6fbe5
23 Jul, 2025 1 commit
- [Core][Model] PrithviMAE Enablement on vLLM v1 engine (#20577) · 8560a5b2
  Christian Pinto authored Jul 23, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  8560a5b2
22 Jul, 2025 1 commit
- [Misc] Remove deprecated args in v0.10 (#21349) · bc8a8ce5
  Kebe authored Jul 22, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  bc8a8ce5
21 Jul, 2025 1 commit
- [Misc] unify variable for LLM instance (#20996) · d9784107
  Ning Xie authored Jul 21, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  d9784107
20 Jul, 2025 1 commit
- [bugfix] fix syntax warning caused by backslash (#21251) · 7ba34b12
  Jiayi Yan authored Jul 21, 2025
  
  7ba34b12
18 Jul, 2025 1 commit
- [Doc] Add inplace weights loading example (#19640) · b38baabc
  22quinn authored Jul 17, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  b38baabc
17 Jul, 2025 1 commit

[VLM] Add Nemotron-Nano-VL-8B-V1 support (#20349) · 4ef00b5c

kYLe authored Jul 17, 2025


Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

4ef00b5c

16 Jul, 2025 1 commit

[Meta] Llama4 EAGLE Support (#20591) · c11013db

zhiweiz authored Jul 15, 2025


Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: qizixi <qizixi@meta.com>

c11013db

15 Jul, 2025 2 commits
- Voxtral (#20970) · e7e3e6d2
  Patrick von Platen authored Jul 15, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  e7e3e6d2
- [Docs] Improve documentation for RLHF example (#20598) · 235bfd5d
  Ricardo Decal authored Jul 15, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  235bfd5d