Commits · 2554b27baa58b15843367f92d7f73d71bb89033d · OpenDAS / vllm_cscc

29 Aug, 2025 2 commits
- [V0 Deprecation] Remove pooling model support in V0 (#23434) · 2554b27b
  Maximilien de Bayser authored Aug 29, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2554b27b
- [Bugfix] Use `ReplicatedLinear` for SequenceClassification head (#23836) · 98ac0cb3
  Isotr0py authored Aug 29, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  98ac0cb3
28 Aug, 2025 1 commit
- [New Model]: Support GteNewModelForSequenceClassification (#23524) · 11a7fafa
  wang.yuqi authored Aug 28, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  11a7fafa
27 Aug, 2025 1 commit
- [V1][Mamba] - Enable V1 by default for Mamba Models (#23650) · 853c371f
  Asaf Joseph Gardin authored Aug 27, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  853c371f
26 Aug, 2025 1 commit
- Support FlashAttention Backend for Hybrid SSM Models (#23299) · 2b4fc9bd
  Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  2b4fc9bd
25 Aug, 2025 1 commit

[Bugfix] Fix Dense module loading for sentence-transformers embedding models... · c9abb104

LIYIFAN_liyifan authored Aug 24, 2025


[Bugfix] Fix Dense module loading for sentence-transformers embedding models (simplified V2) (#23408)
Signed-off-by: FFFfff1FFFfff <yifanli0919@gmail.com>

c9abb104

21 Aug, 2025 2 commits
- [Model] Add LFM2 architecture (#22845) · 2e2000f3
  Paul Pak authored Aug 21, 2025
```
Signed-off-by: Paul Pak <paulpak58@gmail.com>
```
  2e2000f3
- [V1][Mamba1] - Full CUDA and Piecewise CUDA Graphs Support (#23035) · 3663870c
  Asaf Joseph Gardin authored Aug 21, 2025
```
Signed-off-by: asafg <asafg@ai21.com>
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
Co-authored-by: asafg <asafg@ai21.com>
```
  3663870c
20 Aug, 2025 1 commit
- [Doc] Update V1 status of various pooling models (#23189) · 64ab3c72
  Cyrus Leung authored Aug 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  64ab3c72
19 Aug, 2025 1 commit
- [Model] Add multi_label_classification support (#23173) · f856c33c
  wang.yuqi authored Aug 19, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  f856c33c
16 Aug, 2025 1 commit
- [New Model]mBART model (#22883) · 829bbd78
  汪志鹏 authored Aug 16, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  829bbd78
15 Aug, 2025 3 commits

[V1] [Hybrid] Support using float32 for state in Hybrid Models (Mamba2, Mamba1, Minimax) (#22928) · 75531a6c

Thomas Parnell authored Aug 15, 2025


Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Daniel Afrimi <danielafrimi8@gmail.com>
Co-authored-by: Burkhard Ringlein <ngl@zurich.ibm.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

75531a6c

[V1] - Split Prefill and Decode for Mamba1 models (#22653) · fe91ce95

amirai21 authored Aug 15, 2025


Signed-off-by: amirk <amirk@ai21.com>
Signed-off-by: asafg <asafg@ai21.com>
Co-authored-by: asafg <asafg@ai21.com>
Co-authored-by: Asaf Joseph Gardin <39553475+Josephasafg@users.noreply.github.com>

fe91ce95

[CI] Pooling models mteb test uses enforce_eager (#22878) · 5406ebf5
wang.yuqi authored Aug 15, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
5406ebf5

13 Aug, 2025 2 commits

[CI/Build] Increase pooling tolerance to pass CI (#22844) · 0ca2393b

Cyrus Leung authored Aug 14, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

0ca2393b

[V0 Deprecation] Remove multi-step scheduling (#22138) · 71683ca6

Woosuk Kwon authored Aug 12, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>

71683ca6

12 Aug, 2025 1 commit

[Bugfix] Fix ModernBert load & Enable sliding window attention for... · 6d729c43

wang.yuqi authored Aug 12, 2025


[Bugfix] Fix ModernBert load & Enable sliding window attention for bidirectional attention. (#22637)
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

6d729c43

11 Aug, 2025 2 commits
- [Model] Pooling models default to using chunked prefill & prefix caching if supported. (#20930) · 84cf78ac
  wang.yuqi authored Aug 12, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  84cf78ac
- Support token_type_ids in V1 with less code changes (#21985) · 39052dbc
  Maximilien de Bayser authored Aug 11, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  39052dbc
10 Aug, 2025 1 commit
- [V1] [Hybrid] Enable Full CUDA Graph (decode-only) for Mamba layers (#21401) · 61f67d8a
  Thomas Parnell authored Aug 10, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  61f67d8a
09 Aug, 2025 3 commits
- [CI] [Hybrid] Speed up hybrid models test by removing large models (#22563) · 1bf5e1f2
  Thomas Parnell authored Aug 09, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  1bf5e1f2
- Remove mamba_ssm from vLLM requirements; install inside test container using... · 8a0ffd62
  Thomas Parnell authored Aug 09, 2025
```
Remove mamba_ssm from vLLM requirements; install inside test container using `--no-build-isolation` (#22541)
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  8a0ffd62
- [Bugfix] Fix ModernBert cuda graph capturing in v1 (#21901) · 429e4e2d
  Isotr0py authored Aug 09, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  429e4e2d
07 Aug, 2025 2 commits
- [CI] Skip the pooling models that do not support transformers v4.55 (#22411) · 2a4c8255
  wang.yuqi authored Aug 07, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  2a4c8255
- [v1] - Mamba1 Attention Metadata (#21249) · 46a13949
  Asaf Joseph Gardin authored Aug 07, 2025
```
Signed-off-by: asafg <asafg@ai21.com>
Co-authored-by: asafg <asafg@ai21.com>
```
  46a13949
05 Aug, 2025 1 commit
- [Model] Pooling model activation supports per request control by PoolingParams (#20538) · 586f2867
  wang.yuqi authored Aug 05, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  586f2867
04 Aug, 2025 1 commit
- [Misc] Modify the organization of GLM series (#22171) · a7b8788d
  Jee Jee Li authored Aug 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a7b8788d
31 Jul, 2025 1 commit
- [Model][CI] Let more pooling models support v1 (#21747) · 2836dd73
  wang.yuqi authored Jul 31, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  2836dd73
30 Jul, 2025 1 commit
- [Frontend] Add LLM.reward specific to reward models (#21720) · 65f311ce
  wang.yuqi authored Jul 30, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  65f311ce
29 Jul, 2025 1 commit

[V0 deprecation] Guided decoding (#21347) · 37efc63b

Reza Barazesh authored Jul 29, 2025

Signed-off-by: Reza Barazesh <rezabarazesh@meta.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

37efc63b

28 Jul, 2025 1 commit

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f

26 Jul, 2025 1 commit

Support encoder-only models without KV-Cache (#21270) · 1cd6eaba

Maximilien de Bayser authored Jul 26, 2025


Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

1cd6eaba

22 Jul, 2025 1 commit
- [Misc] unify variable for LLM instance v2 (#21356) · 0df4d9b0
  Ning Xie authored Jul 22, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  0df4d9b0
21 Jul, 2025 1 commit
- [Misc] unify variable for LLM instance (#20996) · d9784107
  Ning Xie authored Jul 21, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  d9784107
19 Jul, 2025 1 commit
- [V1] [Hybrid] Enable piecewise CUDA Graph for mamba layers (#21194) · 881e3cbe
  Thomas Parnell authored Jul 19, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  881e3cbe
18 Jul, 2025 1 commit
- [Core] Set pooling params based on task and model (#21128) · 45badd05
  Cyrus Leung authored Jul 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  45badd05
15 Jul, 2025 1 commit
- [V1] [Hybrid] Refactor mamba state shape calculation; enable V1 via cli (#20840) · 3534c39a
  Thomas Parnell authored Jul 15, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  3534c39a
12 Jul, 2025 1 commit
- [Bugfix] Fix tensor parallel issue in Qwen3 reranker weight loading (#20682) · 11c01986
  yurhett authored Jul 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  11c01986
11 Jul, 2025 1 commit

[Bugfix] Fix OOM in language generation test (#20814) · 0d21b266

Isotr0py authored Jul 12, 2025


Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

0d21b266

08 Jul, 2025 1 commit
- [CI] Increase the threshold of the MTEB RERANK tests (#20615) · baba0389
  wang.yuqi authored Jul 08, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  baba0389