Commits · cc6dafaef2bc6b0a3ea0d80efc93985fce6bc8b9 · OpenDAS / vllm_cscc

16 Dec, 2025 1 commit
- Don'e assume `position_embedding_type` will be present for BERT and RoBERTa models (#30770) · 6f15ac5d
  Harry Mellor authored Dec 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6f15ac5d
28 Nov, 2025 1 commit

Improve enable chunked_prefill & prefix_caching logic. (#26623) · f4b76056

wang.yuqi authored Nov 28, 2025


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

f4b76056

13 Nov, 2025 1 commit
- Rename clashing method names for vLLM model protocol (#27583) · 97d1c993
  Harry Mellor authored Nov 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  97d1c993
15 Oct, 2025 1 commit
- [Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370) · f54f8512
  wang.yuqi authored Oct 15, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  f54f8512
12 Oct, 2025 3 commits
- [easy] fix pre commit error on trunk (#26665) · 4fca1a1b
  Huamin Li authored Oct 12, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  4fca1a1b
- [Feature] Add support for naver/splade-v3 (BERT-based sparse embedding model) (#26339) · 18ed7746
  gjgjos authored Oct 13, 2025
```
Signed-off-by: gjgjos <gjgjos@naver.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  18ed7746
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 1 commit
- [Model] CLIP Embedding Support (#26010) · 4570535e
  Cyrus Leung authored Oct 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4570535e
30 Sep, 2025 1 commit
- [Bugfix] Token type and position embeddings fail to be applied to `inputs_embeds` (#25922) · 9f1c4eca
  Cyrus Leung authored Oct 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9f1c4eca
27 Sep, 2025 1 commit

[Bugfix] Merge MM embeddings by index instead of token IDs (#16229) · 27d7638b

Cyrus Leung authored Sep 27, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

27d7638b

18 Sep, 2025 1 commit

[New Model] Support BertForTokenClassification / Named Entity Recognition (NER) task (#24872) · 5f696c33

wang.yuqi authored Sep 18, 2025


Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

5f696c33

09 Sep, 2025 1 commit
- [Model] Systematic support for fp32 head, pooling models part (#23810) · 19332c04
  wang.yuqi authored Sep 09, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  19332c04
29 Aug, 2025 1 commit

[V0 Deprecation] Remove pooling model support in V0 (#23434) · 2554b27b

Maximilien de Bayser authored Aug 29, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

2554b27b

27 Aug, 2025 1 commit
- [Model] Explicit `default_pooling_type` interface (#23736) · 5eeef1b9
  Cyrus Leung authored Aug 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5eeef1b9
22 Aug, 2025 1 commit
- [Attention] Refactor AttentionMetadata Preparation for Encoder-only Models (#23154) · 17373dcd
  Chen Zhang authored Aug 21, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  17373dcd
21 Aug, 2025 1 commit
- [Performance] V1 Pooling Models E2E Performance Optimization (#23162) · d70a1662
  wang.yuqi authored Aug 21, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  d70a1662
11 Aug, 2025 2 commits
- [Model] Pooling models default to using chunked prefill & prefix caching if supported. (#20930) · 84cf78ac
  wang.yuqi authored Aug 12, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  84cf78ac
- Support token_type_ids in V1 with less code changes (#21985) · 39052dbc
  Maximilien de Bayser authored Aug 11, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  39052dbc
09 Aug, 2025 1 commit
- [Bugfix] Fix ModernBert cuda graph capturing in v1 (#21901) · 429e4e2d
  Isotr0py authored Aug 09, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  429e4e2d
26 Jul, 2025 1 commit

Support encoder-only models without KV-Cache (#21270) · 1cd6eaba

Maximilien de Bayser authored Jul 26, 2025


Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

1cd6eaba

25 Jul, 2025 1 commit
- [V1] Get supported tasks from model runner instead of model config (#21585) · 46d81d69
  Cyrus Leung authored Jul 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  46d81d69
21 Jul, 2025 1 commit
- [Model][1/N] Support multiple poolers at model level (#21227) · 042af0c8
  Cyrus Leung authored Jul 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  042af0c8
18 Jul, 2025 1 commit
- [Core] Set pooling params based on task and model (#21128) · 45badd05
  Cyrus Leung authored Jul 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  45badd05
17 Jul, 2025 1 commit
- [Model] Update pooling model interface (#21058) · 90bd2ab6
  Cyrus Leung authored Jul 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  90bd2ab6
16 Jul, 2025 1 commit
- [Model] Consolidate pooler implementations (#20927) · 1c3198b6
  Cyrus Leung authored Jul 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1c3198b6
15 Jul, 2025 1 commit

[Model] Add AutoWeightsLoader support for BERT, RoBERTa (#20534) · 85bd6599

Jennifer He authored Jul 15, 2025


Signed-off-by: Jennifer He <islandhe@gmail.com>
Signed-off-by: <islandhe@gmail.com>
Signed-off-by: Jen H <islandhe@gmail.com>

85bd6599

06 Jul, 2025 1 commit
- [Bugfix] Add `use_cross_encoder` flag to use correct activation in `ClassifierPooler` (#20527) · c18b3b8e
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c18b3b8e
19 Jun, 2025 1 commit

Support embedding models in V1 (#16188) · 799397ee

Maximilien de Bayser authored Jun 19, 2025


Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

799397ee

16 Jun, 2025 1 commit
- [CI] Add mteb testing for rerank models (#19344) · f40f763f
  wang.yuqi authored Jun 16, 2025
  
  f40f763f
04 Jun, 2025 1 commit
- Improve the output precision of embedding models (#19092) · 35cf32df
  wang.yuqi authored Jun 04, 2025
  
  35cf32df
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
29 May, 2025 1 commit
- Prevent the cross-encoder logic from being applied to classification tasks (#18838) · 515b413e
  Maximilien de Bayser authored May 28, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  515b413e
15 May, 2025 1 commit
- Update deprecated type hinting in `models` (#18132) · 26d04193
  Harry Mellor authored May 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  26d04193
11 May, 2025 1 commit
- [New Model]: nomic-embed-text-v2-moe (#17785) · e4b87133
  wang.yuqi authored May 11, 2025
  
  e4b87133
18 Apr, 2025 1 commit
- [New Model]: Snowflake Arctic Embed (Family) (#16649) · 3d3ab368
  wang.yuqi authored Apr 18, 2025
  
  3d3ab368
08 Apr, 2025 1 commit
- [New Model]: jinaai/jina-embeddings-v3 (#16120) · 1f5d13ab
  wang.yuqi authored Apr 08, 2025
  
  1f5d13ab
03 Apr, 2025 1 commit
- [SupportsQuant] Bert, Blip, Blip2, Bloom (#15573) · 421c4629
  Kyle Sayers authored Apr 03, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  421c4629
28 Feb, 2025 1 commit
- [V1]`SupportsV0Only` protocol for model definitions (#13959) · 6c85da3a
  Roger Wang authored Feb 27, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  6c85da3a
25 Feb, 2025 1 commit
- Remove unused kwargs from model definitions (#13555) · cdc1fa12
  Harry Mellor authored Feb 25, 2025
  
  cdc1fa12