Commits · 439afa4eea14db2be232a9ce78eacc2c7bbfac77 · OpenDAS / vllm_cscc

05 Feb, 2026 1 commit

feat: Add ColBERT late interaction model support (#33686) · 439afa4e

Ilya Boytsov authored Feb 05, 2026


Signed-off-by: Ilya Boytsov <ilyaboytsov1805@gmail.com>
Signed-off-by: Ilya Boytsov <boytsovpanamera@mail.ru>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

439afa4e

04 Feb, 2026 1 commit
- [Bugfix] Fix `normalize` still being passed to `PoolerConfig` (#33794) · 80f921ba
  Cyrus Leung authored Feb 04, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  80f921ba
31 Jan, 2026 1 commit
- [Frontend] Use new Renderer for Completions and Tokenize API (#32863) · f0a1c845
  Cyrus Leung authored Jan 31, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f0a1c845
27 Jan, 2026 1 commit
- [CI][Pooling] Stabilize ModernBERT test (#32909) · 6c006457
  Andreas Karatzas authored Jan 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  6c006457
22 Jan, 2026 1 commit
- Support bge-m3 sparse embeddings and colbert embeddings (#14526) · ff365eea
  Maximilien de Bayser authored Jan 22, 2026
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
```
  ff365eea
18 Jan, 2026 1 commit
- [Performance] Improve Triton prefill attention kernel's performance (#32403) · 8cc26acd
  Isotr0py authored Jan 18, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8cc26acd
13 Jan, 2026 1 commit
- [Bugfix] Replace `PoolingParams.normalize` with `use_activation` (#32243) · 232214b2
  Cyrus Leung authored Jan 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  232214b2
10 Jan, 2026 1 commit
- [Refactor] Separate sequence and token pooling types (#32026) · 583a90e0
  Cyrus Leung authored Jan 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  583a90e0
09 Jan, 2026 1 commit
- [ROCm][CI] Fix test_token_classification.py::test_bert_models (#31993) · a1648c40
  Divakar Verma authored Jan 08, 2026
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  a1648c40
06 Jan, 2026 2 commits
- [ROCm][CI] Fix ModernBERT token classification test numerical accuracy on ROCm (#31820) · 2a42ae79
  Andreas Karatzas authored Jan 06, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  2a42ae79
- [Bugfix][CI/Build] Fix failing pooling models test due to Triton kernel accuracy diff (#31776) · ee2e69d6
  Isotr0py authored Jan 06, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  ee2e69d6
05 Jan, 2026 1 commit
- [CI/Build] Revive skipped reward models e2e test (#31665) · 367856de
  Isotr0py authored Jan 05, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  367856de
02 Jan, 2026 1 commit
- [ROCm][CI] Fix ModernBERT token classification test (#31612) · 013b5408
  Andreas Karatzas authored Jan 01, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  013b5408
15 Dec, 2025 1 commit
- [Model] Automatic conversion of TokenClassification model (#30666) · 4429d934
  wang.yuqi authored Dec 15, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  4429d934
11 Dec, 2025 1 commit
- [Bugfix] Fix `task` still being passed in tests/benchmarks (#30476) · d917747c
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d917747c
07 Dec, 2025 2 commits
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
04 Dec, 2025 1 commit

[Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling (#27145) · 74c4d80c

wang.yuqi authored Dec 04, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

74c4d80c

28 Nov, 2025 1 commit

Improve enable chunked_prefill & prefix_caching logic. (#26623) · f4b76056

wang.yuqi authored Nov 28, 2025


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

f4b76056

19 Nov, 2025 1 commit
- Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
  Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a8b70304
18 Nov, 2025 1 commit

[chore] Move the rest of wikimedia url to S3 (#28921) · c64c0b78

Kevin H. Luu authored Nov 18, 2025


Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c64c0b78

16 Nov, 2025 1 commit
- [Model] Allow users to control skip reading cache per request. (#28194) · a55b6463
  wang.yuqi authored Nov 16, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
```
  a55b6463
12 Nov, 2025 2 commits
- `VLLM_USE_TRITON_FLASH_ATTN` V0 variable deprecation (#27611) · 9f0247cf
  Andreas Karatzas authored Nov 11, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
```
  9f0247cf
- [CPU] Refactor CPU attention backend (#27954) · 7f829be7
  Li, Jiang authored Nov 12, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7f829be7
30 Oct, 2025 1 commit

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524) · 4464723f

wang.yuqi authored Oct 30, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

4464723f

23 Oct, 2025 1 commit
- [Model] Add num_cached_tokens for PoolingRequestOutput (#27378) · 3729ed00
  wang.yuqi authored Oct 23, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  3729ed00
15 Oct, 2025 1 commit
- [Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370) · f54f8512
  wang.yuqi authored Oct 15, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  f54f8512
13 Oct, 2025 1 commit
- [Model][0/N] Improve all pooling task | clean up (#25817) · 767c3ab8
  wang.yuqi authored Oct 13, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  767c3ab8
12 Oct, 2025 2 commits
- [Feature] Add support for naver/splade-v3 (BERT-based sparse embedding model) (#26339) · 18ed7746
  gjgjos authored Oct 13, 2025
```
Signed-off-by: gjgjos <gjgjos@naver.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  18ed7746
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 1 commit
- [CI/Build] Fix model nightly tests (#26466) · 0f29dca9
  Cyrus Leung authored Oct 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0f29dca9
07 Oct, 2025 1 commit

[Model] Add support for ModernBertForTokenClassification (#26340) · 6f59beaf

antrec authored Oct 07, 2025

Signed-off-by: Antoine Recanati Le Goat <antoine.recanati@sancare.fr>
Signed-off-by: antrec <antoine.recanati@gmail.com>
Co-authored-by: Antoine Recanati Le Goat <antoine.recanati@sancare.fr>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

6f59beaf

05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
21 Sep, 2025 1 commit

[V0 Deprecation] Remove LLMEngine (#25033) · 52c2a8d4

Woosuk Kwon authored Sep 20, 2025


Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

52c2a8d4

19 Sep, 2025 1 commit
- Move `PoolerConfig` from `config/__init__.py` to `config/pooler.py` (#25181) · 058525b9
  Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  058525b9
18 Sep, 2025 1 commit

[New Model] Support BertForTokenClassification / Named Entity Recognition (NER) task (#24872) · 5f696c33

wang.yuqi authored Sep 18, 2025


Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

5f696c33

12 Sep, 2025 2 commits
- [CI] Speed up model unit tests in CI (#24253) · c8c42597
  afeldman-nm authored Sep 12, 2025
```
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
```
  c8c42597
- Enable conversion of multimodal models to pooling tasks (#24451) · e090b7b4
  Maximilien de Bayser authored Sep 12, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  e090b7b4
11 Sep, 2025 1 commit
- [CI] Split mteb test from Language Models Test (#24634) · fd1ce98c
  wang.yuqi authored Sep 11, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  fd1ce98c
10 Sep, 2025 1 commit
- [CI] Add PPL test for generation models (#24485) · bd98842c
  wang.yuqi authored Sep 10, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  bd98842c