Commits · 1c3a221d3b0f7a82cd9a6d56e10ea360e2435a1c · OpenDAS / vllm_cscc

05 Feb, 2026 3 commits

[Bugfix] Fix corner case of sparse embedding (#33886) · 1c3a221d
wang.yuqi authored Feb 05, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
1c3a221d

[ROCm][Bugfix][CI] Fix hybrid models and their tests (Mamba/Jamba/Bamba) (#32710) · 3e472e81

Andreas Karatzas authored Feb 05, 2026


Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>

3e472e81

feat: Add ColBERT late interaction model support (#33686) · 439afa4e

Ilya Boytsov authored Feb 05, 2026


Signed-off-by: Ilya Boytsov <ilyaboytsov1805@gmail.com>
Signed-off-by: Ilya Boytsov <boytsovpanamera@mail.ru>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

439afa4e

04 Feb, 2026 1 commit
- [Bugfix] Fix `normalize` still being passed to `PoolerConfig` (#33794) · 80f921ba
  Cyrus Leung authored Feb 04, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  80f921ba
31 Jan, 2026 1 commit
- [Frontend] Use new Renderer for Completions and Tokenize API (#32863) · f0a1c845
  Cyrus Leung authored Jan 31, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f0a1c845
27 Jan, 2026 1 commit
- [CI][Pooling] Stabilize ModernBERT test (#32909) · 6c006457
  Andreas Karatzas authored Jan 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  6c006457
22 Jan, 2026 2 commits

Support bge-m3 sparse embeddings and colbert embeddings (#14526) · ff365eea
Maximilien de Bayser authored Jan 22, 2026
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
```
ff365eea

[ROCm][CI] Fix AITER test flakiness by using explicit attention backend (#32346) · eb1629da

Andreas Karatzas authored Jan 21, 2026


Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>

eb1629da

20 Jan, 2026 1 commit

[Misc] Remove pad_for_cudagraphs from config (#30143) · 22613408

Lucas Wilkinson authored Jan 20, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

22613408

19 Jan, 2026 1 commit
- [Frontend] Score entrypoint support data_1 & data_2 and queries & documents as inputs (#32577) · c88860d7
  wang.yuqi authored Jan 19, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  c88860d7
18 Jan, 2026 1 commit
- [Performance] Improve Triton prefill attention kernel's performance (#32403) · 8cc26acd
  Isotr0py authored Jan 18, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8cc26acd
13 Jan, 2026 1 commit
- [Bugfix] Replace `PoolingParams.normalize` with `use_activation` (#32243) · 232214b2
  Cyrus Leung authored Jan 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  232214b2
10 Jan, 2026 1 commit
- [Refactor] Separate sequence and token pooling types (#32026) · 583a90e0
  Cyrus Leung authored Jan 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  583a90e0
09 Jan, 2026 1 commit
- [ROCm][CI] Fix test_token_classification.py::test_bert_models (#31993) · a1648c40
  Divakar Verma authored Jan 08, 2026
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  a1648c40
08 Jan, 2026 1 commit
- [Model] Add Grok-2 (#31847) · 59d260f5
  Bijaya Dangol authored Jan 08, 2026
```
Signed-off-by: dangoldbj <dangoldbj23@gmail.com>
```
  59d260f5
06 Jan, 2026 3 commits
- [ROCm][CI] Fix ModernBERT token classification test numerical accuracy on ROCm (#31820) · 2a42ae79
  Andreas Karatzas authored Jan 06, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  2a42ae79
- [CI] Increase the MTEB_EMBED_TOL threshold to 5e-4. (#31797) · 43d384ba
  wang.yuqi authored Jan 06, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  43d384ba
- [Bugfix][CI/Build] Fix failing pooling models test due to Triton kernel accuracy diff (#31776) · ee2e69d6
  Isotr0py authored Jan 06, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  ee2e69d6
05 Jan, 2026 4 commits
- [Model] Let more models to support the score template. (#31335) · 911d38ed
  wang.yuqi authored Jan 05, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  911d38ed
- [CI/Build] Revive skipped reward models e2e test (#31665) · 367856de
  Isotr0py authored Jan 05, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  367856de
- [ROCm][CI] Fix language generation test accuracy by disabling HF flash_sdp and... · f2b6dfd2
  Andreas Karatzas authored Jan 04, 2026
```
[ROCm][CI] Fix language generation test accuracy by disabling HF flash_sdp and mem_efficient_sdp (#31597)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  f2b6dfd2
- [CI] Skip Phi-MoE test due to old API util (#31632) · 89f1f253
  Andreas Karatzas authored Jan 04, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  89f1f253
02 Jan, 2026 1 commit
- [ROCm][CI] Fix ModernBERT token classification test (#31612) · 013b5408
  Andreas Karatzas authored Jan 01, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  013b5408
31 Dec, 2025 1 commit

[ROCm][CI] Update MiniCPM model test: MiniCPM3-4B to MiniCPM4.1-8B and... · cf16342d

Andreas Karatzas authored Dec 31, 2025


[ROCm][CI] Update MiniCPM model test: MiniCPM3-4B to MiniCPM4.1-8B and simplify attention backend testing (#31551)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>

cf16342d

24 Dec, 2025 1 commit
- [CI] Reorganization pooling_mteb_test (#31265) · 1ff67df1
  wang.yuqi authored Dec 24, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  1ff67df1
23 Dec, 2025 1 commit

[Frontend] Support using chat template as custom score template for reranking models (#30550) · 23daef54

Jakub Zakrzewski authored Dec 23, 2025


Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

23daef54

15 Dec, 2025 2 commits
- [Refactor] [2/N] Move tool parsers into the vLLM main directory (#30675) · 2a1776b7
  Chauncey authored Dec 15, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  2a1776b7
- [Model] Automatic conversion of TokenClassification model (#30666) · 4429d934
  wang.yuqi authored Dec 15, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  4429d934
13 Dec, 2025 1 commit
- [Chore] Adjust tokenizer import to avoid circular imports (#30601) · 64251f48
  Cyrus Leung authored Dec 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  64251f48
11 Dec, 2025 1 commit
- [Bugfix] Fix `task` still being passed in tests/benchmarks (#30476) · d917747c
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d917747c
07 Dec, 2025 2 commits
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
04 Dec, 2025 1 commit

[Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling (#27145) · 74c4d80c

wang.yuqi authored Dec 04, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

74c4d80c

02 Dec, 2025 1 commit
- [BUGFIX] Fix regex pattern for Mistral Tool Call (#29918) · 1b1e35aa
  Julien Denize authored Dec 02, 2025
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
  1b1e35aa
29 Nov, 2025 1 commit
- [Misc] Refactor tokenizer interface (#29693) · 34a98427
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34a98427
28 Nov, 2025 1 commit

Improve enable chunked_prefill & prefix_caching logic. (#26623) · f4b76056

wang.yuqi authored Nov 28, 2025


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

f4b76056

23 Nov, 2025 1 commit
- [Doc] Update more docs with respect to V1 (#29188) · 389aa1b2
  Cyrus Leung authored Nov 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  389aa1b2
21 Nov, 2025 1 commit

Default model load/config/tokenizer to `mistral` format if relevant files exist (#28659) · 57430fc9

Julien Denize authored Nov 21, 2025


Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

57430fc9

19 Nov, 2025 2 commits

Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a8b70304

[Misc] Update embedding/cross encoder tests to use `mteb` v2 (#27329) · 71d0ae1c

Roman Solomatin authored Nov 19, 2025


Signed-off-by: Roman Solomatin <36135455+Samoed@users.noreply.github.com>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

71d0ae1c