Commits · 006693ed43defb7827ef3a4d1a8b94000b010ca9 · OpenDAS / vllm_cscc

16 Nov, 2025 1 commit
- [Model] Allow users to control skip reading cache per request. (#28194) · a55b6463
  wang.yuqi authored Nov 16, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
```
  a55b6463
14 Nov, 2025 1 commit
- [Config] Clean up SchedulerConfig initialization (#28665) · 511a6b61
  Cyrus Leung authored Nov 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  511a6b61
12 Nov, 2025 2 commits
- `VLLM_USE_TRITON_FLASH_ATTN` V0 variable deprecation (#27611) · 9f0247cf
  Andreas Karatzas authored Nov 11, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
```
  9f0247cf
- [CPU] Refactor CPU attention backend (#27954) · 7f829be7
  Li, Jiang authored Nov 12, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7f829be7
02 Nov, 2025 1 commit
- [V1] [Hybrid] Mamba1 Automatic Prefix Caching (#26377) · 00b31a36
  Asaf Joseph Gardin authored Nov 02, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  00b31a36
30 Oct, 2025 1 commit

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524) · 4464723f

wang.yuqi authored Oct 30, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

4464723f

23 Oct, 2025 1 commit
- [Model] Add num_cached_tokens for PoolingRequestOutput (#27378) · 3729ed00
  wang.yuqi authored Oct 23, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  3729ed00
22 Oct, 2025 1 commit

[Model] Revert PR #26715: Restore custom PaliGemma and Gemma3-MM impl… (#27309) · e05a6754

Luciano Martins authored Oct 22, 2025


Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>

e05a6754

17 Oct, 2025 1 commit
- [Model] Always use Transformers backend for PaliGemma and Gemma3-MM (#26715) · 8c017b34
  Cyrus Leung authored Oct 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8c017b34
15 Oct, 2025 1 commit
- [Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370) · f54f8512
  wang.yuqi authored Oct 15, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  f54f8512
13 Oct, 2025 2 commits
- [Bugfix] Fix out of bound index issue for Jina-embedding-v3 RoPE with cuda graph (#26687) · 8e67b255
  Isotr0py authored Oct 13, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8e67b255
- [Model][0/N] Improve all pooling task | clean up (#25817) · 767c3ab8
  wang.yuqi authored Oct 13, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  767c3ab8
12 Oct, 2025 3 commits
- [Feature] Add support for naver/splade-v3 (BERT-based sparse embedding model) (#26339) · 18ed7746
  gjgjos authored Oct 13, 2025
```
Signed-off-by: gjgjos <gjgjos@naver.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  18ed7746
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
- [Bugfix][CI/Build] Fix failing Mteb CI (#26638) · 045b396d
  Isotr0py authored Oct 12, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  045b396d
09 Oct, 2025 1 commit
- [CI/Build] Fix model nightly tests (#26466) · 0f29dca9
  Cyrus Leung authored Oct 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0f29dca9
08 Oct, 2025 1 commit
- [CI] Pooling models mteb test disable enforce_eager (#26408) · e39dc46f
  wang.yuqi authored Oct 08, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  e39dc46f
07 Oct, 2025 1 commit

[Model] Add support for ModernBertForTokenClassification (#26340) · 6f59beaf

antrec authored Oct 07, 2025

Signed-off-by: Antoine Recanati Le Goat <antoine.recanati@sancare.fr>
Signed-off-by: antrec <antoine.recanati@gmail.com>
Co-authored-by: Antoine Recanati Le Goat <antoine.recanati@sancare.fr>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

6f59beaf

06 Oct, 2025 1 commit
- Fix per file ruff ignores related to line length (#26262) · 6c046382
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c046382
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 1 commit

[V1] [Hybrid] Mamba2 Automatic Prefix Caching (#25752) · ea507c3a

Stan Wozniak authored Oct 04, 2025


Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Thomas Ortner <boh@zurich.ibm.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>

ea507c3a

03 Oct, 2025 1 commit
- [CI] Fix distributed hybrid tests in CI (#26155) · 0e93ac0b
  Thomas Parnell authored Oct 03, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  0e93ac0b
23 Sep, 2025 1 commit
- [V1] Remove V0 code paths for Hybrid models (#25400) · a903669e
  Thomas Parnell authored Sep 23, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  a903669e
21 Sep, 2025 1 commit

[V0 Deprecation] Remove LLMEngine (#25033) · 52c2a8d4

Woosuk Kwon authored Sep 20, 2025


Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

52c2a8d4

19 Sep, 2025 2 commits

Move `PoolerConfig` from `config/__init__.py` to `config/pooler.py` (#25181) · 058525b9
Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
058525b9

[CORE] Prompt Embeddings Support for v1 Engine (#24278) · 9a4600e4

Andrew Sansom authored Sep 18, 2025


Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Andrew Sansom <qthequartermasterman@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

9a4600e4

18 Sep, 2025 2 commits
- [New Model] Support BertForTokenClassification / Named Entity Recognition (NER) task (#24872) · 5f696c33
  wang.yuqi authored Sep 18, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  5f696c33
- [Bugfix][Mamba] - Fix Conv State Kernel FP32 Support (#24883) · 66072b36
  Asaf Joseph Gardin authored Sep 18, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  66072b36
16 Sep, 2025 1 commit
- Remove V0 Encoder-Decoder Support (#24907) · 759ef49b
  Woosuk Kwon authored Sep 15, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  759ef49b
13 Sep, 2025 1 commit
- Enable conversion of multimodal models to pooling tasks (#24451) · bbb70036
  Maximilien de Bayser authored Sep 12, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  bbb70036
12 Sep, 2025 5 commits
- [CI] Speed up model unit tests in CI (#24253) · c8c42597
  afeldman-nm authored Sep 12, 2025
```
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
```
  c8c42597
- [CI/Build] Skip prompt embeddings tests on V1-only CPU backend (#24721) · 59d5d2c7
  Li, Jiang authored Sep 12, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  59d5d2c7
- [CI] Add ci_envs for convenient local testing (#24630) · d21a36f5
  wang.yuqi authored Sep 12, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  d21a36f5
- Fix implementation divergence for BLOOM models between vLLM and HuggingFace... · ddcec289
  Andrew Sansom authored Sep 11, 2025
```
Fix implementation divergence for BLOOM models between vLLM and HuggingFace when using prompt embeds (#24686)
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  ddcec289
- Enable conversion of multimodal models to pooling tasks (#24451) · e090b7b4
  Maximilien de Bayser authored Sep 12, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  e090b7b4
11 Sep, 2025 1 commit
- [CI] Split mteb test from Language Models Test (#24634) · fd1ce98c
  wang.yuqi authored Sep 11, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  fd1ce98c
10 Sep, 2025 3 commits
- [v1] Add Whisper model support (encoder-decoder) (#21088) · 37e8182b
  Russell Bryant authored Sep 10, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
```
  37e8182b
- [CI] Add PPL test for generation models (#24485) · bd98842c
  wang.yuqi authored Sep 10, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  bd98842c
- [Bugfix] Guard `_may_reorder_batch` for encoder-only models on CPU (#24319) (#24348) · feaf202e
  Remy authored Sep 10, 2025
```
Signed-off-by: Remy <eunhwan.shin@dtonic.io>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  feaf202e
09 Sep, 2025 1 commit
- [Model] Systematic support for fp32 head, pooling models part (#23810) · 19332c04
  wang.yuqi authored Sep 09, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  19332c04