Commits · 5eb36575786d7034f36315f09cf8248fbfd4230b · OpenDAS / vllm_cscc

27 Apr, 2026 1 commit
- Revert "[Frontend] Remove frontend pooling multi task support. (#37861)" · 5eb36575
  khluu authored Apr 26, 2026
```
This reverts commit d2e2e856.
```
  5eb36575
24 Apr, 2026 1 commit

[Deprecate] Deprecate LLM.reward offline api, use LLM.encode instead. (#40688) · 9744b699

wang.yuqi authored Apr 24, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

9744b699

21 Apr, 2026 1 commit

[Frontend] Remove frontend pooling multi task support. (#37861) · d2e2e856

wang.yuqi authored Apr 21, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

d2e2e856

14 Apr, 2026 1 commit

[Frontend] Offload blocking preprocessing & postprocessing ops to thread pool... · c0ecaed9

wang.yuqi authored Apr 14, 2026


[Frontend] Offload blocking preprocessing & postprocessing ops to thread pool for pooling entrypoints. (#39763)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c0ecaed9

13 Apr, 2026 1 commit

feat: add max_tokens_per_doc in rerank request. (#38827) · edbc1abd

Jesus Federico authored Apr 13, 2026


Signed-off-by: Jesus Federico <jefp@amazon.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

edbc1abd

09 Apr, 2026 1 commit
- [Frontend][4/n] Improve pooling entrypoints | pooling. (#39153) · 66c079ae
  wang.yuqi authored Apr 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  66c079ae
02 Apr, 2026 1 commit
- [Frontend] Re-enable running MaxSim on GPU (#38620) · a9b4f07b
  wang.yuqi authored Apr 03, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  a9b4f07b
01 Apr, 2026 1 commit

[bugfix] do not add extra linebreak for score/rerank with chat template (#38617) · ef53395e

Augusto Yao authored Apr 01, 2026


Signed-off-by: augusto.yjh <augusto.yjh@antgroup.com>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

ef53395e

31 Mar, 2026 1 commit
- [Frontend][3/n] Improve pooling entrypoints | scoring. (#28631) · d9d21eb8
  wang.yuqi authored Mar 31, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  d9d21eb8
28 Mar, 2026 1 commit
- [BugFix][Frontend] apply task instruction as system prompt in cohere v2/embed (#38362) · fafca38a
  Walter Beller-Morales authored Mar 28, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
  fafca38a
26 Mar, 2026 1 commit
- [CI] Reorganize scoring tests (#38207) · dcdc1458
  wang.yuqi authored Mar 26, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  dcdc1458
25 Mar, 2026 1 commit
- [ROCm][CI] Fix flaky Cohere/OpenAI embedding parity test (#37616) · f262a62a
  Andreas Karatzas authored Mar 25, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  f262a62a
24 Mar, 2026 1 commit

[Deprecate] Deprecate pooling multi task support. (#37956) · 1b6cb920

wang.yuqi authored Mar 24, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

1b6cb920

17 Mar, 2026 1 commit
- [Chore] Replace all base64 usages with faster pybase64 package (#37290) · a836524d
  Isotr0py authored Mar 17, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a836524d
16 Mar, 2026 1 commit
- [Feature][Frontend] add support for Cohere Embed v2 API (#37074) · 061980c3
  Walter Beller-Morales authored Mar 16, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
  061980c3
12 Mar, 2026 1 commit
- [Perf] Optimize compute maxsim using batched version, 3.2% E2E throughput improvement (#36710) · c34ba6b9
  Wentao Ye authored Mar 11, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c34ba6b9
10 Mar, 2026 1 commit
- Fix Qwen2.5-VL test for Transformers v5 (#36532) · c8851008
  Harry Mellor authored Mar 10, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c8851008
09 Mar, 2026 1 commit
- [Frontend][2/n] Improve pooling entrypoints | embed. (#36110) · fff3711a
  wang.yuqi authored Mar 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
```
  fff3711a
07 Mar, 2026 1 commit
- feat: expose media_io_kwargs at runtime (#34778) · 755356b3
  milesial authored Mar 06, 2026
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  755356b3
28 Feb, 2026 2 commits

[Deprecation] Deprecate code in 0.17 as scheduled (#35441) · e113a301

Wentao Ye authored Feb 28, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

e113a301

[ROCm][CI] Parametrize vision score tests across attention backends with... · 1e69c048

Andreas Karatzas authored Feb 28, 2026


[ROCm][CI] Parametrize vision score tests across attention backends with per-backend tolerances (#35571)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>

1e69c048

26 Feb, 2026 1 commit

[Perf] Optimize maxsim scores computation for pooling models, 13.9% E2E... · 99c7892c

Wentao Ye authored Feb 26, 2026


[Perf] Optimize maxsim scores computation for pooling models, 13.9% E2E throughput improvement (#35330)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

99c7892c

22 Feb, 2026 1 commit
- [ROCm][CI] Fix flaky embedding chat test by using tolerance-based comparison (#35050) · a8a47c17
  Andreas Karatzas authored Feb 22, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  a8a47c17
13 Feb, 2026 1 commit
- Extend ColBERT support to non-standard BERT backbones (#34170) · 071d863e
  Ilya Boytsov authored Feb 13, 2026
```
Signed-off-by: Ilya Boytsov <ilya.boytsov@aleph-alpha.com>
```
  071d863e
09 Feb, 2026 1 commit
- [Frontend][last/5] Make pooling entrypoints request schema consensus. (#31127) · 22b64948
  wang.yuqi authored Feb 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  22b64948
05 Feb, 2026 2 commits

[Refactor] Move `task` outside of `PoolingParams.verify` (#33796) · 038914b7

Cyrus Leung authored Feb 05, 2026


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

038914b7

feat: Add ColBERT late interaction model support (#33686) · 439afa4e

Ilya Boytsov authored Feb 05, 2026


Signed-off-by: Ilya Boytsov <ilyaboytsov1805@gmail.com>
Signed-off-by: Ilya Boytsov <boytsovpanamera@mail.ru>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

439afa4e

04 Feb, 2026 1 commit
- [Frontend][4/n] Make pooling entrypoints request schema consensus | ScoreRequest (#33060) · 1b8fe6f7
  wang.yuqi authored Feb 04, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  1b8fe6f7
03 Feb, 2026 1 commit
- [Refactor] Clean up pooling serial utils (#33665) · 83449a5f
  Cyrus Leung authored Feb 03, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  83449a5f
31 Jan, 2026 1 commit
- [Frontend] Use new Renderer for Completions and Tokenize API (#32863) · f0a1c845
  Cyrus Leung authored Jan 31, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f0a1c845
29 Jan, 2026 1 commit

[Bugfix] Fix Qwen3-VL-Reranker load. (#33298) · abb34ac4

wang.yuqi authored Jan 29, 2026

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

abb34ac4

27 Jan, 2026 1 commit

[Frontend] Frontend will only attach supported tasks corresponding entrypoints. (#33139) · 76139d08

wang.yuqi authored Jan 27, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

76139d08

23 Jan, 2026 1 commit

[Frontend][3/n] Make pooling entrypoints request schema consensus |... · 05f3d714

wang.yuqi authored Jan 23, 2026


[Frontend][3/n] Make pooling entrypoints request schema consensus | EmbedRequest & ClassifyRequest (#32905)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

05f3d714

22 Jan, 2026 2 commits
- [Frontend] Introduce Renderer for processing chat messages (using `ModelConfig`) (#30200) · d117a4d1
  Cyrus Leung authored Jan 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d117a4d1
- [Frontend][2/n] Make pooling entrypoints request schema consensus | ChatRequest (#32574) · 328cbb27
  wang.yuqi authored Jan 22, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  328cbb27
19 Jan, 2026 1 commit
- [Frontend] Score entrypoint support data_1 & data_2 and queries & documents as inputs (#32577) · c88860d7
  wang.yuqi authored Jan 19, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  c88860d7
16 Jan, 2026 1 commit
- [Frontend][1/n] Make pooling entrypoints request schema consensus | CompletionRequest (#32395) · 4ae77dfd
  wang.yuqi authored Jan 16, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  4ae77dfd
15 Jan, 2026 1 commit
- [3/N] Group together media-related code (#32406) · 28459785
  Cyrus Leung authored Jan 15, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  28459785
13 Jan, 2026 1 commit
- [Bugfix] Replace `PoolingParams.normalize` with `use_activation` (#32243) · 232214b2
  Cyrus Leung authored Jan 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  232214b2
06 Jan, 2026 1 commit
- [Model] rename use_pad_token to use_sep_token (#31784) · 96860af6
  wang.yuqi authored Jan 06, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  96860af6