Commits · c0ecaed95030815c49699995bf6461209ccd6a0f · OpenDAS / vllm_cscc

14 Apr, 2026 1 commit

[Frontend] Offload blocking preprocessing & postprocessing ops to thread pool... · c0ecaed9

wang.yuqi authored Apr 14, 2026


[Frontend] Offload blocking preprocessing & postprocessing ops to thread pool for pooling entrypoints. (#39763)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c0ecaed9

13 Apr, 2026 1 commit

feat: add max_tokens_per_doc in rerank request. (#38827) · edbc1abd

Jesus Federico authored Apr 13, 2026


Signed-off-by: Jesus Federico <jefp@amazon.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

edbc1abd

10 Apr, 2026 1 commit
- [New Model]: jinaai/jina-reranker-v3 (#38800) · cb5f7501
  wang.yuqi authored Apr 10, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  cb5f7501
09 Apr, 2026 1 commit
- [Frontend][4/n] Improve pooling entrypoints | pooling. (#39153) · 66c079ae
  wang.yuqi authored Apr 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  66c079ae
02 Apr, 2026 1 commit
- [Frontend] Re-enable running MaxSim on GPU (#38620) · a9b4f07b
  wang.yuqi authored Apr 03, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  a9b4f07b
01 Apr, 2026 1 commit

[bugfix] do not add extra linebreak for score/rerank with chat template (#38617) · ef53395e

Augusto Yao authored Apr 01, 2026


Signed-off-by: augusto.yjh <augusto.yjh@antgroup.com>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

ef53395e

31 Mar, 2026 1 commit
- [Frontend][3/n] Improve pooling entrypoints | scoring. (#28631) · d9d21eb8
  wang.yuqi authored Mar 31, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  d9d21eb8
28 Mar, 2026 1 commit
- [BugFix][Frontend] apply task instruction as system prompt in cohere v2/embed (#38362) · fafca38a
  Walter Beller-Morales authored Mar 28, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
  fafca38a
26 Mar, 2026 1 commit
- [CI] Reorganize scoring tests (#38207) · dcdc1458
  wang.yuqi authored Mar 26, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  dcdc1458
25 Mar, 2026 2 commits
- [Misc] Reorganize inputs (#35182) · ba2f0acc
  Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ba2f0acc
- [ROCm][CI] Fix flaky Cohere/OpenAI embedding parity test (#37616) · f262a62a
  Andreas Karatzas authored Mar 25, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  f262a62a
24 Mar, 2026 2 commits

[Deprecate] Deprecate pooling multi task support. (#37956) · 1b6cb920

wang.yuqi authored Mar 24, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

1b6cb920

Fix tool_parser_cls type annotation from Callable to type[ToolParser] (#37957) · 2e67fa75
Flora Feng authored Mar 24, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
2e67fa75

20 Mar, 2026 1 commit
- [Model] Deprecate the score task (this will not affect users). (#37537) · ed359c49
  wang.yuqi authored Mar 20, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  ed359c49
19 Mar, 2026 2 commits
- [Bug] Fix EmbedIOprocessor "classify" <-> "embed" (#37573) · df3c0291
  Wentao Ye authored Mar 19, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  df3c0291
- [Refactor] Remove dead code in pooling model (#37572) · 2be1a0f7
  Wentao Ye authored Mar 19, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  2be1a0f7
17 Mar, 2026 3 commits
- [Chore] Replace all base64 usages with faster pybase64 package (#37290) · a836524d
  Isotr0py authored Mar 17, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a836524d
- [Frontend] Complete OpenAI render delegation (#37287) · 59192dfd
  Sage authored Mar 17, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  59192dfd
- [Misc] Use VLLMValidationError in batch, pooling, and tokenize protocol validators (#36256) · 56cb1baa
  Umut Polat authored Mar 17, 2026
```
Signed-off-by: umut-polat <52835619+umut-polat@users.noreply.github.com>
```
  56cb1baa
16 Mar, 2026 2 commits
- [Feature][Frontend] add support for Cohere Embed v2 API (#37074) · 061980c3
  Walter Beller-Morales authored Mar 16, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
  061980c3
- [CI][Bugfix] Fix 500 errors from priority overflow and TemplateError... · 57a314d1
  Andreas Karatzas authored Mar 16, 2026
```
[CI][Bugfix] Fix 500 errors from priority overflow and TemplateError subclasses in schema fuzz tests (#37127)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  57a314d1
12 Mar, 2026 1 commit
- [Perf] Optimize compute maxsim using batched version, 3.2% E2E throughput improvement (#36710) · c34ba6b9
  Wentao Ye authored Mar 11, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c34ba6b9
11 Mar, 2026 1 commit
- [openapi server] log exception in exception handler(2/N) (#36201) · fe714dd5
  Ning Xie authored Mar 11, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  fe714dd5
10 Mar, 2026 2 commits
- [Model] Consolidate score logic by introduce score_type (#36479) · a3189a08
  wang.yuqi authored Mar 10, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  a3189a08
- [Perf] Compute maxsim in worker side, reducing redundant copies, 2.7% E2E... · 7279374f
  Wentao Ye authored Mar 09, 2026
```
[Perf] Compute maxsim in worker side, reducing redundant copies, 2.7% E2E throughput improvement (#36159)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7279374f
09 Mar, 2026 1 commit
- [Frontend][2/n] Improve pooling entrypoints | embed. (#36110) · fff3711a
  wang.yuqi authored Mar 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
```
  fff3711a
07 Mar, 2026 1 commit
- feat: expose media_io_kwargs at runtime (#34778) · 755356b3
  milesial authored Mar 06, 2026
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  755356b3
05 Mar, 2026 1 commit
- [openai api] log exception in exception handler (1/N) (#31164) · 176c799f
  Ning Xie authored Mar 06, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  176c799f
03 Mar, 2026 2 commits

[Frontend][1/n] Improve pooling entrypoints | classify. (#35604) · ea463978

wang.yuqi authored Mar 03, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

ea463978

[Refactor] Fix maxsim cuda platform and add cli to control it (#35427) · c21d0039

Wentao Ye authored Mar 02, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

c21d0039

28 Feb, 2026 1 commit

[Deprecation] Deprecate code in 0.17 as scheduled (#35441) · e113a301

Wentao Ye authored Feb 28, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

e113a301

26 Feb, 2026 1 commit

[Perf] Optimize maxsim scores computation for pooling models, 13.9% E2E... · 99c7892c

Wentao Ye authored Feb 26, 2026


[Perf] Optimize maxsim scores computation for pooling models, 13.9% E2E throughput improvement (#35330)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

99c7892c

23 Feb, 2026 1 commit
- [Feature] Lazy import for the "mistral" tokenizer module. (#34651) · 54e2f83d
  Neil Schemenauer authored Feb 23, 2026
```
Signed-off-by: Neil Schemenauer <nas@arctrix.com>
```
  54e2f83d
21 Feb, 2026 1 commit

[Frontend] Support multimodal inputs for late-interaction scoring (ColQwen3) +... · 5719a4e4

Kata Coder authored Feb 21, 2026


[Frontend] Support multimodal inputs for late-interaction scoring (ColQwen3) + NewModel: nvidia/nemotron-colembed (#34574)
Signed-off-by: craftsangjae <craftsangjae@gmail.com>

5719a4e4

17 Feb, 2026 1 commit
- [Renderer] Move InputPreprocessor into Renderer (2/2) (#34560) · 574fe752
  Cyrus Leung authored Feb 17, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  574fe752
15 Feb, 2026 1 commit

[bugfix] Fix critical bug when reporting for all paths where... · 50dbd6c9

Stanislav Kirillov authored Feb 15, 2026


[bugfix] Fix critical bug when reporting for all paths where handler.create_error_response is used (#34516)
Signed-off-by: Stanislav Kirillov <stas@nebius.com>
Co-authored-by: Stanislav Kirillov <stas@nebius.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

50dbd6c9

13 Feb, 2026 1 commit

[Refactor] Call renderer for online IO processor request (#34490) · ec090c24

Cyrus Leung authored Feb 13, 2026

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ec090c24

12 Feb, 2026 1 commit
- [Refactor] Pass Renderer to Input Processor (#34329) · b96f7314
  Cyrus Leung authored Feb 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b96f7314
11 Feb, 2026 1 commit
- [Plugin] Simplify IO Processor Plugin interface (#34236) · c9a1923b
  Cyrus Leung authored Feb 11, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c9a1923b
09 Feb, 2026 1 commit
- [Frontend][last/5] Make pooling entrypoints request schema consensus. (#31127) · 22b64948
  wang.yuqi authored Feb 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  22b64948