Commits · c0ecaed95030815c49699995bf6461209ccd6a0f · OpenDAS / vllm_cscc

14 Apr, 2026 1 commit

[Frontend] Offload blocking preprocessing & postprocessing ops to thread pool... · c0ecaed9

wang.yuqi authored Apr 14, 2026


[Frontend] Offload blocking preprocessing & postprocessing ops to thread pool for pooling entrypoints. (#39763)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c0ecaed9

13 Apr, 2026 1 commit

feat: add max_tokens_per_doc in rerank request. (#38827) · edbc1abd

Jesus Federico authored Apr 13, 2026


Signed-off-by: Jesus Federico <jefp@amazon.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

edbc1abd

09 Apr, 2026 1 commit
- [Frontend][4/n] Improve pooling entrypoints | pooling. (#39153) · 66c079ae
  wang.yuqi authored Apr 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  66c079ae
02 Apr, 2026 1 commit
- [Frontend] Re-enable running MaxSim on GPU (#38620) · a9b4f07b
  wang.yuqi authored Apr 03, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  a9b4f07b
31 Mar, 2026 1 commit
- [Frontend][3/n] Improve pooling entrypoints | scoring. (#28631) · d9d21eb8
  wang.yuqi authored Mar 31, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  d9d21eb8
26 Mar, 2026 1 commit
- [CI] Reorganize scoring tests (#38207) · dcdc1458
  wang.yuqi authored Mar 26, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  dcdc1458
25 Mar, 2026 2 commits
- [Misc] Reorganize inputs (#35182) · ba2f0acc
  Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ba2f0acc
- [ROCm][CI] Fix flaky Cohere/OpenAI embedding parity test (#37616) · f262a62a
  Andreas Karatzas authored Mar 25, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  f262a62a
24 Mar, 2026 1 commit
- Fix tool_parser_cls type annotation from Callable to type[ToolParser] (#37957) · 2e67fa75
  Flora Feng authored Mar 24, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  2e67fa75
17 Mar, 2026 1 commit
- [Misc] Use VLLMValidationError in batch, pooling, and tokenize protocol validators (#36256) · 56cb1baa
  Umut Polat authored Mar 17, 2026
```
Signed-off-by: umut-polat <52835619+umut-polat@users.noreply.github.com>
```
  56cb1baa
16 Mar, 2026 2 commits
- [Feature][Frontend] add support for Cohere Embed v2 API (#37074) · 061980c3
  Walter Beller-Morales authored Mar 16, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
  061980c3
- [CI][Bugfix] Fix 500 errors from priority overflow and TemplateError... · 57a314d1
  Andreas Karatzas authored Mar 16, 2026
```
[CI][Bugfix] Fix 500 errors from priority overflow and TemplateError subclasses in schema fuzz tests (#37127)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  57a314d1
09 Mar, 2026 1 commit
- [Frontend][2/n] Improve pooling entrypoints | embed. (#36110) · fff3711a
  wang.yuqi authored Mar 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
```
  fff3711a
07 Mar, 2026 1 commit
- feat: expose media_io_kwargs at runtime (#34778) · 755356b3
  milesial authored Mar 06, 2026
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  755356b3
05 Mar, 2026 1 commit
- [openai api] log exception in exception handler (1/N) (#31164) · 176c799f
  Ning Xie authored Mar 06, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  176c799f
03 Mar, 2026 1 commit

[Frontend][1/n] Improve pooling entrypoints | classify. (#35604) · ea463978

wang.yuqi authored Mar 03, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

ea463978

28 Feb, 2026 1 commit

[Deprecation] Deprecate code in 0.17 as scheduled (#35441) · e113a301

Wentao Ye authored Feb 28, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

e113a301

09 Feb, 2026 1 commit
- [Frontend][last/5] Make pooling entrypoints request schema consensus. (#31127) · 22b64948
  wang.yuqi authored Feb 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  22b64948
05 Feb, 2026 1 commit

[Refactor] Move `task` outside of `PoolingParams.verify` (#33796) · 038914b7

Cyrus Leung authored Feb 05, 2026


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

038914b7

31 Jan, 2026 2 commits
- [Deprecation] Remove deprecated items related to pooling (#33477) · 92924b2d
  Cyrus Leung authored Feb 01, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  92924b2d
- [Frontend] Use new Renderer for Completions and Tokenize API (#32863) · f0a1c845
  Cyrus Leung authored Jan 31, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f0a1c845
23 Jan, 2026 1 commit

[Frontend][3/n] Make pooling entrypoints request schema consensus |... · 05f3d714

wang.yuqi authored Jan 23, 2026


[Frontend][3/n] Make pooling entrypoints request schema consensus | EmbedRequest & ClassifyRequest (#32905)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

05f3d714

22 Jan, 2026 1 commit
- [Frontend][2/n] Make pooling entrypoints request schema consensus | ChatRequest (#32574) · 328cbb27
  wang.yuqi authored Jan 22, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  328cbb27
16 Jan, 2026 1 commit
- [Frontend][1/n] Make pooling entrypoints request schema consensus | CompletionRequest (#32395) · 4ae77dfd
  wang.yuqi authored Jan 16, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  4ae77dfd