Commits · 5a2d420c175653c05ff9273bbda95eb23cdb4155 · OpenDAS / vllm_cscc

02 Apr, 2026 1 commit
- [Bugfix] Use dedicated MM processor cache in /tokenize to prevent sender-cache pollution (#38545) · 5a2d420c
  Sergey Zinchenko authored Apr 02, 2026
```
Signed-off-by: Sergey Zinchenko <sergey.zinchenko.rnd@gmail.com>
```
  5a2d420c
27 Mar, 2026 1 commit
- [Bugfix] Offload blocking tokenizer ops to shared thread pool to unblock event loop (#34789) · 999dfc16
  Bvicii authored Mar 26, 2026
```
Signed-off-by: Bvicii <yizhanhuang2002@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  999dfc16
26 Mar, 2026 1 commit
- [Renderer] Consolidate factory methods (#38218) · 2e225f7b
  Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2e225f7b
25 Mar, 2026 1 commit
- [Misc] Reorganize inputs (#35182) · ba2f0acc
  Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ba2f0acc
21 Mar, 2026 1 commit
- [Frontend] Remove librosa from audio dependency (#37058) · c7f98b4d
  Isotr0py authored Mar 21, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  c7f98b4d
17 Mar, 2026 1 commit

Ekagra Ranjan authored Mar 17, 2026


Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>

b5ca9c35

16 Mar, 2026 1 commit
- [Feature][Frontend] add support for Cohere Embed v2 API (#37074) · 061980c3
  Walter Beller-Morales authored Mar 16, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
  061980c3
14 Mar, 2026 3 commits
- [Frontend] Reduce chat template warmup logging levels (#37062) · 458c1a4b
  Nick Hill authored Mar 14, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  458c1a4b
- [Frontend] Avoid startup error log for models without chat template (#37040) · 5467d137
  Cyrus Leung authored Mar 15, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5467d137
- fix: resolve chat template names before kwargs detection (#36937) · b41aa264
  Giulio Leone authored Mar 14, 2026
```
Co-authored-by: giulio-leone <giulio.leone@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
```
  b41aa264
11 Mar, 2026 2 commits

[Misc] Clean up renderers (#36770) · 196802df
Cyrus Leung authored Mar 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
196802df

[Model] Add support for moonshotai/Kimi-Audio-7B-Instruct (#36127) · 42fadebe

tunglinwood authored Mar 11, 2026


Signed-off-by: tunglinwood <tunglinwood@gmail.com>
Signed-off-by: tunglinwood <tomwu.tunglin@gmail.com>
Signed-off-by: tunglinwood <113751333+tunglinwood@users.noreply.github.com>

42fadebe

10 Mar, 2026 2 commits

[CI] Bump `mypy` version to 1.19.1 (#36104) · f83b933b
Harry Mellor authored Mar 10, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
f83b933b

[Bugfix] Fix `RuntimeError: Already borrowed` that degrades VLM serving... · d0cd736c

hallerite authored Mar 09, 2026


[Bugfix] Fix `RuntimeError: Already borrowed` that degrades VLM serving throughput under concurrent load. (#36557)
Signed-off-by: hallerite <hallerite@users.noreply.github.com>
Signed-off-by: hallerite <git@hallerite.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

d0cd736c

09 Mar, 2026 2 commits

Support online use_audio_in_video (#36319) · 5578f2a4

Tianyu Guo authored Mar 09, 2026


Signed-off-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

5578f2a4

[Frontend] Move warmup into Renderer (#36482) · 3ec21150
Cyrus Leung authored Mar 09, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
3ec21150

07 Mar, 2026 1 commit
- feat: expose media_io_kwargs at runtime (#34778) · 755356b3
  milesial authored Mar 06, 2026
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  755356b3
06 Mar, 2026 2 commits
- [bugfix] add api process rank in default multimodal request (#36150) · fcb73f30
  Chenguang Zheng authored Mar 06, 2026
```
Signed-off-by: fake0fan <645327136@qq.com>
Signed-off-by: Chenguang ZHENG <645327136@qq.com>
```
  fcb73f30
- [Bugfix] Fix misleading context length error messages (#36197) · 43f10573
  Ajay Anubolu authored Mar 05, 2026
```
Signed-off-by: AjAnubolu <anuboluajay@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  43f10573
05 Mar, 2026 2 commits

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

[Bugfix] Fix Qwen-VL tokenizer implementation (#36140) · 71963481
Cyrus Leung authored Mar 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
71963481

23 Feb, 2026 1 commit
- [Refactor] Decouple TimingContext from InputProcessingContext (#35083) · 39264545
  Cyrus Leung authored Feb 23, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  39264545
19 Feb, 2026 1 commit
- [Bugfix] Fix edge case in UUID data parsing (#34884) · 13913788
  Cyrus Leung authored Feb 19, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  13913788
18 Feb, 2026 1 commit
- [Renderer] Move MM Hash parsing into Renderer (#34711) · a0d8d944
  Cyrus Leung authored Feb 18, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a0d8d944
17 Feb, 2026 1 commit
- [Renderer] Move InputPreprocessor into Renderer (2/2) (#34560) · 574fe752
  Cyrus Leung authored Feb 17, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  574fe752
16 Feb, 2026 1 commit
- [Renderer] Move InputPreprocessor into Renderer (1.5/2) (#34598) · ec17bdd8
  Cyrus Leung authored Feb 16, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ec17bdd8
14 Feb, 2026 1 commit

[Renderer] Move InputPreprocessor into Renderer (1/2) (#34510) · 73391a1b

Cyrus Leung authored Feb 15, 2026


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

73391a1b

13 Feb, 2026 2 commits
- [Refactor] Pass full VllmConfig to Renderer (#34485) · 2f308214
  Cyrus Leung authored Feb 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2f308214
- [Refactor] Simplify BOS/EOS token handling (#34435) · ea5ff3a1
  Cyrus Leung authored Feb 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ea5ff3a1
11 Feb, 2026 1 commit
- [Chore] Move `BaseRenderer` to `base.py` (#34308) · 675a22ed
  Cyrus Leung authored Feb 11, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  675a22ed
08 Feb, 2026 1 commit
- [Perf] Simplify DeepseekV32 tokenizer, ensure fast detokenization used (#33855) · a96197f5
  Nick Hill authored Feb 07, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  a96197f5
07 Feb, 2026 1 commit
- [Renderer] Define `render_cmpl` and `render_chat` (#34039) · edb359cc
  Cyrus Leung authored Feb 07, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  edb359cc
06 Feb, 2026 2 commits

[Refactor] Consolidate sequence normalization and enc-dec parsing (#33928) · cd8b405b
Cyrus Leung authored Feb 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
cd8b405b

feat(frontend): early-fail tokenization guard for user requests (#31366) · a32cb49b

Mingliang Li authored Feb 06, 2026


Signed-off-by: limingliang <limingliang@stepfun.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: limingliang <limingliang@stepfun.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

a32cb49b

01 Feb, 2026 1 commit
- [Refactor] Make Renderer an abstract class (#33479) · a358e4df
  Cyrus Leung authored Feb 01, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a358e4df
31 Jan, 2026 2 commits
- [Bugfix] Fix incompatibility between #33372 and #32863 (#33475) · 4cb59dea
  Cyrus Leung authored Jan 31, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4cb59dea
- [Frontend] Use new Renderer for Completions and Tokenize API (#32863) · f0a1c845
  Cyrus Leung authored Jan 31, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f0a1c845
30 Jan, 2026 1 commit
- Explicitly set `return_dict` for `apply_chat_template` (#33372) · 9432ed8c
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  9432ed8c
29 Jan, 2026 1 commit
- [Misc] Cleanup Kimi-K2.5's vision chunk modality entrypoints (#33157) · 3a92c6f3
  Isotr0py authored Jan 29, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3a92c6f3
27 Jan, 2026 1 commit

[Models] Kimi-K2.5 (#33131) · b539f988

Roger Wang authored Jan 26, 2026


Signed-off-by: wanglinian <wanglinian@stu.pku.edu.cn>
Signed-off-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: wanglinian <wanglinian@stu.pku.edu.cn>
Co-authored-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

b539f988