Commits · 999dfc1622d042dffbe4e273056fa4554453c8e7 · OpenDAS / vllm_cscc

27 Mar, 2026 1 commit
- [Bugfix] Offload blocking tokenizer ops to shared thread pool to unblock event loop (#34789) · 999dfc16
  Bvicii authored Mar 26, 2026
```
Signed-off-by: Bvicii <yizhanhuang2002@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  999dfc16
26 Mar, 2026 1 commit
- [Renderer] Consolidate factory methods (#38218) · 2e225f7b
  Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2e225f7b
25 Mar, 2026 1 commit
- [Misc] Reorganize inputs (#35182) · ba2f0acc
  Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ba2f0acc
21 Mar, 2026 1 commit
- [Frontend] Remove librosa from audio dependency (#37058) · c7f98b4d
  Isotr0py authored Mar 21, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  c7f98b4d
17 Mar, 2026 1 commit

Ekagra Ranjan authored Mar 17, 2026


Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>

b5ca9c35

14 Mar, 2026 2 commits
- [Frontend] Reduce chat template warmup logging levels (#37062) · 458c1a4b
  Nick Hill authored Mar 14, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  458c1a4b
- [Frontend] Avoid startup error log for models without chat template (#37040) · 5467d137
  Cyrus Leung authored Mar 15, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5467d137
10 Mar, 2026 1 commit

[Bugfix] Fix `RuntimeError: Already borrowed` that degrades VLM serving... · d0cd736c

hallerite authored Mar 09, 2026


[Bugfix] Fix `RuntimeError: Already borrowed` that degrades VLM serving throughput under concurrent load. (#36557)
Signed-off-by: hallerite <hallerite@users.noreply.github.com>
Signed-off-by: hallerite <git@hallerite.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

d0cd736c

09 Mar, 2026 1 commit
- [Frontend] Move warmup into Renderer (#36482) · 3ec21150
  Cyrus Leung authored Mar 09, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3ec21150
06 Mar, 2026 1 commit
- [bugfix] add api process rank in default multimodal request (#36150) · fcb73f30
  Chenguang Zheng authored Mar 06, 2026
```
Signed-off-by: fake0fan <645327136@qq.com>
Signed-off-by: Chenguang ZHENG <645327136@qq.com>
```
  fcb73f30
23 Feb, 2026 1 commit
- [Refactor] Decouple TimingContext from InputProcessingContext (#35083) · 39264545
  Cyrus Leung authored Feb 23, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  39264545
19 Feb, 2026 1 commit
- [Bugfix] Fix edge case in UUID data parsing (#34884) · 13913788
  Cyrus Leung authored Feb 19, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  13913788
18 Feb, 2026 1 commit
- [Renderer] Move MM Hash parsing into Renderer (#34711) · a0d8d944
  Cyrus Leung authored Feb 18, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a0d8d944
17 Feb, 2026 1 commit
- [Renderer] Move InputPreprocessor into Renderer (2/2) (#34560) · 574fe752
  Cyrus Leung authored Feb 17, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  574fe752
16 Feb, 2026 1 commit
- [Renderer] Move InputPreprocessor into Renderer (1.5/2) (#34598) · ec17bdd8
  Cyrus Leung authored Feb 16, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ec17bdd8
14 Feb, 2026 1 commit

[Renderer] Move InputPreprocessor into Renderer (1/2) (#34510) · 73391a1b

Cyrus Leung authored Feb 15, 2026


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

73391a1b

13 Feb, 2026 2 commits
- [Refactor] Pass full VllmConfig to Renderer (#34485) · 2f308214
  Cyrus Leung authored Feb 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2f308214
- [Refactor] Simplify BOS/EOS token handling (#34435) · ea5ff3a1
  Cyrus Leung authored Feb 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ea5ff3a1
11 Feb, 2026 1 commit
- [Chore] Move `BaseRenderer` to `base.py` (#34308) · 675a22ed
  Cyrus Leung authored Feb 11, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  675a22ed
07 Feb, 2026 1 commit
- [Renderer] Define `render_cmpl` and `render_chat` (#34039) · edb359cc
  Cyrus Leung authored Feb 07, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  edb359cc
06 Feb, 2026 1 commit
- [Refactor] Consolidate sequence normalization and enc-dec parsing (#33928) · cd8b405b
  Cyrus Leung authored Feb 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cd8b405b
01 Feb, 2026 1 commit
- [Refactor] Make Renderer an abstract class (#33479) · a358e4df
  Cyrus Leung authored Feb 01, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a358e4df
31 Jan, 2026 1 commit
- [Frontend] Use new Renderer for Completions and Tokenize API (#32863) · f0a1c845
  Cyrus Leung authored Jan 31, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f0a1c845
22 Jan, 2026 1 commit
- [Frontend] Introduce Renderer for processing chat messages (using `ModelConfig`) (#30200) · d117a4d1
  Cyrus Leung authored Jan 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d117a4d1