Commits · 5a71cdd76ebc4f55a7490e087d2a50bd892ab3bc · OpenDAS / vllm_cscc

12 Mar, 2026 1 commit
- [Bugfix] Fix crash when tool_choice=required exceeds max_tokens (#36841) · 5a71cdd7
  Chauncey authored Mar 12, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  5a71cdd7
09 Mar, 2026 3 commits
- Support online use_audio_in_video (#36319) · 5578f2a4
  Tianyu Guo authored Mar 09, 2026
```
Signed-off-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  5578f2a4
- [Frontend] Add Support for MM Encoder/Decoder Beam Search (Online Transcriptions) (#36160) · 65a4da15
  Alex Brooks authored Mar 08, 2026
```
Signed-off-by: Alex Brooks <albrooks@redhat.com>
```
  65a4da15
- [Frontend][2/n] Improve pooling entrypoints | embed. (#36110) · fff3711a
  wang.yuqi authored Mar 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
```
  fff3711a
07 Mar, 2026 1 commit
- feat: expose media_io_kwargs at runtime (#34778) · 755356b3
  milesial authored Mar 06, 2026
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  755356b3
06 Mar, 2026 2 commits
- Change "following fields were present in the request but ignored" log from warn to debug (#36173) · 5afb387b
  Tyler Michael Smith authored Mar 06, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  5afb387b
- [Bugfix] Fix misleading context length error messages (#36197) · 43f10573
  Ajay Anubolu authored Mar 05, 2026
```
Signed-off-by: AjAnubolu <anuboluajay@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  43f10573
05 Mar, 2026 1 commit
- [openai api] log exception in exception handler (1/N) (#31164) · 176c799f
  Ning Xie authored Mar 06, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  176c799f
03 Mar, 2026 1 commit

[Frontend][1/n] Improve pooling entrypoints | classify. (#35604) · ea463978

wang.yuqi authored Mar 03, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

ea463978

23 Feb, 2026 1 commit
- [Feature] Lazy import for the "mistral" tokenizer module. (#34651) · 54e2f83d
  Neil Schemenauer authored Feb 23, 2026
```
Signed-off-by: Neil Schemenauer <nas@arctrix.com>
```
  54e2f83d
17 Feb, 2026 1 commit
- [Renderer] Move InputPreprocessor into Renderer (2/2) (#34560) · 574fe752
  Cyrus Leung authored Feb 17, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  574fe752
16 Feb, 2026 1 commit
- [Bugfix] Treat generation_config max_tokens as default not ceiling (#34063) · 72d5951d
  Almog Tavor authored Feb 16, 2026
```
Signed-off-by: almogtavor <almogtavor@gmail.com>
```
  72d5951d
13 Feb, 2026 1 commit

[Refactor] Call renderer for online IO processor request (#34490) · ec090c24

Cyrus Leung authored Feb 13, 2026

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ec090c24

12 Feb, 2026 1 commit
- [Refactor] Pass Renderer to Input Processor (#34329) · b96f7314
  Cyrus Leung authored Feb 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b96f7314
07 Feb, 2026 2 commits
- [Renderer] Define `render_cmpl` and `render_chat` (#34039) · edb359cc
  Cyrus Leung authored Feb 07, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  edb359cc
- [Misc] Simplify `get_max_tokens` (#34036) · 11a4c9d3
  Cyrus Leung authored Feb 07, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  11a4c9d3
06 Feb, 2026 1 commit
- [Refactor] Consolidate sequence normalization and enc-dec parsing (#33928) · cd8b405b
  Cyrus Leung authored Feb 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cd8b405b
05 Feb, 2026 1 commit
- [Misc] Rename `translations` to `speech_to_text` for OAI serving component (#33904) · 20f5d185
  Nicolò Lucchesi authored Feb 05, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  20f5d185
04 Feb, 2026 1 commit
- [1/N] Initial Implementation of Parser for ResponsesAPI (#32712) · e1bf04b6
  Andrew Xia authored Feb 03, 2026
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  e1bf04b6
02 Feb, 2026 1 commit
- [Chore] Remove redundant input parsing methods (#33542) · a502831d
  Cyrus Leung authored Feb 02, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a502831d
01 Feb, 2026 1 commit
- [Bugfix] Fix inconsistent handling of cache reset (#33481) · 79b6ec6a
  Cyrus Leung authored Feb 01, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  79b6ec6a
31 Jan, 2026 1 commit
- [Frontend] Use new Renderer for Completions and Tokenize API (#32863) · f0a1c845
  Cyrus Leung authored Jan 31, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f0a1c845
30 Jan, 2026 1 commit
- Remove deprecated `reasoning_content` message field (#33402) · c5113f60
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c5113f60
29 Jan, 2026 1 commit
- support returning tokenids in responses api (#33212) · 3bba2edb
  cmunley1 authored Jan 29, 2026
```
Signed-off-by: Christian Munley <cmunley@nvidia.com>
```
  3bba2edb
27 Jan, 2026 3 commits

[Frontend] Cleanup serving engine (#33103) · e0b005d9
Cyrus Leung authored Jan 27, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
e0b005d9
[Frontend] Reduce mixin usage in serving pooling (#33101) · c831911b
Cyrus Leung authored Jan 27, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
c831911b

fix: preserve native tool call ID in multi-turn tool calling (#32768) · 2d705343

wangln19 authored Jan 27, 2026


Signed-off-by: wanglinian <wanglinian@stu.pku.edu.cn>
Signed-off-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <2037008807@qq.com>

2d705343

23 Jan, 2026 2 commits

[Refactor] Clean up unused variables & func (#32692) · 37c9859f
Wentao Ye authored Jan 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
37c9859f

[Frontend][3/n] Make pooling entrypoints request schema consensus |... · 05f3d714

wang.yuqi authored Jan 23, 2026


[Frontend][3/n] Make pooling entrypoints request schema consensus | EmbedRequest & ClassifyRequest (#32905)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

05f3d714

22 Jan, 2026 1 commit
- [Frontend] Introduce Renderer for processing chat messages (using `ModelConfig`) (#30200) · d117a4d1
  Cyrus Leung authored Jan 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d117a4d1
19 Jan, 2026 1 commit
- [Frontend] Score entrypoint support data_1 & data_2 and queries & documents as inputs (#32577) · c88860d7
  wang.yuqi authored Jan 19, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  c88860d7
17 Jan, 2026 1 commit
- apply _validate_input to MistralTokenizer token-id chat prompts (#32448) · 037a6487
  vanshil shah authored Jan 16, 2026
```
Signed-off-by: Vanshil Shah <vanshilshah@gmail.com>
```
  037a6487
15 Jan, 2026 2 commits
- [Refactor] [11/N] to simplify the mcp architecture (#32396) · 707b44cc
  Chauncey authored Jan 15, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  707b44cc
- [Refactor] [10/N] to simplify the vLLM openai completion serving architecture (#32369) · 4c1c501a
  Chauncey authored Jan 15, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  4c1c501a
14 Jan, 2026 3 commits
- [Frontend] Standardize use of `create_error_response` (#32319) · 3f28174c
  Cyrus Leung authored Jan 14, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3f28174c
- [Refactor] [9/N] to simplify the vLLM openai translations serving ar chitecture (#32313) · 769d0629
  Chauncey authored Jan 14, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  769d0629
- [Refactor] [8/N] to simplify the vLLM openai responsesapi_serving architecture (#32260) · 9312a6c0
  Chauncey authored Jan 14, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  9312a6c0
13 Jan, 2026 2 commits
- [Refactor] [7/N] to simplify the vLLM lora serving architecture (#32251) · 4f02cb2e
  Chauncey authored Jan 13, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  4f02cb2e
- [Refactor] [6/N] to simplify the vLLM openai chat_completion serving architecture (#32240) · fefce498
  Chauncey authored Jan 13, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  fefce498