Commits · ba871fb788f5036b8f55f61ffc7c05e367dacc5a · OpenDAS / vllm_cscc

01 Feb, 2026 1 commit
- [Bugfix] Fix inconsistent handling of cache reset (#33481) · 79b6ec6a
  Cyrus Leung authored Feb 01, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  79b6ec6a
31 Jan, 2026 1 commit
- [Frontend] Use new Renderer for Completions and Tokenize API (#32863) · f0a1c845
  Cyrus Leung authored Jan 31, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f0a1c845
29 Jan, 2026 1 commit
- support returning tokenids in responses api (#33212) · 3bba2edb
  cmunley1 authored Jan 29, 2026
```
Signed-off-by: Christian Munley <cmunley@nvidia.com>
```
  3bba2edb
27 Jan, 2026 3 commits

[Frontend] Cleanup serving engine (#33103) · e0b005d9
Cyrus Leung authored Jan 27, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
e0b005d9
[Frontend] Reduce mixin usage in serving pooling (#33101) · c831911b
Cyrus Leung authored Jan 27, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
c831911b

fix: preserve native tool call ID in multi-turn tool calling (#32768) · 2d705343

wangln19 authored Jan 27, 2026


Signed-off-by: wanglinian <wanglinian@stu.pku.edu.cn>
Signed-off-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <2037008807@qq.com>

2d705343

23 Jan, 2026 1 commit

[Frontend][3/n] Make pooling entrypoints request schema consensus |... · 05f3d714

wang.yuqi authored Jan 23, 2026


[Frontend][3/n] Make pooling entrypoints request schema consensus | EmbedRequest & ClassifyRequest (#32905)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

05f3d714

22 Jan, 2026 1 commit
- [Frontend] Introduce Renderer for processing chat messages (using `ModelConfig`) (#30200) · d117a4d1
  Cyrus Leung authored Jan 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d117a4d1
19 Jan, 2026 1 commit
- [Frontend] Score entrypoint support data_1 & data_2 and queries & documents as inputs (#32577) · c88860d7
  wang.yuqi authored Jan 19, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  c88860d7
17 Jan, 2026 1 commit
- apply _validate_input to MistralTokenizer token-id chat prompts (#32448) · 037a6487
  vanshil shah authored Jan 16, 2026
```
Signed-off-by: Vanshil Shah <vanshilshah@gmail.com>
```
  037a6487
15 Jan, 2026 2 commits
- [Refactor] [11/N] to simplify the mcp architecture (#32396) · 707b44cc
  Chauncey authored Jan 15, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  707b44cc
- [Refactor] [10/N] to simplify the vLLM openai completion serving architecture (#32369) · 4c1c501a
  Chauncey authored Jan 15, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  4c1c501a
14 Jan, 2026 3 commits
- [Frontend] Standardize use of `create_error_response` (#32319) · 3f28174c
  Cyrus Leung authored Jan 14, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3f28174c
- [Refactor] [9/N] to simplify the vLLM openai translations serving ar chitecture (#32313) · 769d0629
  Chauncey authored Jan 14, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  769d0629
- [Refactor] [8/N] to simplify the vLLM openai responsesapi_serving architecture (#32260) · 9312a6c0
  Chauncey authored Jan 14, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  9312a6c0
13 Jan, 2026 1 commit
- [Refactor] [6/N] to simplify the vLLM openai chat_completion serving architecture (#32240) · fefce498
  Chauncey authored Jan 13, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  fefce498
07 Jan, 2026 1 commit
- [OpenAI] Extend VLLMValidationError to additional validation parameters (#31870) · 1ab055ef
  R3hankhan authored Jan 07, 2026
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
  1ab055ef
05 Jan, 2026 1 commit
- [Frontend] [Bugfix] respect server-level default chat template kwargs in reasoning parser (#31581) · e2701cc5
  cjackal authored Jan 05, 2026
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  e2701cc5
30 Dec, 2025 1 commit
- feat(frontend): add --default-chat-template-kwargs CLI argument (#31343) · dc837bc2
  Hojin Yang authored Dec 30, 2025
```
Signed-off-by: effortprogrammer <yhjhoward7@gmail.com>
```
  dc837bc2
23 Dec, 2025 1 commit
- [OpenAI] Add parameter metadata to validation errors (#30134) · 769f27e7
  R3hankhan authored Dec 23, 2025
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
  769f27e7
18 Dec, 2025 1 commit
- [Bugfix] fix DP-aware routing in OpenAI API requests (#29002) · 500f26e6
  inkcherry authored Dec 19, 2025
```
Signed-off-by: inkcherry <mingzhi.liu@amd.com>
```
  500f26e6
15 Dec, 2025 2 commits
- [Refactor] [2/N] Move tool parsers into the vLLM main directory (#30675) · 2a1776b7
  Chauncey authored Dec 15, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  2a1776b7
- [Bugfix] Fix deepseek_v32 tokenizer_mode (#30658) · a524d1ba
  Jee Jee Li authored Dec 15, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a524d1ba
14 Dec, 2025 1 commit
- [Chore] Remove redundant `RequestPrompt` (#30612) · dcb31196
  Cyrus Leung authored Dec 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dcb31196
13 Dec, 2025 1 commit
- [Chore] Adjust tokenizer import to avoid circular imports (#30601) · 64251f48
  Cyrus Leung authored Dec 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  64251f48
10 Dec, 2025 2 commits

[P/D] KV Load Failure Recovery/Abort Configuration (#26813) · a9e4106f

Will Eaton authored Dec 10, 2025


Signed-off-by: Will Eaton <weaton@redhat.com>
Signed-off-by: Will Eaton <me@wseaton.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: chaunceyjiang <chaunceyjiang@gmail.com>

a9e4106f

[responsesAPI][6] Fix multi turn MCP tokenization (#30230) · c3487aca
Andrew Xia authored Dec 09, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
c3487aca

07 Dec, 2025 2 commits
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
05 Dec, 2025 1 commit

[responsesAPI][5] ResponsesParser with tools for full MCP python loop (#29798) · da7bc54e

Andrew Xia authored Dec 05, 2025


Signed-off-by: Andrew Xia <axia@fb.com>
Signed-off-by: Andrew Xia <axia@meta.com>
Co-authored-by: Andrew Xia <axia@fb.com>

da7bc54e

04 Dec, 2025 1 commit
- [Misc] Various cleanups for MM input processing (#29970) · 9ae2f603
  Cyrus Leung authored Dec 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9ae2f603
03 Dec, 2025 2 commits
- [Frontend] supports deepseekv32 chat template (#29837) · b78772c4
  Chauncey authored Dec 03, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  b78772c4
- [Refactor] [1/N] to simplify the vLLM serving architecture (#28040) · 3f42b05f
  Chauncey authored Dec 03, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  3f42b05f
01 Dec, 2025 1 commit
- [Frontend] Resettle pooling entrypoints (#29634) · 62de4f42
  wang.yuqi authored Dec 01, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  62de4f42
29 Nov, 2025 2 commits
- [Chore] Enable passing `tokenizer=None` into MM processor (#29724) · fe3398fa
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fe3398fa
- [Misc] Refactor tokenizer interface (#29693) · 34a98427
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34a98427
28 Nov, 2025 1 commit
- [Chore] Rename `Processor` to `InputProcessor` (#29682) · 8d9338fa
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8d9338fa
25 Nov, 2025 3 commits
- [Frontend] Respect Chat Completion parallel_tool_calls param (#26233) · e1dd706c
  Ben Browning authored Nov 25, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  e1dd706c
- [Misc] Streamline unique id generation (#29375) · db290610
  Nick Hill authored Nov 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  db290610
- [BugFix] Fix duplicate id tool-call race condition (#29355) · a178a0b4
  Nick Hill authored Nov 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  a178a0b4