Commits · 421012b63ae2e3f26bba0506e9f3951e9dc53ded · OpenDAS / vllm_cscc

22 Jan, 2026 2 commits
- [Frontend] add prompt_cache_key for openresponses (#32824) · 841d53aa
  Chauncey authored Jan 22, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  841d53aa
- [Frontend][2/n] Make pooling entrypoints request schema consensus | ChatRequest (#32574) · 328cbb27
  wang.yuqi authored Jan 22, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  328cbb27
20 Jan, 2026 1 commit

[Feat] allow inplace loading lora (#31326) · 12dab78f

Jackmin801 authored Jan 19, 2026


Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Signed-off-by: Jackmin801 <56836461+Jackmin801@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

12dab78f

19 Jan, 2026 2 commits

[Frontend] Score entrypoint support data_1 & data_2 and queries & documents as inputs (#32577) · c88860d7
wang.yuqi authored Jan 19, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
c88860d7

[Frontend] Add render endpoints for prompt preprocessing (#32473) · 3c8740aa

Hyunkyun Moon authored Jan 19, 2026

Signed-off-by: HyunKyun Moon <mhg5303@gmail.com>
Signed-off-by: Hyunkyun Moon <mhg5303@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

3c8740aa

17 Jan, 2026 1 commit
- apply _validate_input to MistralTokenizer token-id chat prompts (#32448) · 037a6487
  vanshil shah authored Jan 16, 2026
```
Signed-off-by: Vanshil Shah <vanshilshah@gmail.com>
```
  037a6487
16 Jan, 2026 3 commits
- [responsesAPI] allow tuning include_stop_str_in_output (#32383) · 4c82b6fa
  Andrew Xia authored Jan 16, 2026
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  4c82b6fa
- [Frontend][1/n] Make pooling entrypoints request schema consensus | CompletionRequest (#32395) · 4ae77dfd
  wang.yuqi authored Jan 16, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  4ae77dfd
- [bugfix] Fix online serving crash when text type response_format is received (#26822) · 35bf5d08
  cjackal authored Jan 16, 2026
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
Signed-off-by: j0shuajun <59368606+j0shuajun@users.noreply.github.com>
Co-authored-by: j0shuajun <59368606+j0shuajun@users.noreply.github.com>
```
  35bf5d08
15 Jan, 2026 5 commits
- [Refactor] Remove unused file (#32422) · aca5c514
  Wentao Ye authored Jan 15, 2026
  
  aca5c514
- [Refactor] [11/N] to simplify the mcp architecture (#32396) · 707b44cc
  Chauncey authored Jan 15, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  707b44cc
- [Bugfix] Strengthen the check of X-data-parallel-rank in Hybrid LB mode (#32314) · 1e584823
  dtc authored Jan 15, 2026
```
Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
```
  1e584823
- [Refactor] [10/N] to simplify the vLLM openai completion serving architecture (#32369) · 4c1c501a
  Chauncey authored Jan 15, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  4c1c501a
- Support configure skip_special_tokens in openai response api (#32345) · 375e5984
  Shiyan Deng authored Jan 14, 2026
```
Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
```
  375e5984
14 Jan, 2026 6 commits
- [MODEL] Fix handling of multiple channels for gpt-oss with speculative decoding (#26291) · d084e9fc
  Aleksandr Samarin authored Jan 14, 2026
```
Signed-off-by: Aleksandr Samarin <astrlrd@nebius.com>
Signed-off-by: southfreebird <yvorott@gmail.com>
Co-authored-by: southfreebird <yvorott@gmail.com>
```
  d084e9fc
- rename tokenize serving api request id prefix to tokenize (#32328) · 552b2629
  Ning Xie authored Jan 14, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  552b2629
- [Frontend] track responsesAPI server_load (#32323) · 00e6402d
  Chauncey authored Jan 14, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  00e6402d
- [Frontend] Standardize use of `create_error_response` (#32319) · 3f28174c
  Cyrus Leung authored Jan 14, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3f28174c
- [Refactor] [9/N] to simplify the vLLM openai translations serving ar chitecture (#32313) · 769d0629
  Chauncey authored Jan 14, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  769d0629
- [Refactor] [8/N] to simplify the vLLM openai responsesapi_serving architecture (#32260) · 9312a6c0
  Chauncey authored Jan 14, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  9312a6c0
13 Jan, 2026 5 commits
- [responseAPI] support partial message generation (#32100) · af54d2e2
  Andrew Xia authored Jan 13, 2026
```
Signed-off-by: Andrew Xia <axia@fb.com>
Signed-off-by: Andrew Xia <mitandrewxia@gmail.com>
Signed-off-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  af54d2e2
- [Refactor] [7/N] to simplify the vLLM lora serving architecture (#32251) · 4f02cb2e
  Chauncey authored Jan 13, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  4f02cb2e
- [Refactor] [6/N] to simplify the vLLM openai chat_completion serving architecture (#32240) · fefce498
  Chauncey authored Jan 13, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  fefce498
- [Bugfix] Replace `PoolingParams.normalize` with `use_activation` (#32243) · 232214b2
  Cyrus Leung authored Jan 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  232214b2
- [Frontend] Add `reasoning_effort` to `OpenAIServing._preprocess_chat()` (#31956) · 60b77e14
  Sanghoon Yoon authored Jan 13, 2026
```
Signed-off-by: Sanghoon Yoon <seanyoon@kakao.com>
```
  60b77e14
12 Jan, 2026 1 commit

[Feature] Support recording expert indices for rollout router replay (#28284) · 49e6b86c

Hongxin Xu authored Jan 12, 2026


Signed-off-by: xhx1022 <1737006628@qq.com>
Signed-off-by: Hongxin Xu <70438206+xhx1022@users.noreply.github.com>
Signed-off-by: arlenxu <arlenxu@tencent.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: arlenxu <arlenxu@tencent.com>

49e6b86c

10 Jan, 2026 1 commit
- [Refactor] Separate sequence and token pooling types (#32026) · 583a90e0
  Cyrus Leung authored Jan 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  583a90e0
09 Jan, 2026 8 commits
- [responsesAPI] fix incomplete_messages for simple/parsable context (#31836) · 1f8b7c53
  Andrew Xia authored Jan 09, 2026
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  1f8b7c53
- [Frontend][gpt-oss] Allow system message to overwrite model identity (#31737) · f32c629e
  Andrew Xia authored Jan 09, 2026
```
Signed-off-by: lacora <hyelacora@gmail.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: lacora <hyelacora@gmail.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  f32c629e
- [UX] Add vLLM model inspection view (#29450) · d5ec6c05
  Michael Goin authored Jan 09, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  d5ec6c05
- Rename --exclude-log-deltas to --enable-log-deltas (#32020) · ac9f9330
  Kevin Šuc authored Jan 09, 2026
```
Signed-off-by: Catacomba <kevinsuc16@gmail.com>
```
  ac9f9330
- Fix type error (#31999) · bbf80ede
  Adolfo Victoria authored Jan 09, 2026
```
Signed-off-by: Adolfo Victoria <adolfokarim@gmail.com>
Co-authored-by: Adolfo Victoria <adovi@meta.com>
```
  bbf80ede
- [Bugfix] Fix OpenAPI schema test failures (#31921) · 02073280
  Andreas Karatzas authored Jan 09, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  02073280
- [Bugfix] missing tokens occur in harmony streaming (#30437) · e2d49ec2
  RioS authored Jan 09, 2026
```
Signed-off-by: RioS <aa248424@gmail.com>
Signed-off-by: Ri0S <aa248424@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  e2d49ec2
- [Frontend] Add MCP tool streaming support to Responses API (#31761) · a4ec0c55
  daniel-salib authored Jan 08, 2026
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
```
  a4ec0c55
08 Jan, 2026 5 commits

[Frontend] Improve error message (#31987) · aa125ecf
Cyrus Leung authored Jan 09, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
aa125ecf
[OpenAI] Fix tool_choice=required streaming when output has trailing extra data (#31610) · 7645bc52
Mary authored Jan 08, 2026
```
Signed-off-by: maylikenoother <ogedengbemary19@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
7645bc52

[Voxtral] Fix speech transcription api (#31388) · 18d4e481

Patrick von Platen authored Jan 08, 2026


Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>
Co-authored-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

18d4e481

[Models] Allow converting Qwen3-VL into Reranker model (#31890) · eac3b96e
Isotr0py authored Jan 08, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
eac3b96e

[grpc] Support gRPC server entrypoint (#30190) · 791b2fc3

Chang Su authored Jan 07, 2026


Signed-off-by: Chang Su <chang.s.su@oracle.com>
Signed-off-by: njhill <nickhill123@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: njhill <nickhill123@gmail.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

791b2fc3