Commits · 1752262e96f94d3cf4d236d8d7f3dada2cdb927e · OpenDAS / vllm_cscc

20 Jan, 2026 1 commit

[Feat] allow inplace loading lora (#31326) · 12dab78f

Jackmin801 authored Jan 19, 2026


Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Signed-off-by: Jackmin801 <56836461+Jackmin801@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

12dab78f

19 Jan, 2026 2 commits

[Frontend] Score entrypoint support data_1 & data_2 and queries & documents as inputs (#32577) · c88860d7
wang.yuqi authored Jan 19, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
c88860d7

[Frontend] Add render endpoints for prompt preprocessing (#32473) · 3c8740aa

Hyunkyun Moon authored Jan 19, 2026

Signed-off-by: HyunKyun Moon <mhg5303@gmail.com>
Signed-off-by: Hyunkyun Moon <mhg5303@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

3c8740aa

17 Jan, 2026 1 commit
- apply _validate_input to MistralTokenizer token-id chat prompts (#32448) · 037a6487
  vanshil shah authored Jan 16, 2026
```
Signed-off-by: Vanshil Shah <vanshilshah@gmail.com>
```
  037a6487
16 Jan, 2026 3 commits
- [responsesAPI] allow tuning include_stop_str_in_output (#32383) · 4c82b6fa
  Andrew Xia authored Jan 16, 2026
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  4c82b6fa
- [Frontend][1/n] Make pooling entrypoints request schema consensus | CompletionRequest (#32395) · 4ae77dfd
  wang.yuqi authored Jan 16, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  4ae77dfd
- [bugfix] Fix online serving crash when text type response_format is received (#26822) · 35bf5d08
  cjackal authored Jan 16, 2026
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
Signed-off-by: j0shuajun <59368606+j0shuajun@users.noreply.github.com>
Co-authored-by: j0shuajun <59368606+j0shuajun@users.noreply.github.com>
```
  35bf5d08
15 Jan, 2026 3 commits
- [Refactor] [11/N] to simplify the mcp architecture (#32396) · 707b44cc
  Chauncey authored Jan 15, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  707b44cc
- [Refactor] [10/N] to simplify the vLLM openai completion serving architecture (#32369) · 4c1c501a
  Chauncey authored Jan 15, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  4c1c501a
- Support configure skip_special_tokens in openai response api (#32345) · 375e5984
  Shiyan Deng authored Jan 14, 2026
```
Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
```
  375e5984
14 Jan, 2026 5 commits
- [MODEL] Fix handling of multiple channels for gpt-oss with speculative decoding (#26291) · d084e9fc
  Aleksandr Samarin authored Jan 14, 2026
```
Signed-off-by: Aleksandr Samarin <astrlrd@nebius.com>
Signed-off-by: southfreebird <yvorott@gmail.com>
Co-authored-by: southfreebird <yvorott@gmail.com>
```
  d084e9fc
- [Frontend] track responsesAPI server_load (#32323) · 00e6402d
  Chauncey authored Jan 14, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  00e6402d
- [Frontend] Standardize use of `create_error_response` (#32319) · 3f28174c
  Cyrus Leung authored Jan 14, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3f28174c
- [Refactor] [9/N] to simplify the vLLM openai translations serving ar chitecture (#32313) · 769d0629
  Chauncey authored Jan 14, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  769d0629
- [Refactor] [8/N] to simplify the vLLM openai responsesapi_serving architecture (#32260) · 9312a6c0
  Chauncey authored Jan 14, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  9312a6c0
13 Jan, 2026 4 commits
- [responseAPI] support partial message generation (#32100) · af54d2e2
  Andrew Xia authored Jan 13, 2026
```
Signed-off-by: Andrew Xia <axia@fb.com>
Signed-off-by: Andrew Xia <mitandrewxia@gmail.com>
Signed-off-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  af54d2e2
- [Refactor] [7/N] to simplify the vLLM lora serving architecture (#32251) · 4f02cb2e
  Chauncey authored Jan 13, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  4f02cb2e
- [Refactor] [6/N] to simplify the vLLM openai chat_completion serving architecture (#32240) · fefce498
  Chauncey authored Jan 13, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  fefce498
- [Frontend] Add `reasoning_effort` to `OpenAIServing._preprocess_chat()` (#31956) · 60b77e14
  Sanghoon Yoon authored Jan 13, 2026
```
Signed-off-by: Sanghoon Yoon <seanyoon@kakao.com>
```
  60b77e14
09 Jan, 2026 6 commits
- [responsesAPI] fix incomplete_messages for simple/parsable context (#31836) · 1f8b7c53
  Andrew Xia authored Jan 09, 2026
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  1f8b7c53
- [Frontend][gpt-oss] Allow system message to overwrite model identity (#31737) · f32c629e
  Andrew Xia authored Jan 09, 2026
```
Signed-off-by: lacora <hyelacora@gmail.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: lacora <hyelacora@gmail.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  f32c629e
- Rename --exclude-log-deltas to --enable-log-deltas (#32020) · ac9f9330
  Kevin Šuc authored Jan 09, 2026
```
Signed-off-by: Catacomba <kevinsuc16@gmail.com>
```
  ac9f9330
- [Bugfix] Fix OpenAPI schema test failures (#31921) · 02073280
  Andreas Karatzas authored Jan 09, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  02073280
- [Bugfix] missing tokens occur in harmony streaming (#30437) · e2d49ec2
  RioS authored Jan 09, 2026
```
Signed-off-by: RioS <aa248424@gmail.com>
Signed-off-by: Ri0S <aa248424@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  e2d49ec2
- [Frontend] Add MCP tool streaming support to Responses API (#31761) · a4ec0c55
  daniel-salib authored Jan 08, 2026
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
```
  a4ec0c55
08 Jan, 2026 3 commits

[Frontend] Improve error message (#31987) · aa125ecf
Cyrus Leung authored Jan 09, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
aa125ecf
[OpenAI] Fix tool_choice=required streaming when output has trailing extra data (#31610) · 7645bc52
Mary authored Jan 08, 2026
```
Signed-off-by: maylikenoother <ogedengbemary19@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
7645bc52

[Voxtral] Fix speech transcription api (#31388) · 18d4e481

Patrick von Platen authored Jan 08, 2026


Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>
Co-authored-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

18d4e481

07 Jan, 2026 1 commit
- [OpenAI] Extend VLLMValidationError to additional validation parameters (#31870) · 1ab055ef
  R3hankhan authored Jan 07, 2026
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
  1ab055ef
05 Jan, 2026 2 commits

[Frontend] [Doc] Exclude log deltas feature (#30322) · 79ed460d

Kevin Šuc authored Jan 05, 2026


Signed-off-by: Catacomba <kevinsuc16@gmail.com>
Signed-off-by: Kevin Šuc <kevinsuc16@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

79ed460d

[Frontend] [Bugfix] respect server-level default chat template kwargs in reasoning parser (#31581) · e2701cc5
cjackal authored Jan 05, 2026
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
e2701cc5

04 Jan, 2026 1 commit
- [misc] Sort uvicorn log level description according to verbosity (#31137) · 6522721d
  Ning Xie authored Jan 05, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  6522721d
30 Dec, 2025 2 commits
- [Minor] Various small code cleanups/simplifications (#31508) · 3b312fb7
  Nick Hill authored Dec 29, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  3b312fb7
- feat(frontend): add --default-chat-template-kwargs CLI argument (#31343) · dc837bc2
  Hojin Yang authored Dec 30, 2025
```
Signed-off-by: effortprogrammer <yhjhoward7@gmail.com>
```
  dc837bc2
29 Dec, 2025 2 commits

[Feature] Add offline FastAPI documentation support for air-gapped environments (#30184) · b3a2bdf1

RickyChen / 陳昭儒 authored Dec 30, 2025

Signed-off-by: rickychen-infinirc <ricky.chen@infinirc.com>
Signed-off-by: RickyChen / 陳昭儒 <ricky.chen@infinirc.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

b3a2bdf1

[Bugfix] Preserve tool call id/type/name in streaming finish chunk (#31438) · 9c884faa
amittell authored Dec 29, 2025
```
Signed-off-by: amittell <mittell@me.com>
Signed-off-by: Alex Mittell <mittell@me.com>
```
9c884faa

24 Dec, 2025 2 commits
- [Perf] Add skip_clone to SamplingParams for internal request handling (#31041) · bc5ef333
  Michael Goin authored Dec 24, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  bc5ef333
- [Chore][1/2] Drop `v0.14` deprecations (#31285) · 09dc7c69
  Cyrus Leung authored Dec 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09dc7c69
23 Dec, 2025 2 commits

[OpenAI] Add parameter metadata to validation errors (#30134) · 769f27e7
R3hankhan authored Dec 23, 2025
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
769f27e7

[Frontend] Support using chat template as custom score template for reranking models (#30550) · 23daef54

Jakub Zakrzewski authored Dec 23, 2025


Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

23daef54