Commits · ee484b3f4b0c061d2612ea7c0cb40b44baf680c0 · OpenDAS / vllm_cscc

23 Jan, 2026 2 commits

[Frontend] add logprob, compression_rate to 'verbose_json' features (#31059) · 9b77bb79

sangbumlikeagod authored Jan 24, 2026


Signed-off-by: sangbumlikeagod <oironese@naver.com>
Signed-off-by: sangbumlikeagod <98077576+sangbumlikeagod@users.noreply.github.com>

9b77bb79

[Frontend][3/n] Make pooling entrypoints request schema consensus |... · 05f3d714

wang.yuqi authored Jan 23, 2026


[Frontend][3/n] Make pooling entrypoints request schema consensus | EmbedRequest & ClassifyRequest (#32905)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

05f3d714

22 Jan, 2026 3 commits
- [Misc] Bump opencv-python dependecy version to 4.13 (#32668) · 444e2e7e
  Isotr0py authored Jan 22, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  444e2e7e
- [Frontend] Introduce Renderer for processing chat messages (using `ModelConfig`) (#30200) · d117a4d1
  Cyrus Leung authored Jan 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d117a4d1
- [Frontend][2/n] Make pooling entrypoints request schema consensus | ChatRequest (#32574) · 328cbb27
  wang.yuqi authored Jan 22, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  328cbb27
20 Jan, 2026 2 commits

[Metrics] Complete removal of deprecated vllm:time_per_output_token_seconds metric (#32661) · bb917203

杨朱 · Kiki authored Jan 20, 2026



This PR completes the removal of the deprecated vllm:time_per_output_token_seconds
metric that was deprecated in v0.11, hidden in v0.12, scheduled for removal in v0.13,
but delayed until v0.15.
Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Haiku 4.5 <noreply@anthropic.com>

bb917203

[Feat] allow inplace loading lora (#31326) · 12dab78f

Jackmin801 authored Jan 19, 2026


Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Signed-off-by: Jackmin801 <56836461+Jackmin801@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

12dab78f

19 Jan, 2026 4 commits
- [Frontend] Score entrypoint support data_1 & data_2 and queries & documents as inputs (#32577) · c88860d7
  wang.yuqi authored Jan 19, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  c88860d7
- [Core] Whisper support `torch.compile` (#30385) · 74c583bc
  Nicolò Lucchesi authored Jan 19, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  74c583bc
- [Frontend] Add render endpoints for prompt preprocessing (#32473) · 3c8740aa
  Hyunkyun Moon authored Jan 19, 2026
```
Signed-off-by: HyunKyun Moon <mhg5303@gmail.com>
Signed-off-by: Hyunkyun Moon <mhg5303@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  3c8740aa
- [CI/Build] Use Common Event Map Fixture in Harmony / MCP Server Tests (#32531) · 7518a3dc
  Alex Brooks authored Jan 18, 2026
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  7518a3dc
17 Jan, 2026 1 commit
- apply _validate_input to MistralTokenizer token-id chat prompts (#32448) · 037a6487
  vanshil shah authored Jan 16, 2026
```
Signed-off-by: Vanshil Shah <vanshilshah@gmail.com>
```
  037a6487
16 Jan, 2026 3 commits
- [Frontend][1/n] Make pooling entrypoints request schema consensus | CompletionRequest (#32395) · 4ae77dfd
  wang.yuqi authored Jan 16, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  4ae77dfd
- [bugfix] Fix online serving crash when text type response_format is received (#26822) · 35bf5d08
  cjackal authored Jan 16, 2026
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
Signed-off-by: j0shuajun <59368606+j0shuajun@users.noreply.github.com>
Co-authored-by: j0shuajun <59368606+j0shuajun@users.noreply.github.com>
```
  35bf5d08
- [ROCm][CI] Enable AITER Unified Attention On ROCm For gpt-oss Test (#32431) · 46f8a982
  Micah Williamson authored Jan 15, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  46f8a982
15 Jan, 2026 3 commits
- [3/N] Group together media-related code (#32406) · 28459785
  Cyrus Leung authored Jan 15, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  28459785
- [Refactor] [11/N] to simplify the mcp architecture (#32396) · 707b44cc
  Chauncey authored Jan 15, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  707b44cc
- [Refactor] [10/N] to simplify the vLLM openai completion serving architecture (#32369) · 4c1c501a
  Chauncey authored Jan 15, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  4c1c501a
14 Jan, 2026 2 commits
- [MODEL] Fix handling of multiple channels for gpt-oss with speculative decoding (#26291) · d084e9fc
  Aleksandr Samarin authored Jan 14, 2026
```
Signed-off-by: Aleksandr Samarin <astrlrd@nebius.com>
Signed-off-by: southfreebird <yvorott@gmail.com>
Co-authored-by: southfreebird <yvorott@gmail.com>
```
  d084e9fc
- [Refactor] [8/N] to simplify the vLLM openai responsesapi_serving architecture (#32260) · 9312a6c0
  Chauncey authored Jan 14, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  9312a6c0
13 Jan, 2026 5 commits
- [responseAPI] support partial message generation (#32100) · af54d2e2
  Andrew Xia authored Jan 13, 2026
```
Signed-off-by: Andrew Xia <axia@fb.com>
Signed-off-by: Andrew Xia <mitandrewxia@gmail.com>
Signed-off-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  af54d2e2
- [Refactor] [7/N] to simplify the vLLM lora serving architecture (#32251) · 4f02cb2e
  Chauncey authored Jan 13, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  4f02cb2e
- [Refactor] [6/N] to simplify the vLLM openai chat_completion serving architecture (#32240) · fefce498
  Chauncey authored Jan 13, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  fefce498
- [Bugfix] Replace `PoolingParams.normalize` with `use_activation` (#32243) · 232214b2
  Cyrus Leung authored Jan 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  232214b2
- [responsesAPI] add unit test for optional function tool call id (#32036) · a307ac07
  Andrew Xia authored Jan 12, 2026
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  a307ac07
12 Jan, 2026 1 commit
- [Frontend] Fix Flaky MCP Streaming Test (#32153) · d7b2e570
  daniel-salib authored Jan 12, 2026
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
```
  d7b2e570
11 Jan, 2026 1 commit
- [CI/Build] Separate out flaky responses API tests (#32110) · a3745321
  Cyrus Leung authored Jan 11, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a3745321
10 Jan, 2026 1 commit
- [ROCm][CI] Fix flaky `test_function_calling_with_stream` and reduce schema test examples (#32063) · d83becd5
  Andreas Karatzas authored Jan 09, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  d83becd5
09 Jan, 2026 5 commits
- [responsesAPI] fix incomplete_messages for simple/parsable context (#31836) · 1f8b7c53
  Andrew Xia authored Jan 09, 2026
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  1f8b7c53
- [Frontend][gpt-oss] Allow system message to overwrite model identity (#31737) · f32c629e
  Andrew Xia authored Jan 09, 2026
```
Signed-off-by: lacora <hyelacora@gmail.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: lacora <hyelacora@gmail.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  f32c629e
- [Bugfix] Fix OpenAPI schema test failures (#31921) · 02073280
  Andreas Karatzas authored Jan 09, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  02073280
- [CI] [ROCm] Fix `tests/entrypoints/test_grpc_server.py` on ROCm (#31970) · 7a05d2dc
  TJian authored Jan 09, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  7a05d2dc
- [Frontend] Add MCP tool streaming support to Responses API (#31761) · a4ec0c55
  daniel-salib authored Jan 08, 2026
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
```
  a4ec0c55
08 Jan, 2026 2 commits

[Frontend] Improve error message (#31987) · aa125ecf
Cyrus Leung authored Jan 09, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
aa125ecf

[grpc] Support gRPC server entrypoint (#30190) · 791b2fc3

Chang Su authored Jan 07, 2026


Signed-off-by: Chang Su <chang.s.su@oracle.com>
Signed-off-by: njhill <nickhill123@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: njhill <nickhill123@gmail.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

791b2fc3

06 Jan, 2026 1 commit
- [Model] rename use_pad_token to use_sep_token (#31784) · 96860af6
  wang.yuqi authored Jan 06, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  96860af6
03 Jan, 2026 1 commit
- [CI][Bugfix] Fix token counting in chunked prefill compl test (#31630) · 4f9ce35a
  Andreas Karatzas authored Jan 03, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  4f9ce35a
31 Dec, 2025 1 commit
- [CI][Bugfix] Fix token counting in chunked prefill streaming test (#31565) · 21de6d4b
  Andreas Karatzas authored Dec 31, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  21de6d4b
30 Dec, 2025 1 commit
- feat(frontend): add --default-chat-template-kwargs CLI argument (#31343) · dc837bc2
  Hojin Yang authored Dec 30, 2025
```
Signed-off-by: effortprogrammer <yhjhoward7@gmail.com>
```
  dc837bc2
29 Dec, 2025 1 commit
- [Bugfix] Preserve tool call id/type/name in streaming finish chunk (#31438) · 9c884faa
  amittell authored Dec 29, 2025
```
Signed-off-by: amittell <mittell@me.com>
Signed-off-by: Alex Mittell <mittell@me.com>
```
  9c884faa