Commits · f16bfbe5bc8f9045e7bb38d72ab35764bab22e44 · OpenDAS / vllm_cscc

08 Jan, 2026 4 commits

[OpenAI] Fix tool_choice=required streaming when output has trailing extra data (#31610) · 7645bc52
Mary authored Jan 08, 2026
```
Signed-off-by: maylikenoother <ogedengbemary19@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
7645bc52

[Voxtral] Fix speech transcription api (#31388) · 18d4e481

Patrick von Platen authored Jan 08, 2026


Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>
Co-authored-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

18d4e481

[Models] Allow converting Qwen3-VL into Reranker model (#31890) · eac3b96e
Isotr0py authored Jan 08, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
eac3b96e

[grpc] Support gRPC server entrypoint (#30190) · 791b2fc3

Chang Su authored Jan 07, 2026


Signed-off-by: Chang Su <chang.s.su@oracle.com>
Signed-off-by: njhill <nickhill123@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: njhill <nickhill123@gmail.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

791b2fc3

07 Jan, 2026 2 commits
- UX: add vLLM env info in '/server_info' (#31899) · 30399cc7
  Jee Jee Li authored Jan 08, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  30399cc7
- [OpenAI] Extend VLLMValidationError to additional validation parameters (#31870) · 1ab055ef
  R3hankhan authored Jan 07, 2026
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
  1ab055ef
06 Jan, 2026 1 commit
- [Model] rename use_pad_token to use_sep_token (#31784) · 96860af6
  wang.yuqi authored Jan 06, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  96860af6
05 Jan, 2026 3 commits
- [Frontend] [Doc] Exclude log deltas feature (#30322) · 79ed460d
  Kevin Šuc authored Jan 05, 2026
```
Signed-off-by: Catacomba <kevinsuc16@gmail.com>
Signed-off-by: Kevin Šuc <kevinsuc16@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  79ed460d
- [Frontend] [Bugfix] respect server-level default chat template kwargs in reasoning parser (#31581) · e2701cc5
  cjackal authored Jan 05, 2026
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  e2701cc5
- [log] enable max_log_len trim only when needed (#31482) · 98b8b3ab
  Ning Xie authored Jan 05, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  98b8b3ab
04 Jan, 2026 1 commit
- [misc] Sort uvicorn log level description according to verbosity (#31137) · 6522721d
  Ning Xie authored Jan 05, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  6522721d
02 Jan, 2026 1 commit

Add Multimodal Processor Benchmark (#29105) · 1f5b7c41

Reagan Lee authored Jan 01, 2026


Signed-off-by: Reagan Lee <reaganjlee@gmail.com>
Signed-off-by: Reagan <reaganjlee@gmail.com>

1f5b7c41

30 Dec, 2025 3 commits
- [Frontend] add continue_final_message parameter to /embeddings endpoint (#31497) · 51085c2a
  Kevin authored Dec 29, 2025
```
Signed-off-by: Kevin P-W <140451262+kevin-pw@users.noreply.github.com>
```
  51085c2a
- [Minor] Various small code cleanups/simplifications (#31508) · 3b312fb7
  Nick Hill authored Dec 29, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  3b312fb7
- feat(frontend): add --default-chat-template-kwargs CLI argument (#31343) · dc837bc2
  Hojin Yang authored Dec 30, 2025
```
Signed-off-by: effortprogrammer <yhjhoward7@gmail.com>
```
  dc837bc2
29 Dec, 2025 3 commits

[Feature] Add offline FastAPI documentation support for air-gapped environments (#30184) · b3a2bdf1

RickyChen / 陳昭儒 authored Dec 30, 2025

Signed-off-by: rickychen-infinirc <ricky.chen@infinirc.com>
Signed-off-by: RickyChen / 陳昭儒 <ricky.chen@infinirc.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

b3a2bdf1

[Bugfix] Preserve tool call id/type/name in streaming finish chunk (#31438) · 9c884faa
amittell authored Dec 29, 2025
```
Signed-off-by: amittell <mittell@me.com>
Signed-off-by: Alex Mittell <mittell@me.com>
```
9c884faa

[Bugfix][Frontend] Fix Jina reranker multimodal input compatibility (#31445) · bf73a3e4

twj authored Dec 29, 2025

Signed-off-by: tianwenjing <tianwenjing@jfgenius.com>
Signed-off-by: twj <151701930+twjww@users.noreply.github.com>
Co-authored-by: tianwenjing <tianwenjing@jfgenius.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

bf73a3e4

24 Dec, 2025 5 commits
- [Perf] Add skip_clone to SamplingParams for internal request handling (#31041) · bc5ef333
  Michael Goin authored Dec 24, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  bc5ef333
- [Chore][1/2] Drop `v0.14` deprecations (#31285) · 09dc7c69
  Cyrus Leung authored Dec 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09dc7c69
- [cli] complete vllm cli help message (#31226) · 5d930896
  Ning Xie authored Dec 24, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  5d930896
- [Chore] Remove unused `noqa`s (#31263) · aa3868ec
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aa3868ec
- [ROCm][CI] Fix entrypoints tests and Python-only installation test on ROCm (#28979) · 0247a91e
  Andreas Karatzas authored Dec 24, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  0247a91e
23 Dec, 2025 3 commits

[Core] Add a random suffix to frontend-provided request IDs (#27987) · f7900686

Mark McLoughlin authored Dec 23, 2025


Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

f7900686

[OpenAI] Add parameter metadata to validation errors (#30134) · 769f27e7
R3hankhan authored Dec 23, 2025
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
769f27e7

[Frontend] Support using chat template as custom score template for reranking models (#30550) · 23daef54

Jakub Zakrzewski authored Dec 23, 2025


Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

23daef54

22 Dec, 2025 1 commit
- [gpt-oss] Fix harmony parser in streaming responses (#30205) · bd6d5a74
  AlonKejzman authored Dec 22, 2025
```
Signed-off-by: AlonKejzman <alonkeizman@gmail.com>
```
  bd6d5a74
21 Dec, 2025 1 commit

[BugFix]fix gpt-oss v1/completions response bug (#30608) · 3e92b2b7

汪志鹏 authored Dec 21, 2025


Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: bbrowning <bbrownin@redhat.com>

3e92b2b7

19 Dec, 2025 3 commits

[Frontend][Bug] allow tool calls in analysis channel (#28139) · 45594967

Marko Rosenmueller authored Dec 19, 2025


Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

45594967

[Bugfix] Add validation for tool requests when tool_parser is unavailable (#30613) · 086b9633
lif authored Dec 19, 2025
```
Signed-off-by: majiayu000 <1835304752@qq.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
086b9633

[Bugfix] Fix tool_choice="none" being ignored by GPT-OSS/harmony models (#30867) · 6a09612b

PlatinumGod authored Dec 19, 2025


Signed-off-by: yujiepu <pyjapple@gmail.com>
Signed-off-by: PlatinumGod <pyjapple@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

6a09612b

18 Dec, 2025 3 commits
- [Bugfix] fix DP-aware routing in OpenAI API requests (#29002) · 500f26e6
  inkcherry authored Dec 19, 2025
```
Signed-off-by: inkcherry <mingzhi.liu@amd.com>
```
  500f26e6
- fix: add warmup for audio preprocessing (#30706) · fc2ae6d6
  Nathan Price authored Dec 18, 2025
```
Signed-off-by: Nathan Price <nathan@abridge.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  fc2ae6d6
- feat(api): Eager chat template warmup to eliminate first-request latency (#30700) · 05a83dc6
  Nathan Price authored Dec 17, 2025
```
Signed-off-by: Nathan Price <nathan@abridge.com>
```
  05a83dc6
17 Dec, 2025 2 commits
- [Refactor] [4/N] Move VLLM_SERVER_DEV endpoints into the serve directory (#30749) · 9ad5b217
  Chauncey authored Dec 17, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  9ad5b217
- [Doc][ResponsesAPI] add documentation (#30840) · 4c054d89
  Andrew Xia authored Dec 17, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  4c054d89
16 Dec, 2025 3 commits
- [Frontend] Add `max-completion-token` option to transcription/translation endpoints (#30769) · ca702a14
  Nicolò Lucchesi authored Dec 16, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  ca702a14
- [responsesAPI][8] input/output messages for ResponsesParser (#30158) · 0d0c929f
  Andrew Xia authored Dec 16, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Signed-off-by: Andrew Xia <axia@meta.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  0d0c929f
- [Bugfix] fix streaming final output for non harmony (#30237) · bbd850e5
  penfree authored Dec 16, 2025
```
Signed-off-by: penfree <qiupengfei@baidu.com>
Co-authored-by: penfree <qiupengfei@baidu.com>
```
  bbd850e5
15 Dec, 2025 1 commit
- [UX][Attention] Add `attention_config` argument to `LLM()` (#30710) · a182be43
  Matthew Bonanni authored Dec 15, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  a182be43