Commits · fe714dd5071d1e1f829ecfe4ee10d0d7e6144b5f · OpenDAS / vllm_cscc

11 Mar, 2026 1 commit
- [openapi server] log exception in exception handler(2/N) (#36201) · fe714dd5
  Ning Xie authored Mar 11, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  fe714dd5
10 Mar, 2026 6 commits

fix: check HTTP status in batch read_file to prevent silent failures (#36397) · cf88b237

Alvin Tang authored Mar 10, 2026


Signed-off-by: gambletan <ethanchang32@gmail.com>
Co-authored-by: gambletan <ethanchang32@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

cf88b237

[Model] Consolidate score logic by introduce score_type (#36479) · a3189a08
wang.yuqi authored Mar 10, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
a3189a08
[Frontend][Core] Revert "Add shutdown timeout" (#34730 and #36270) (#36628) · 23486039
Mark McLoughlin authored Mar 10, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
23486039

feat(grpc): extract gRPC servicer into smg-grpc-servicer package, add --grpc... · 507ddbe9

Chang Su authored Mar 10, 2026

feat(grpc): extract gRPC servicer into smg-grpc-servicer package, add --grpc flag to vllm serve (#36169)
Signed-off-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

507ddbe9

[Perf] Compute maxsim in worker side, reducing redundant copies, 2.7% E2E... · 7279374f

Wentao Ye authored Mar 09, 2026


[Perf] Compute maxsim in worker side, reducing redundant copies, 2.7% E2E throughput improvement (#36159)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

7279374f

[Model] Add HyperCLOVAX-SEED-Think-32B vision-language model support (#31471) · 0836be3b
Hojin Yang authored Mar 10, 2026
```
Signed-off-by: effortprogrammer <yhjhoward7@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
0836be3b

09 Mar, 2026 5 commits
- [Refactor] Simplify `chat_completion_full_generator` for tool parsers (#35634) · 941e52c2
  Wentao Ye authored Mar 09, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  941e52c2
- Support online use_audio_in_video (#36319) · 5578f2a4
  Tianyu Guo authored Mar 09, 2026
```
Signed-off-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  5578f2a4
- [Frontend] Move warmup into Renderer (#36482) · 3ec21150
  Cyrus Leung authored Mar 09, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3ec21150
- [Frontend] Add Support for MM Encoder/Decoder Beam Search (Online Transcriptions) (#36160) · 65a4da15
  Alex Brooks authored Mar 08, 2026
```
Signed-off-by: Alex Brooks <albrooks@redhat.com>
```
  65a4da15
- [Frontend][2/n] Improve pooling entrypoints | embed. (#36110) · fff3711a
  wang.yuqi authored Mar 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
```
  fff3711a
08 Mar, 2026 1 commit
- [Frontend] Add GPU-less render serving path (`vllm launch render`) (#36166) · 4497431d
  Sage authored Mar 08, 2026
  
  4497431d
07 Mar, 2026 2 commits
- [V0 Deprecation] Remove unused swap_space parameter (#36216) · 00b814ba
  lif authored Mar 07, 2026
```
Signed-off-by: majiayu000 <1835304752@qq.com>
Co-authored-by: mcelrath
```
  00b814ba
- feat: expose media_io_kwargs at runtime (#34778) · 755356b3
  milesial authored Mar 06, 2026
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  755356b3
06 Mar, 2026 5 commits
- [Frontend] Add Support for MM Encoder/Decoder Beam Search (Offline) (#36153) · 10f4db4d
  Alex Brooks authored Mar 06, 2026
```
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  10f4db4d
- Change "following fields were present in the request but ignored" log from warn to debug (#36173) · 5afb387b
  Tyler Michael Smith authored Mar 06, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  5afb387b
- [Bugfix] Fix misleading context length error messages (#36197) · 43f10573
  Ajay Anubolu authored Mar 05, 2026
```
Signed-off-by: AjAnubolu <anuboluajay@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  43f10573
- [Frontend][Core] Add shutdown timeout - allowing in-flight requests to finish (#34730) · 27066d1b
  Mark McLoughlin authored Mar 06, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
```
  27066d1b
- [Bug] Fix a corner case in _process_simple_streaming_events (#34754) · 8e87cc57
  Shiyan Deng authored Mar 05, 2026
```
Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  8e87cc57
05 Mar, 2026 3 commits

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

[openai api] log exception in exception handler (1/N) (#31164) · 176c799f
Ning Xie authored Mar 06, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
176c799f
[Misc] Fix SyntaxWarning - invalid escape sequence '\e' (#36020) · a708ef59
cjackal authored Mar 05, 2026
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
a708ef59

04 Mar, 2026 4 commits

[Docs] Document security risks of GPT-OSS Python tool (#35139) · 636ee223
Russell Bryant authored Mar 04, 2026
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
636ee223
[Frontend] Add vllm launch command for GPU-less preprocessing serving (#34551) · bc6be89d
Hyunkyun Moon authored Mar 05, 2026
```
Signed-off-by: HyunKyun Moon <mhg5303@gmail.com>
```
bc6be89d

[Feature] Add basic metrics for /realtime endpoint (#35500) · 1659b2e0

pougetat authored Mar 04, 2026

Signed-off-by: Thomas Pouget-Abadie <thomaspou@microsoft.com>
Signed-off-by: pougetat <thomas.pougetabadie@gmail.com>
Co-authored-by: Thomas Pouget-Abadie <thomaspou@microsoft.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

1659b2e0

[BugFix] Support tool_choice=none in the Anthropic API (#35835) · 7cdba98e
ShiJie Zhong authored Mar 04, 2026
```
Signed-off-by: ZhongsJie <zhongsjie@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
7cdba98e

03 Mar, 2026 5 commits

fix: Ensure invalid audio files return 400 error (#34715) · ae88468b

JasonCohere authored Mar 03, 2026


Signed-off-by: Jason Ozuzu <jasonozuzu@cohere.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

ae88468b

[Frontend][1/n] Improve pooling entrypoints | classify. (#35604) · ea463978

wang.yuqi authored Mar 03, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

ea463978

[Refactor] Fix maxsim cuda platform and add cli to control it (#35427) · c21d0039

Wentao Ye authored Mar 02, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

c21d0039

[Core] Add optional flags to check for repetitive token patterns in engine output (#35451) · 25e02647
aykoppol authored Mar 02, 2026
```
Signed-off-by: aykoppol <aykoppol+git@gmail.com>
```
25e02647
[Tool Parser] Fix Qwen3Coder streaming parameter loss with speculative decode (#35615) · 8ebd872f
Martin Vit authored Mar 03, 2026
```
Signed-off-by: Martin Vit <martin@voipmonitor.org>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
8ebd872f

02 Mar, 2026 2 commits
- [Doc] Improve UX of `--enable-log-requests` (#35723) · 792a74b9
  Cyrus Leung authored Mar 03, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  792a74b9
- [Feat] Supports Anthropic Messages count_tokens API (#35588) · 9a87b057
  Chauncey authored Mar 02, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  9a87b057
28 Feb, 2026 6 commits

[Bugfix] Fix Anthropic API base64 image handling in Messages endpoint (#35557) · 95a395db
Martin Vit authored Feb 28, 2026
```
Signed-off-by: Martin Vit <martin@voipmonitor.org>
```
95a395db

[Deprecation] Deprecate code in 0.17 as scheduled (#35441) · e113a301

Wentao Ye authored Feb 28, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

e113a301

[Feature]Supports Anthropic Thinking Block (#33671) · 0892d1ab

Mario Hong authored Feb 28, 2026


Signed-off-by: mariohong <mariohong128@gmail.com>
Co-authored-by: zetaohong <i-hongzetao@stepfun.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

0892d1ab

[Bugfix] Move chat completion response_format validation to Pydantic model_validator (#35510) · 1d5ab5d6
Umut Polat authored Feb 28, 2026
```
Signed-off-by: umut-polat <52835619+umut-polat@users.noreply.github.com>
```
1d5ab5d6

[1/N] Elastic EP Milestone 2 (#34861) · dea26833

Itay Alroy authored Feb 28, 2026


Signed-off-by: Yongji Wu <wuyongji317@gmail.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Ron Tourgeman <rtourgeman@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

dea26833

[Misc] Clean up ResponsesRequest model validators (#35531) · 405f28d3
Umut Polat authored Feb 28, 2026
```
Signed-off-by: umut-polat <52835619+umut-polat@users.noreply.github.com>
```
405f28d3