Commits · 176c799f4c512daf0904556940fc9a2c938af5ce · OpenDAS / vllm_cscc

05 Mar, 2026 2 commits
- [openai api] log exception in exception handler (1/N) (#31164) · 176c799f
  Ning Xie authored Mar 06, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  176c799f
- [Misc] Fix SyntaxWarning - invalid escape sequence '\e' (#36020) · a708ef59
  cjackal authored Mar 05, 2026
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  a708ef59
04 Mar, 2026 3 commits

[Docs] Document security risks of GPT-OSS Python tool (#35139) · 636ee223
Russell Bryant authored Mar 04, 2026
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
636ee223
[Frontend] Add vllm launch command for GPU-less preprocessing serving (#34551) · bc6be89d
Hyunkyun Moon authored Mar 05, 2026
```
Signed-off-by: HyunKyun Moon <mhg5303@gmail.com>
```
bc6be89d

[Feature] Add basic metrics for /realtime endpoint (#35500) · 1659b2e0

pougetat authored Mar 04, 2026

Signed-off-by: Thomas Pouget-Abadie <thomaspou@microsoft.com>
Signed-off-by: pougetat <thomas.pougetabadie@gmail.com>
Co-authored-by: Thomas Pouget-Abadie <thomaspou@microsoft.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

1659b2e0

03 Mar, 2026 5 commits

fix: Ensure invalid audio files return 400 error (#34715) · ae88468b

JasonCohere authored Mar 03, 2026


Signed-off-by: Jason Ozuzu <jasonozuzu@cohere.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

ae88468b

[Frontend][1/n] Improve pooling entrypoints | classify. (#35604) · ea463978

wang.yuqi authored Mar 03, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

ea463978

[Refactor] Fix maxsim cuda platform and add cli to control it (#35427) · c21d0039

Wentao Ye authored Mar 02, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

c21d0039

[Core] Add optional flags to check for repetitive token patterns in engine output (#35451) · 25e02647
aykoppol authored Mar 02, 2026
```
Signed-off-by: aykoppol <aykoppol+git@gmail.com>
```
25e02647
[Tool Parser] Fix Qwen3Coder streaming parameter loss with speculative decode (#35615) · 8ebd872f
Martin Vit authored Mar 03, 2026
```
Signed-off-by: Martin Vit <martin@voipmonitor.org>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
8ebd872f

02 Mar, 2026 1 commit
- [Doc] Improve UX of `--enable-log-requests` (#35723) · 792a74b9
  Cyrus Leung authored Mar 03, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  792a74b9
28 Feb, 2026 3 commits
- [Deprecation] Deprecate code in 0.17 as scheduled (#35441) · e113a301
  Wentao Ye authored Feb 28, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  e113a301
- [Bugfix] Move chat completion response_format validation to Pydantic model_validator (#35510) · 1d5ab5d6
  Umut Polat authored Feb 28, 2026
```
Signed-off-by: umut-polat <52835619+umut-polat@users.noreply.github.com>
```
  1d5ab5d6
- [Misc] Clean up ResponsesRequest model validators (#35531) · 405f28d3
  Umut Polat authored Feb 28, 2026
```
Signed-off-by: umut-polat <52835619+umut-polat@users.noreply.github.com>
```
  405f28d3
27 Feb, 2026 2 commits
- [Bugfix] Replace assert with ValueError for response_format validation in... · b66a7464
  Umut Polat authored Feb 27, 2026
```
[Bugfix] Replace assert with ValueError for response_format validation in completions endpoint (#35456)
Signed-off-by: umut-polat <52835619+umut-polat@users.noreply.github.com>
```
  b66a7464
- [Bugfix] Emit reasoning_part events in simple streaming path for Resp… (#35184) · d43048ce
  daniel-salib authored Feb 26, 2026
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
```
  d43048ce
26 Feb, 2026 1 commit
- [Misc][Harmony] Move Responses API only harmony utils to responses/harmony.py (#35339) · 186ea22e
  Flora Feng authored Feb 26, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  186ea22e
25 Feb, 2026 5 commits
- [Bugfix] Fix Harmony preamble visibility in Responses API (#32114) · 5d18bf8b
  pushkar authored Feb 25, 2026
```
Signed-off-by: Pushkar Patel <git@thepushkarp.com>
Signed-off-by: pupa <pupa@users.noreply.github.com>
```
  5d18bf8b
- [Bugfix] Fix AttributeError when passing StructuredOutputsParams to CompletionRequest (#35237) · af770b8e
  pks authored Feb 25, 2026
```
Signed-off-by: Patrick Simianer <patrick@lilt.com>
```
  af770b8e
- [Responses][CI] Filter negative token IDs in schema fuzz test to avoid 500 errors (#35231) · 2ff3e436
  Andreas Karatzas authored Feb 24, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  2ff3e436
- [Responses] Decouple SSE event helpers from Harmony context (#35148) · ec1d30c0
  Flora Feng authored Feb 24, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  ec1d30c0
- [Frontend] Use init_app_state and FrontendArgs in run_batch (#32967) · e3b2324e
  Pooya Davoodi authored Feb 24, 2026
```
Signed-off-by: Pooya Davoodi <pooya.davoodi@parasail.io>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  e3b2324e
24 Feb, 2026 2 commits
- [Frontend] Always pass `supported_tasks` to validation (#35186) · 761e63e5
  Cyrus Leung authored Feb 24, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  761e63e5
- [MM] Allow audio chunking for offline LLM (#34628) · f91808ae
  Nicolò Lucchesi authored Feb 24, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  f91808ae
23 Feb, 2026 2 commits
- [Feature] Lazy import for the "mistral" tokenizer module. (#34651) · 54e2f83d
  Neil Schemenauer authored Feb 23, 2026
```
Signed-off-by: Neil Schemenauer <nas@arctrix.com>
```
  54e2f83d
- [BugFix]: Fix local mypy issues (#34739) · e97c46a9
  Martin Hickey authored Feb 23, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e97c46a9
22 Feb, 2026 1 commit
- [Bugfix] Fix Qwen3/Qwen3.5 Reasoning Parser (#34779) · 40f88d83
  Roger Wang authored Feb 21, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  40f88d83
21 Feb, 2026 3 commits

[Frontend] Add automatic language detection for Whisper transcription (#34342) · 98b0205c

Roman authored Feb 21, 2026


Signed-off-by: space_check <roman.vuskov@rwth-aachen.de>
Signed-off-by: Roman <45857014+spacecheck@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

98b0205c

[CI][MCP][Harmony] Heavy refactoring Harmony & MCP response tests and... · 991d6bff

Andreas Karatzas authored Feb 20, 2026


[CI][MCP][Harmony] Heavy refactoring Harmony & MCP response tests and stabilizing with deterministic test infrastructure (#33949)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>

991d6bff

[Realtime] Add Qwen3-ASR realtime streaming support (#34613) · 11be2c74

pougetat authored Feb 20, 2026


Signed-off-by: Thomas Pouget-Abadie <thomaspou@microsoft.com>
Co-authored-by: Thomas Pouget-Abadie <thomaspou@microsoft.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

11be2c74

20 Feb, 2026 2 commits
- [Refactor] Extract Harmony streaming SSE event builders into streaming_events.py (#34909) · ed31a020
  Flora Feng authored Feb 20, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  ed31a020
- Add validation to reject non-text content in system messages (#34072) · 676f82ae
  Varun Chawla authored Feb 19, 2026
```
Signed-off-by: Varun Chawla <varun_6april@hotmail.com>
```
  676f82ae
19 Feb, 2026 1 commit
- [Frontend] Fix reasoning_tokens for text-based parsers in Responses API (#33513) · 9681068c
  Jaeyeon Kim(김재연) authored Feb 19, 2026
```
Signed-off-by: Jaeyeon Kim <anencore94@gmail.com>
```
  9681068c
17 Feb, 2026 1 commit
- [Renderer] Move InputPreprocessor into Renderer (2/2) (#34560) · 574fe752
  Cyrus Leung authored Feb 17, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  574fe752
16 Feb, 2026 1 commit
- [Bugfix] Treat generation_config max_tokens as default not ceiling (#34063) · 72d5951d
  Almog Tavor authored Feb 16, 2026
```
Signed-off-by: almogtavor <almogtavor@gmail.com>
```
  72d5951d
15 Feb, 2026 1 commit

[bugfix] Fix critical bug when reporting for all paths where... · 50dbd6c9

Stanislav Kirillov authored Feb 15, 2026


[bugfix] Fix critical bug when reporting for all paths where handler.create_error_response is used (#34516)
Signed-off-by: Stanislav Kirillov <stas@nebius.com>
Co-authored-by: Stanislav Kirillov <stas@nebius.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

50dbd6c9

14 Feb, 2026 1 commit

[Renderer] Move InputPreprocessor into Renderer (1/2) (#34510) · 73391a1b

Cyrus Leung authored Feb 15, 2026


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

73391a1b

13 Feb, 2026 2 commits

[Refactor] Call renderer for online IO processor request (#34490) · ec090c24

Cyrus Leung authored Feb 13, 2026

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ec090c24

[Frontend] Enable generic structured_outputs for responses API (#33709) · be7370da
Alec S authored Feb 12, 2026
```
Signed-off-by: Alec Solder <alecs@fb.com>
Co-authored-by: Alec Solder <alecs@fb.com>
```
be7370da

12 Feb, 2026 1 commit
- [V0 Deprecation] Remove code related to per-request logits processors (#34400) · fb455ed5
  Cyrus Leung authored Feb 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fb455ed5