Commits · 9ad5b2171002522772de0a0cc71b747068ec8862 · OpenDAS / vllm_cscc

17 Dec, 2025 1 commit
- [Refactor] [4/N] Move VLLM_SERVER_DEV endpoints into the serve directory (#30749) · 9ad5b217
  Chauncey authored Dec 17, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  9ad5b217
16 Dec, 2025 3 commits
- [Frontend] Add `max-completion-token` option to transcription/translation endpoints (#30769) · ca702a14
  Nicolò Lucchesi authored Dec 16, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  ca702a14
- [responsesAPI][8] input/output messages for ResponsesParser (#30158) · 0d0c929f
  Andrew Xia authored Dec 16, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Signed-off-by: Andrew Xia <axia@meta.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  0d0c929f
- [Bugfix] fix streaming final output for non harmony (#30237) · bbd850e5
  penfree authored Dec 16, 2025
```
Signed-off-by: penfree <qiupengfei@baidu.com>
Co-authored-by: penfree <qiupengfei@baidu.com>
```
  bbd850e5
15 Dec, 2025 2 commits
- [Refactor] [2/N] Move tool parsers into the vLLM main directory (#30675) · 2a1776b7
  Chauncey authored Dec 15, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  2a1776b7
- additional protection for CVE-2025-62164 (#30649) · 84e23d10
  Wenqi Glantz authored Dec 14, 2025
```
Signed-off-by: Wenqi Glantz <wglantz@nvidia.com>
```
  84e23d10
14 Dec, 2025 1 commit
- [Chore] Remove redundant `RequestPrompt` (#30612) · dcb31196
  Cyrus Leung authored Dec 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dcb31196
13 Dec, 2025 2 commits
- [Chore] Adjust tokenizer import to avoid circular imports (#30601) · 64251f48
  Cyrus Leung authored Dec 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  64251f48
- [Bugfix] Dictionary MM embeddings for online chat (#30507) · b09806e2
  Cyrus Leung authored Dec 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b09806e2
12 Dec, 2025 2 commits
- [Frontend] Fixes anthropic streaming message_start usage nesting (#30266) · f3237f3f
  Benjamin Bartels authored Dec 12, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
```
  f3237f3f
- [Bugfix] Multiple fixes for gpt-oss Chat Completion prompting (#28729) · 8f8fda26
  Ben Browning authored Dec 11, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  8f8fda26
10 Dec, 2025 2 commits

[P/D] KV Load Failure Recovery/Abort Configuration (#26813) · a9e4106f

Will Eaton authored Dec 10, 2025


Signed-off-by: Will Eaton <weaton@redhat.com>
Signed-off-by: Will Eaton <me@wseaton.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: chaunceyjiang <chaunceyjiang@gmail.com>

a9e4106f

[responsesAPI][6] Fix multi turn MCP tokenization (#30230) · c3487aca
Andrew Xia authored Dec 09, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
c3487aca

08 Dec, 2025 2 commits

[Frontend] Binary embedding response does not return metadata by setting... · 2e660c24

wang.yuqi authored Dec 08, 2025


[Frontend] Binary embedding response does not return metadata by setting encoding_format to bytes_only. (#30249)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

2e660c24

[Frontend] Add MCP type support infrastructure to Responses API (#30054) · 444f0e3f
daniel-salib authored Dec 07, 2025
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
```
444f0e3f

07 Dec, 2025 3 commits
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
- Support multiple image/audio embeddings per requests (#29988) · dce6d229
  jeremyteboul authored Dec 06, 2025
```
Signed-off-by: Jeremy Teboul <jeremyteboul@fb.com>
Co-authored-by: Jeremy Teboul <jeremyteboul@fb.com>
```
  dce6d229
06 Dec, 2025 3 commits
- [ez] move harmony utils to parser folder (#30117) · 421125d0
  Andrew Xia authored Dec 06, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  421125d0
- Gigachat 3 tool parser and tests (#29905) · 21bb3235
  Viacheslav authored Dec 06, 2025
```
Signed-off-by: Viacheslav Barinov <viacheslav.teh@gmail.com>
```
  21bb3235
- [Tests] Tool call tests for openai/gpt-oss-20b (#26237) · 02a41691
  Deboleina authored Dec 05, 2025
```
Signed-off-by: Debolina Roy <debroy@redhat.com>
```
  02a41691
05 Dec, 2025 3 commits
- [CI] Re-use whisper_client for all tests (#30148) · e23ca3a0
  Nicolò Lucchesi authored Dec 05, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  e23ca3a0
- [responsesAPI][5] ResponsesParser with tools for full MCP python loop (#29798) · da7bc54e
  Andrew Xia authored Dec 05, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Signed-off-by: Andrew Xia <axia@meta.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  da7bc54e
- [Bugfix] Fix parse_output_message crash on commentary with no recipient (#29972) · b73b158a
  strinczer authored Dec 05, 2025
```
Signed-off-by: Shai Trinczer <strinczer@icloud.com>
Signed-off-by: strinczer <strinczer@icloud.com>
```
  b73b158a
04 Dec, 2025 3 commits

[Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling (#27145) · 74c4d80c

wang.yuqi authored Dec 04, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

74c4d80c

[Misc] Various cleanups for MM input processing (#29970) · 9ae2f603
Cyrus Leung authored Dec 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
9ae2f603

[Frontend] Fixes anthropic /v1/messages streaming not containing input_tokens... · fca3f466

Benjamin Bartels authored Dec 04, 2025


[Frontend] Fixes anthropic /v1/messages streaming not containing input_tokens on first chunk (#29971)
Signed-off-by: bbartels <benjamin@bartels.dev>

fca3f466

03 Dec, 2025 2 commits
- [Refactor] [1/N] to simplify the vLLM serving architecture (#28040) · 3f42b05f
  Chauncey authored Dec 03, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  3f42b05f
- [responsesAPI] support input output messages for non harmony models (#29549) · 3a775148
  Andrew Xia authored Dec 02, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  3a775148
02 Dec, 2025 5 commits
- [responsesAPI][3] ResponsesParser to set up non harmony MCP (#29413) · 52cb349f
  Andrew Xia authored Dec 02, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  52cb349f
- [Multimodal][Core] Optimize multimodal preprocessing cache by hashing image... · 60c3d413
  ImaGoodFella authored Dec 02, 2025
```
[Multimodal][Core] Optimize multimodal preprocessing cache by hashing image bytes instead of pixel values (#29621)
Signed-off-by: Rahul Steiger <rasteiger@ethz.ch>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  60c3d413
- [Chore] Move tokenizer initialization methods (#29793) · 653591d5
  Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  653591d5
- [Misc] Update conftest for entrypoints/sagemaker test folder (#29799) · 53bf71b0
  Zuyi Zhao authored Dec 01, 2025
```
Signed-off-by: Zuyi Zhao <zhaozuy@amazon.com>
```
  53bf71b0
- [responsesAPI][4] fix responseOutputItem Kimi K2 thinking bug (#29555) · fa8804ad
  Andrew Xia authored Dec 01, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  fa8804ad
01 Dec, 2025 4 commits
- [Frontend] add 'verbose_json' and 'timestamp' feature on Whisper Transcription/Translation (#24209) · 092bb73b
  sangbumlikeagod authored Dec 02, 2025
```
Signed-off-by: sangbumlikeagod <oironese@naver.com>
Signed-off-by: sangbumlikeagod <98077576+sangbumlikeagod@users.noreply.github.com>
```
  092bb73b
- [Misc] Unify tokenizer registration (#29767) · f0a28bf6
  Cyrus Leung authored Dec 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f0a28bf6
- [Frontend] Add tool filtering support to ToolServer (#29224) · 014ece97
  daniel-salib authored Dec 01, 2025
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  014ece97
- [Frontend] Resettle pooling entrypoints (#29634) · 62de4f42
  wang.yuqi authored Dec 01, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  62de4f42
29 Nov, 2025 2 commits
- [Bugfix] Revert test_tokenization.py (#29729) · b9d0504a
  Jee Jee Li authored Nov 30, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  b9d0504a
- [Misc] Refactor tokenizer interface (#29693) · 34a98427
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34a98427