Commits · fdc135d768267b3a0ae8ed6fc3eca6a68d75f7a6 · OpenDAS / vllm_cscc

12 Dec, 2025 2 commits
- [Frontend] Fixes anthropic streaming message_start usage nesting (#30266) · f3237f3f
  Benjamin Bartels authored Dec 12, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
```
  f3237f3f
- [Bugfix] Multiple fixes for gpt-oss Chat Completion prompting (#28729) · 8f8fda26
  Ben Browning authored Dec 11, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  8f8fda26
10 Dec, 2025 2 commits

[P/D] KV Load Failure Recovery/Abort Configuration (#26813) · a9e4106f

Will Eaton authored Dec 10, 2025


Signed-off-by: Will Eaton <weaton@redhat.com>
Signed-off-by: Will Eaton <me@wseaton.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: chaunceyjiang <chaunceyjiang@gmail.com>

a9e4106f

[responsesAPI][6] Fix multi turn MCP tokenization (#30230) · c3487aca
Andrew Xia authored Dec 09, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
c3487aca

08 Dec, 2025 2 commits

[Frontend] Binary embedding response does not return metadata by setting... · 2e660c24

wang.yuqi authored Dec 08, 2025


[Frontend] Binary embedding response does not return metadata by setting encoding_format to bytes_only. (#30249)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

2e660c24

[Frontend] Add MCP type support infrastructure to Responses API (#30054) · 444f0e3f
daniel-salib authored Dec 07, 2025
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
```
444f0e3f

07 Dec, 2025 3 commits
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
- Support multiple image/audio embeddings per requests (#29988) · dce6d229
  jeremyteboul authored Dec 06, 2025
```
Signed-off-by: Jeremy Teboul <jeremyteboul@fb.com>
Co-authored-by: Jeremy Teboul <jeremyteboul@fb.com>
```
  dce6d229
06 Dec, 2025 3 commits
- [ez] move harmony utils to parser folder (#30117) · 421125d0
  Andrew Xia authored Dec 06, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  421125d0
- Gigachat 3 tool parser and tests (#29905) · 21bb3235
  Viacheslav authored Dec 06, 2025
```
Signed-off-by: Viacheslav Barinov <viacheslav.teh@gmail.com>
```
  21bb3235
- [Tests] Tool call tests for openai/gpt-oss-20b (#26237) · 02a41691
  Deboleina authored Dec 05, 2025
```
Signed-off-by: Debolina Roy <debroy@redhat.com>
```
  02a41691
05 Dec, 2025 3 commits
- [CI] Re-use whisper_client for all tests (#30148) · e23ca3a0
  Nicolò Lucchesi authored Dec 05, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  e23ca3a0
- [responsesAPI][5] ResponsesParser with tools for full MCP python loop (#29798) · da7bc54e
  Andrew Xia authored Dec 05, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Signed-off-by: Andrew Xia <axia@meta.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  da7bc54e
- [Bugfix] Fix parse_output_message crash on commentary with no recipient (#29972) · b73b158a
  strinczer authored Dec 05, 2025
```
Signed-off-by: Shai Trinczer <strinczer@icloud.com>
Signed-off-by: strinczer <strinczer@icloud.com>
```
  b73b158a
04 Dec, 2025 3 commits

[Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling (#27145) · 74c4d80c

wang.yuqi authored Dec 04, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

74c4d80c

[Misc] Various cleanups for MM input processing (#29970) · 9ae2f603
Cyrus Leung authored Dec 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
9ae2f603

[Frontend] Fixes anthropic /v1/messages streaming not containing input_tokens... · fca3f466

Benjamin Bartels authored Dec 04, 2025


[Frontend] Fixes anthropic /v1/messages streaming not containing input_tokens on first chunk (#29971)
Signed-off-by: bbartels <benjamin@bartels.dev>

fca3f466

03 Dec, 2025 2 commits
- [Refactor] [1/N] to simplify the vLLM serving architecture (#28040) · 3f42b05f
  Chauncey authored Dec 03, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  3f42b05f
- [responsesAPI] support input output messages for non harmony models (#29549) · 3a775148
  Andrew Xia authored Dec 02, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  3a775148
02 Dec, 2025 5 commits
- [responsesAPI][3] ResponsesParser to set up non harmony MCP (#29413) · 52cb349f
  Andrew Xia authored Dec 02, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  52cb349f
- [Multimodal][Core] Optimize multimodal preprocessing cache by hashing image... · 60c3d413
  ImaGoodFella authored Dec 02, 2025
```
[Multimodal][Core] Optimize multimodal preprocessing cache by hashing image bytes instead of pixel values (#29621)
Signed-off-by: Rahul Steiger <rasteiger@ethz.ch>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  60c3d413
- [Chore] Move tokenizer initialization methods (#29793) · 653591d5
  Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  653591d5
- [Misc] Update conftest for entrypoints/sagemaker test folder (#29799) · 53bf71b0
  Zuyi Zhao authored Dec 01, 2025
```
Signed-off-by: Zuyi Zhao <zhaozuy@amazon.com>
```
  53bf71b0
- [responsesAPI][4] fix responseOutputItem Kimi K2 thinking bug (#29555) · fa8804ad
  Andrew Xia authored Dec 01, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  fa8804ad
01 Dec, 2025 4 commits
- [Frontend] add 'verbose_json' and 'timestamp' feature on Whisper Transcription/Translation (#24209) · 092bb73b
  sangbumlikeagod authored Dec 02, 2025
```
Signed-off-by: sangbumlikeagod <oironese@naver.com>
Signed-off-by: sangbumlikeagod <98077576+sangbumlikeagod@users.noreply.github.com>
```
  092bb73b
- [Misc] Unify tokenizer registration (#29767) · f0a28bf6
  Cyrus Leung authored Dec 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f0a28bf6
- [Frontend] Add tool filtering support to ToolServer (#29224) · 014ece97
  daniel-salib authored Dec 01, 2025
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  014ece97
- [Frontend] Resettle pooling entrypoints (#29634) · 62de4f42
  wang.yuqi authored Dec 01, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  62de4f42
29 Nov, 2025 5 commits
- [Bugfix] Revert test_tokenization.py (#29729) · b9d0504a
  Jee Jee Li authored Nov 30, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  b9d0504a
- [Misc] Refactor tokenizer interface (#29693) · 34a98427
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34a98427
- [LoRA] Cleanup LoRA unused code (#29611) · 39e63dec
  Jee Jee Li authored Nov 29, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  39e63dec
- [Frontend] Perform offline path replacement to `tokenizer` (#29706) · 762a4a6c
  Tsukasa OI authored Nov 29, 2025
```
Signed-off-by: Tsukasa OI <floss_llm@irq.a4lg.com>
```
  762a4a6c
- [Bugfix] Fix wrong mock attribute (#29704) · b2c50eda
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b2c50eda
28 Nov, 2025 1 commit
- [Chore] Rename `Processor` to `InputProcessor` (#29682) · 8d9338fa
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8d9338fa
27 Nov, 2025 1 commit
- [CI] Add batched audios Whisper test (#29308) · e5a621b7
  Nicolò Lucchesi authored Nov 27, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  e5a621b7
25 Nov, 2025 3 commits
- [responsesAPI][2] parse ResponseFunctionToolCallOutputItem (#29383) · b07555d2
  Andrew Xia authored Nov 25, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  b07555d2
- [CI] Resettle pooling entrypoints tests. (#29370) · 7a80b018
  wang.yuqi authored Nov 25, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  7a80b018
- [Metrics] Scheduled removal of deprecated metrics (#29330) · 9cf4edae
  Mark McLoughlin authored Nov 25, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  9cf4edae
24 Nov, 2025 1 commit
- [Tests] Verify gpt_oss package is installed in harmony tests (#29336) · 84371daf
  Nick Hill authored Nov 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  84371daf