Commits · abe93bce5952ed8adf90d4b77af6ed3515958620 · OpenDAS / vllm_cscc

09 Dec, 2025 1 commit
- [BUGFIX] Mistral tool call parser v11+ (#30332) · 5c213d28
  Julien Denize authored Dec 09, 2025
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
  5c213d28
08 Dec, 2025 1 commit
- [Frontend] Add MCP type support infrastructure to Responses API (#30054) · 444f0e3f
  daniel-salib authored Dec 07, 2025
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
```
  444f0e3f
07 Dec, 2025 2 commits
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
06 Dec, 2025 2 commits
- [ez] move harmony utils to parser folder (#30117) · 421125d0
  Andrew Xia authored Dec 06, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  421125d0
- Gigachat 3 tool parser and tests (#29905) · 21bb3235
  Viacheslav authored Dec 06, 2025
```
Signed-off-by: Viacheslav Barinov <viacheslav.teh@gmail.com>
```
  21bb3235
05 Dec, 2025 2 commits

[KVConnector][Feature] Support KV connector cache reset via /reset_prefix_cache (#27170) · adb31506

Tova Movshovitz authored Dec 05, 2025

Signed-off-by: tovam <tovam@pliops.com>
Signed-off-by: Tova Movshovitz <tovam@pliops.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

adb31506

[responsesAPI][5] ResponsesParser with tools for full MCP python loop (#29798) · da7bc54e

Andrew Xia authored Dec 05, 2025


Signed-off-by: Andrew Xia <axia@fb.com>
Signed-off-by: Andrew Xia <axia@meta.com>
Co-authored-by: Andrew Xia <axia@fb.com>

da7bc54e

04 Dec, 2025 3 commits
- [Bugfix] Missing tokens in `return_token_ids` when tool parsers is enabled in... · 48a5fff6
  Peng-YM authored Dec 05, 2025
```
[Bugfix] Missing tokens in `return_token_ids` when tool parsers is enabled in streaming mode (#29074)
Signed-off-by: Peng-YM <1048217874pengym@gmail.com>
```
  48a5fff6
- Add DeepSeek-V3.2 tool parser. (#29848) · ffdd1811
  Xu Wenqing authored Dec 04, 2025
```
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
```
  ffdd1811
- [Misc] Various cleanups for MM input processing (#29970) · 9ae2f603
  Cyrus Leung authored Dec 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9ae2f603
03 Dec, 2025 4 commits

[Bugfix] Mistral tool parser streaming update (#19425) · dd5d1ef7

avigny authored Dec 03, 2025


Signed-off-by: avigny <47987522+avigny@users.noreply.github.com>
Signed-off-by: Chauncey <chaunceyjiang@gmail.com>
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Jeff Cook <jeff@jeffcook.io>
Co-authored-by: sfbemerk <benjaminmerkel@mail.de>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

dd5d1ef7

[Frontend] supports deepseekv32 chat template (#29837) · b78772c4
Chauncey authored Dec 03, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
b78772c4
[Refactor] [1/N] to simplify the vLLM serving architecture (#28040) · 3f42b05f
Chauncey authored Dec 03, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
3f42b05f
[responsesAPI] support input output messages for non harmony models (#29549) · 3a775148
Andrew Xia authored Dec 02, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
3a775148

02 Dec, 2025 5 commits

[BUGFIX] Fix regex pattern for Mistral Tool Call (#29918) · 1b1e35aa
Julien Denize authored Dec 02, 2025
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
1b1e35aa
[responsesAPI][3] ResponsesParser to set up non harmony MCP (#29413) · 52cb349f
Andrew Xia authored Dec 02, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
52cb349f
[Chore] Use `tokenizer.encode` and `tokenizer.decode` directly (#29851) · 68ffbca7
Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
68ffbca7

Add Mistral Large 3 and Ministral 3 (#29757) · d8c6210e

Julien Denize authored Dec 02, 2025


Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Mickael Seznec <mickael@mistral.ai>

d8c6210e

[Core] Support reseting all running requests' KV while calling `reset_prefix_cache` (#28827) · d0cd7289

Zhuohan Li authored Dec 01, 2025


Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

d0cd7289

01 Dec, 2025 3 commits
- [Frontend] add 'verbose_json' and 'timestamp' feature on Whisper Transcription/Translation (#24209) · 092bb73b
  sangbumlikeagod authored Dec 02, 2025
```
Signed-off-by: sangbumlikeagod <oironese@naver.com>
Signed-off-by: sangbumlikeagod <98077576+sangbumlikeagod@users.noreply.github.com>
```
  092bb73b
- [Frontend] Add tool filtering support to ToolServer (#29224) · 014ece97
  daniel-salib authored Dec 01, 2025
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  014ece97
- [Frontend] Resettle pooling entrypoints (#29634) · 62de4f42
  wang.yuqi authored Dec 01, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  62de4f42
29 Nov, 2025 3 commits
- [Chore] Enable passing `tokenizer=None` into MM processor (#29724) · fe3398fa
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fe3398fa
- [Misc] Refactor tokenizer interface (#29693) · 34a98427
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34a98427
- [Doc]: fixing typos in various files. (#29717) · 04a797cd
  Didier Durand authored Nov 29, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  04a797cd
28 Nov, 2025 3 commits
- [Chore] Rename `Processor` to `InputProcessor` (#29682) · 8d9338fa
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8d9338fa
- [Misc] Remove `yapf` directives (#29675) · 0808eb81
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0808eb81
- Revert "Supress verbose logs from model_hosting_container_standards (… (#29335) · f8151b66
  HappyAmazonian authored Nov 28, 2025
```
Signed-off-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  f8151b66
25 Nov, 2025 7 commits
- [responsesAPI][2] parse ResponseFunctionToolCallOutputItem (#29383) · b07555d2
  Andrew Xia authored Nov 25, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  b07555d2
- [Frontend] Respect Chat Completion parallel_tool_calls param (#26233) · e1dd706c
  Ben Browning authored Nov 25, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  e1dd706c
- [responsesAPI] refactor construct_input_messages (#29359) · a685b47c
  Andrew Xia authored Nov 25, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  a685b47c
- [Misc] Streamline unique id generation (#29375) · db290610
  Nick Hill authored Nov 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  db290610
- [BugFix] Use unique ids for different transcription prompts (#29372) · 7992324f
  Nick Hill authored Nov 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  7992324f
- Scheduled removal of `guided_*` config fields (#29326) · 316c8492
  Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  316c8492
- [BugFix] Fix duplicate id tool-call race condition (#29355) · a178a0b4
  Nick Hill authored Nov 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  a178a0b4
24 Nov, 2025 1 commit

[Bugfix] properly handle nested json with llama3 tool parser (#27701) · 656516c3

Aydin Abiar authored Nov 24, 2025

Signed-off-by: Aydin Abiar <aydin@anyscale.com>
Signed-off-by: Aydin Abiar <62435714+Aydin-ab@users.noreply.github.com>
Co-authored-by: Aydin Abiar <aydin@anyscale.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

656516c3

21 Nov, 2025 3 commits
- Tool Call Parser logs should not contain user input / model output except on DEBUG (#29160) · 2092ce8c
  sfbemerk authored Nov 21, 2025
```
Signed-off-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
Co-authored-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  2092ce8c
- [V0 deprecation] Remove more V0 references (#29088) · aab0102a
  Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aab0102a
- [V0 Deprecation] Remove `best_of` (#29090) · 56e96b37
  Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  56e96b37