Commits · a8ec486592fd44db67a7390fb91f032ce69f80e1 · OpenDAS / vllm_cscc

14 Dec, 2025 3 commits

[Misc] Add a script to benchmark compilation time (#29919) · a8ec4865
Bin Bao authored Dec 14, 2025
```
Signed-off-by: Bin Bao <binbao@meta.com>
```
a8ec4865

[Doc]: fixing typos in various files (#30540) · 1a55cfaf

Didier Durand authored Dec 14, 2025

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Didier Durand <2927957+didier-durand@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

1a55cfaf

[Chore] Remove redundant `RequestPrompt` (#30612) · dcb31196
Cyrus Leung authored Dec 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
dcb31196

13 Dec, 2025 3 commits
- [Refactor] `TokenizerRegistry` only uses lazy imports (#30609) · 39cefbdf
  Cyrus Leung authored Dec 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  39cefbdf
- [Chore] Adjust tokenizer import to avoid circular imports (#30601) · 64251f48
  Cyrus Leung authored Dec 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  64251f48
- [Bugfix] Dictionary MM embeddings for online chat (#30507) · b09806e2
  Cyrus Leung authored Dec 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b09806e2
12 Dec, 2025 2 commits
- [Frontend] Fixes anthropic streaming message_start usage nesting (#30266) · f3237f3f
  Benjamin Bartels authored Dec 12, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
```
  f3237f3f
- [Bugfix] Multiple fixes for gpt-oss Chat Completion prompting (#28729) · 8f8fda26
  Ben Browning authored Dec 11, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  8f8fda26
11 Dec, 2025 2 commits
- Fix typo of endpoint name in CLI args docs (#30473) · 853611bb
  Kenichi Maehashi authored Dec 11, 2025
```
Signed-off-by: Kenichi Maehashi <maehashi@preferred.jp>
```
  853611bb
- [Deprecation] Remove deprecated task, seed and MM settings (#30397) · 7e24e5d4
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7e24e5d4
10 Dec, 2025 3 commits

{Deprecation] Remove tokenizer setter (#30400) · e72d65b9
Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
e72d65b9

[P/D] KV Load Failure Recovery/Abort Configuration (#26813) · a9e4106f

Will Eaton authored Dec 10, 2025


Signed-off-by: Will Eaton <weaton@redhat.com>
Signed-off-by: Will Eaton <me@wseaton.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: chaunceyjiang <chaunceyjiang@gmail.com>

a9e4106f

[responsesAPI][6] Fix multi turn MCP tokenization (#30230) · c3487aca
Andrew Xia authored Dec 09, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
c3487aca

09 Dec, 2025 2 commits

[Cleanup] Refactor profiling env vars into a CLI config (#29912) · e858bfe0

Benjamin Chislett authored Dec 09, 2025

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

e858bfe0

[BUGFIX] Mistral tool call parser v11+ (#30332) · 5c213d28
Julien Denize authored Dec 09, 2025
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
5c213d28

08 Dec, 2025 3 commits

[Frontend] Binary embedding response does not return metadata by setting... · 2e660c24

wang.yuqi authored Dec 08, 2025


[Frontend] Binary embedding response does not return metadata by setting encoding_format to bytes_only. (#30249)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

2e660c24

[responsesAPI][7] Browser, Container MCP tools for non harmony models (#29989) · 735284ed

Andrew Xia authored Dec 07, 2025


Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

735284ed

[Frontend] Add MCP type support infrastructure to Responses API (#30054) · 444f0e3f
daniel-salib authored Dec 07, 2025
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
```
444f0e3f

07 Dec, 2025 3 commits
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
- Support multiple image/audio embeddings per requests (#29988) · dce6d229
  jeremyteboul authored Dec 06, 2025
```
Signed-off-by: Jeremy Teboul <jeremyteboul@fb.com>
Co-authored-by: Jeremy Teboul <jeremyteboul@fb.com>
```
  dce6d229
06 Dec, 2025 3 commits
- [ez] move harmony utils to parser folder (#30117) · 421125d0
  Andrew Xia authored Dec 06, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  421125d0
- Gigachat 3 tool parser and tests (#29905) · 21bb3235
  Viacheslav authored Dec 06, 2025
```
Signed-off-by: Viacheslav Barinov <viacheslav.teh@gmail.com>
```
  21bb3235
- Support tokenization_kwargs override (#29794) · 43e75930
  Yu Jiaqi authored Dec 06, 2025
```
Signed-off-by: piood <2477084691@qq.com>
```
  43e75930
05 Dec, 2025 3 commits

[KVConnector][Feature] Support KV connector cache reset via /reset_prefix_cache (#27170) · adb31506

Tova Movshovitz authored Dec 05, 2025

Signed-off-by: tovam <tovam@pliops.com>
Signed-off-by: Tova Movshovitz <tovam@pliops.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

adb31506

[responsesAPI][5] ResponsesParser with tools for full MCP python loop (#29798) · da7bc54e

Andrew Xia authored Dec 05, 2025


Signed-off-by: Andrew Xia <axia@fb.com>
Signed-off-by: Andrew Xia <axia@meta.com>
Co-authored-by: Andrew Xia <axia@fb.com>

da7bc54e

[Bugfix] Fix parse_output_message crash on commentary with no recipient (#29972) · b73b158a
strinczer authored Dec 05, 2025
```
Signed-off-by: Shai Trinczer <strinczer@icloud.com>
Signed-off-by: strinczer <strinczer@icloud.com>
```
b73b158a

04 Dec, 2025 5 commits
- [Bugfix] Missing tokens in `return_token_ids` when tool parsers is enabled in... · 48a5fff6
  Peng-YM authored Dec 05, 2025
```
[Bugfix] Missing tokens in `return_token_ids` when tool parsers is enabled in streaming mode (#29074)
Signed-off-by: Peng-YM <1048217874pengym@gmail.com>
```
  48a5fff6
- Add DeepSeek-V3.2 tool parser. (#29848) · ffdd1811
  Xu Wenqing authored Dec 04, 2025
```
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
```
  ffdd1811
- [Frontend] refactor harmony utils output message parsing (#29820) · 404fc4bf
  daniel-salib authored Dec 03, 2025
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
```
  404fc4bf
- [Misc] Various cleanups for MM input processing (#29970) · 9ae2f603
  Cyrus Leung authored Dec 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9ae2f603
- [Frontend] Fixes anthropic /v1/messages streaming not containing input_tokens... · fca3f466
  Benjamin Bartels authored Dec 04, 2025
```
[Frontend] Fixes anthropic /v1/messages streaming not containing input_tokens on first chunk (#29971)
Signed-off-by: bbartels <benjamin@bartels.dev>
```
  fca3f466
03 Dec, 2025 7 commits

[CI] Fix re import error (#29973) · ac188658
Wentao Ye authored Dec 03, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
ac188658

[Bugfix] Mistral tool parser streaming update (#19425) · dd5d1ef7

avigny authored Dec 03, 2025


Signed-off-by: avigny <47987522+avigny@users.noreply.github.com>
Signed-off-by: Chauncey <chaunceyjiang@gmail.com>
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Jeff Cook <jeff@jeffcook.io>
Co-authored-by: sfbemerk <benjaminmerkel@mail.de>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

dd5d1ef7

SigLIP example add chat_template (#29902) · 9ae3c55b
Yu Jiaqi authored Dec 04, 2025
```
Signed-off-by: piood <2477084691@qq.com>
```
9ae3c55b
[Frontend] supports deepseekv32 chat template (#29837) · b78772c4
Chauncey authored Dec 03, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
b78772c4
[Refactor] [1/N] to simplify the vLLM serving architecture (#28040) · 3f42b05f
Chauncey authored Dec 03, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
3f42b05f
[responsesAPI] support input output messages for non harmony models (#29549) · 3a775148
Andrew Xia authored Dec 02, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
3a775148
[Docs] Discuss api key limitations in security guide (#29922) · b08025a8
Russell Bryant authored Dec 02, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
b08025a8

02 Dec, 2025 1 commit
- [BUGFIX] Fix regex pattern for Mistral Tool Call (#29918) · 1b1e35aa
  Julien Denize authored Dec 02, 2025
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
  1b1e35aa