Commits · 742e9ff6b39ad0433bac0d7417a41bbdc74854a3 · OpenDAS / vllm_cscc

22 Nov, 2025 1 commit

[responsesAPI] parse reasoning item input (#28248) · 742e9ff6

Andrew Xia authored Nov 21, 2025


Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

742e9ff6

21 Nov, 2025 5 commits
- Tool Call Parser logs should not contain user input / model output except on DEBUG (#29160) · 2092ce8c
  sfbemerk authored Nov 21, 2025
```
Signed-off-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
Co-authored-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  2092ce8c
- [V0 deprecation] Remove more V0 references (#29088) · aab0102a
  Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aab0102a
- [Bugfix] Fix default MM LoRA alignment for single str prompts (#29140) · b4734b95
  Alex Brooks authored Nov 20, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  b4734b95
- [V0 Deprecation] Remove `best_of` (#29090) · 56e96b37
  Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  56e96b37
- [Core] Add audio_embeds support to chat completions (#29059) · 07304149
  jeremyteboul authored Nov 20, 2025
```
Signed-off-by: Jeremy Teboul <jeremyteboul@fb.com>
Co-authored-by: Jeremy Teboul <jeremyteboul@fb.com>
```
  07304149
20 Nov, 2025 4 commits

[Bugfix] - Add Trace Headers to Beam Search Path (#29100) · 4d01b642
Software Developer authored Nov 20, 2025
```
Signed-off-by: dsuhinin <suhinin.dmitriy@gmail.com>
```
4d01b642

[Frontend] Optimize beam search loop by sorting and then splicing (#19347) · 56f45edd

rookie authored Nov 21, 2025


Signed-off-by: zhangguozhu <zhangguozhu@360.cn>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: zhangguozhu <zhangguozhu@360.cn>
Co-authored-by: mgoin <mgoin64@gmail.com>

56f45edd

[RL] Add Pause and Resume Generation for Asynchronous RL Training (#28037) · 371b1d4c

Samit authored Nov 20, 2025


Signed-off-by: SamitHuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Signed-off-by: samithuang <285365963@qq.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

371b1d4c

[Frontend] Allow parsed tool arguments (#28820) · 1c7bcc55

Quentin Gallouédec authored Nov 19, 2025


Signed-off-by: Quentin Gallouédec <45557362+qgallouedec@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

1c7bcc55

18 Nov, 2025 2 commits

Supress verbose logs from model_hosting_container_standards (#28949) · 67745d18
Michael Goin authored Nov 18, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
67745d18

[Bugfix] Fix Kimi-K2 tool parser concatenated tool calls parsing (#28831) · b6e04390

Benjamin Bartels authored Nov 18, 2025


Signed-off-by: Thomas Mao <yiyeguhu@gmail.com>
Signed-off-by: bbartels <benjamin@bartels.dev>
Co-authored-by: Thomas Mao <yiyeguhu@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

b6e04390

17 Nov, 2025 1 commit
- [Bugfix][Model] Prevent special token leakage in KimiK2ToolParser streaming mode (#28543) · 6f374192
  Jay Caldwell authored Nov 16, 2025
```
Signed-off-by: Jscaldwell55 <jay.s.caldwell@gmail.com>
```
  6f374192
16 Nov, 2025 1 commit

[V1] Support MP Executor for multi node distributed inference (#23691) · b316ac65

Lucia Fang authored Nov 16, 2025


Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

b316ac65

15 Nov, 2025 1 commit
- [RL] [V1] Remove unused device argument from reset_kv_cache (#28766) · dd6ac1c2
  Zhuohan Li authored Nov 14, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  dd6ac1c2
14 Nov, 2025 2 commits

[DisaggEverything] Tokens in<>out `/generate` endpoint (#24261) · 6f1e7f72

Nicolò Lucchesi authored Nov 14, 2025

Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6f1e7f72

[Frontend] Added chat-style multimodal support to /classify. (#27516) · 360bd876

Srreyansh Sethi authored Nov 14, 2025


Signed-off-by: WorldExplored <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <107075589+WorldExplored@users.noreply.github.com>
Signed-off-by: vnadathur <glvikramn@gmail.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: vnadathur <236933696+vnadathur@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: vnadathur <glvikramn@gmail.com>
Co-authored-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

360bd876

13 Nov, 2025 4 commits

Fix io processor pooling #28273 (#28484) · c428e8d8
baonudesifeizhai authored Nov 13, 2025
```
Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
```
c428e8d8
[Frontend] supports interleaved thinking (#28531) · 5c9ad138
Chauncey authored Nov 13, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
5c9ad138

[Frontend][responsesAPI][1/n] convert responses API tool input to chat... · 1a0b157a

Andrew Xia authored Nov 12, 2025


[Frontend][responsesAPI][1/n] convert responses API tool input to chat completions tool format (#28231)
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

1a0b157a

[Frontend] split append tool output (#28333) · 7c38ed0f
Andrew Xia authored Nov 12, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
7c38ed0f

12 Nov, 2025 1 commit
- [Frontend] Change CompilationMode to a proper Enum (#28165) · 48c87936
  Yanan Cao authored Nov 11, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  48c87936
11 Nov, 2025 1 commit

[Frontend] Add sagemaker_standards dynamic lora adapter and stateful session... · bca74e32

Zuyi Zhao authored Nov 10, 2025


[Frontend] Add sagemaker_standards dynamic lora adapter and stateful session management decorators to vLLM OpenAI API server (#27892)
Signed-off-by: Zuyi Zhao <zhaozuy@amazon.com>
Signed-off-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

bca74e32

10 Nov, 2025 2 commits
- [Perf] Move gc.freeze logic from EngineCoreProc to EngineCore for better coverage (#27896) · b30372cb
  Jialin Ouyang authored Nov 10, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  b30372cb
- [Frontend][2/n] remove empty content from _parse_tool_calls_from_content (#28331) · 4b94ed8f
  Andrew Xia authored Nov 10, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  4b94ed8f
08 Nov, 2025 2 commits
- [Feat] Drop-in Torch CUDA Profiler (#27841) · 975676d1
  Benjamin Chislett authored Nov 08, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  975676d1
- `reasoning_content` -> `reasoning` (#27752) · d9ab1ad9
  Harry Mellor authored Nov 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d9ab1ad9
07 Nov, 2025 2 commits
- [CLI] add --max-tokens to `vllm complete` (#28109) · e0d6b4a8
  Iceber Gu authored Nov 07, 2025
```
Signed-off-by: Iceber Gu <caiwei95@hotmail.com>
```
  e0d6b4a8
- [Bug] Fix missing token_ids for reasoning parser models in chat completions #28246 (#28256) · 9da9208b
  baonudesifeizhai authored Nov 07, 2025
  
  9da9208b
06 Nov, 2025 4 commits
- [Chore] eliminate duplicated and unconditional object serialization in... · d4aa65c9
  Vico Chu authored Nov 07, 2025
```
[Chore] eliminate duplicated and unconditional object serialization in anthropic messages api (#27792)
Signed-off-by: Vico Chu <vico24826@gmail.com>
```
  d4aa65c9
- [Frontend] Fix logging format when enable response logging (#28049) · d1dd5f53
  Roy Wang authored Nov 07, 2025
```
Signed-off-by: esmeetu <jasonailu87@gmail.com>
```
  d1dd5f53
- [Frontend] OpenAI Responses API supports Tool/Function calling - non-harmony (#26874) · 59a50afa
  Chauncey authored Nov 06, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  59a50afa
- [Misc] Remove the duplicate code (#28111) · 07d61451
  Chauncey authored Nov 06, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  07d61451
05 Nov, 2025 7 commits
- [Core] add support for reasoning parser plugins (#28075) · 752ddeac
  Walter Beller-Morales authored Nov 05, 2025
```
Signed-off-by: walter beller-morales <walter.beller.morales@gmail.com>
```
  752ddeac
- [Bugfix] Validate custom logits processor xargs for online serving (#27560) · 3f5a4b64
  Isotr0py authored Nov 06, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3f5a4b64
- [BugFix] Support EP/DP + EPLB with MTP (#25311) · e50c4546
  Ilya Markov authored Nov 05, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
```
  e50c4546
- Fix excessive logging noise by reducing the log level of the... · b57789b6
  Eric Yue authored Nov 05, 2025
```
Fix excessive logging noise by reducing the log level of the MinimaxM2ToolParser import success message (#27635)
Signed-off-by: minatoaquaMK2 <jiacheng.yue@foxmail.com>
```
  b57789b6
- [Refactor] to simplify and extract the shared logic between chat completion and responses (#27961) · 0976711f
  Chauncey authored Nov 05, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  0976711f
- [Refactor] Lazy-loaded reasoning_parser (#28092) · e261d37c
  Chauncey authored Nov 05, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  e261d37c
- [Model, Core] Support Granite Speech & LoRA for STT (#24455) · b7cbc254
  Alex Brooks authored Nov 05, 2025
  
  b7cbc254