Commits · 82dfb12e52ded608da2a458b2da5f48ba1acecdf · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "56e96b37e4951946c06379b4891d8170e743dcc2"

09 Sep, 2025 2 commits
- [Core] Use sha256 bytes instead of BlockHash to reduce GC overhead (#23673) · 82dfb12e
  Zebing Lin authored Sep 09, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
  82dfb12e
- [Flashinfer] Support Flashinfer TRTLLM FP8-qkv BF16/FP16-out Attention Kernel (#23647) · bba1042c
  elvischenv authored Sep 09, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  bba1042c
08 Sep, 2025 11 commits

[Attention] FlashAttention MLA cudagraph support (#23958) · 620db1fc

Matthew Bonanni authored Sep 08, 2025


Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

620db1fc

[CI] Enable encoder model compilation test (#24442) · 7be141b2
Jiangyun Zhu authored Sep 09, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
7be141b2
[Model] Remove quantized mixtral (#24437) · 8d7f39b4
Jee Jee Li authored Sep 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
8d7f39b4

[Frontend] User-provided uuids for medias in chat. (RFC #22044) (#23449) · 01dfb5e9

Chenheli Hua authored Sep 08, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

01dfb5e9

Move `KVEventsConfig` from `config/__init__.py` to `config/kv_events.py` (#24433) · 03dd652c
Harry Mellor authored Sep 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
03dd652c

[Misc] Terratorch related fixes (#24337) · 9cd76b71

Christian Pinto authored Sep 08, 2025


Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

9cd76b71

[Bugfix] Fix mamba2 prefill chunking (#23279) · e0413141

tomeras91 authored Sep 08, 2025

Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
Signed-off-by: tomeras91 <57313761+tomeras91@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

e0413141

[CI/Build] Fix local image inputs in test_pixtral.py (#24401) · 3bca396f
Chenheli Hua authored Sep 07, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
3bca396f
[CI/Build] Disable flaky test_structured_output tests (#24404) · 3a3e91bd
22quinn authored Sep 07, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
3a3e91bd

[Sampler] Support returning all prompt logprobs (#23868) · b3d7e3c8

Xingyu Liu authored Sep 07, 2025


Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

b3d7e3c8

[Kernel] Support decode context parallelism on Blackwell with CUTLASS MLA (#24385) · 86173ad5

Ming Yang authored Sep 07, 2025


Signed-off-by: Ming Yang <minos.future@gmail.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

86173ad5

07 Sep, 2025 3 commits
- Add renderer-based prompt processing for embedding and classification endpoints (#24356) · 0661cb9d
  Flora Feng authored Sep 07, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  0661cb9d
- [TPU] Remove TopKTopPSampler dependency for TPU sampler (#24391) · 105d3d62
  Woosuk Kwon authored Sep 07, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  105d3d62
- [CI][Fix] deterministic seed for flaky CI runs on structured outputs (#24380) · e6759754
  Aaron Pham authored Sep 06, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  e6759754
06 Sep, 2025 9 commits
- [V0 deprecation] Deprecate V0 Neuron backend (#21159) · 4172235a
  Woosuk Kwon authored Sep 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4172235a
- [Bugfix] Fix unstable silu_mul+nvfp4 quant fusion test (#24370) · e68dc2f0
  elvischenv authored Sep 07, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  e68dc2f0
- [Frontend][Responses API] Support reporting tool output tokens and fix... · a3645ed9
  Ye (Charlotte) Qi authored Sep 06, 2025
```
[Frontend][Responses API] Support reporting tool output tokens and fix reasoning token count (#24285)
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  a3645ed9
- [Fix] [gpt-oss] fix non-tool calling path for chat completion (#24324) · fb691ee4
  Aaron Pham authored Sep 06, 2025
  
  fb691ee4
- [Bugfix] Fix test_mixtral_moe (#24371) · 7555d6b3
  Jee Jee Li authored Sep 07, 2025
  
  7555d6b3
- [CI] Disable flaky structured output test from CI (#24366) · b121ca22
  Roger Wang authored Sep 06, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  b121ca22
- [New Model]: google/embeddinggemma-300m (#24318) · 6d6c6b05
  wang.yuqi authored Sep 06, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  6d6c6b05
- [Feature] Support Decode Context Parallel (DCP) for MLA (#23734) · ac201a0e
  yzds authored Sep 06, 2025
```
Signed-off-by: hongchao <hongchao@msh.team>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: hongchao <hongchao@msh.team>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  ac201a0e
- [Doc]: fix typos in Python comments (#24294) · 35bf1938
  Didier Durand authored Sep 06, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  35bf1938
05 Sep, 2025 2 commits
- [Bugfix] Fix silu_mul+quant fusion test (#24341) · eedb2a2a
  elvischenv authored Sep 06, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  eedb2a2a
- [gpt-oss] tool parser supports for /chat/completions [1/n] (#22386) · c29fb540
  Aaron Pham authored Sep 04, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  c29fb540
04 Sep, 2025 12 commits

[CI/Build] Reduce the number of redundant cases to test for LoRA (#24276) · 886ccbe5
Zhuohan Li authored Sep 04, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
886ccbe5

[Bugfix][Misc] Fix silu_and_mul_nvfp4_quant issue and extract common utils for... · adc3ddb4

elvischenv authored Sep 05, 2025


[Bugfix][Misc] Fix silu_and_mul_nvfp4_quant issue and extract common utils for nvfp4 kernel source files (#23727)
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

adc3ddb4

[Misc] Have AsyncLLM `custom_stat_loggers` extend default logger list (#20952) · 60b755cb

Seiji Eicher authored Sep 04, 2025


Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Signed-off-by: Seiji Eicher <58963096+eicherseiji@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

60b755cb

[Doc]: fix typos in Python comments (#24173) · 83609ca9

Didier Durand authored Sep 04, 2025


Signed-off-by: Didier Durand <durand.didier@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

83609ca9

[Misc] Removed force_fp8_e4m3fnuz from FP8LinearOp (#23725) · 37241077

nvjullin authored Sep 04, 2025

Signed-off-by: Julien Lin <jullin@nvidia.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

37241077

[Feature][Response API] Add streaming support for non-harmony (#23741) · 8f423e5f
Kebe authored Sep 04, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
8f423e5f

[Attention] FlashAttn MLA (#14258) · 402759d4

Lucas Wilkinson authored Sep 04, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

402759d4

[Core][Model] Terratorch backend integration (#23513) · 51d5e9be

mgazz authored Sep 04, 2025


Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

51d5e9be

[Model] Add MiDashengLM model support (#23652) · e7fc7001

bingchen-mi authored Sep 04, 2025


Signed-off-by: chenbing8 <chenbing8@xiaomi.com>
Signed-off-by: bingchen-mi <chenbing8@xiaomi.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

e7fc7001

[CPU] Refactor CPU unquantized linear (#24150) · 57b1ce94
Li, Jiang authored Sep 04, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
57b1ce94
[Refactor] Introduce basic Renderer for completion-style request (#24010) · 712b273f
Flora Feng authored Sep 03, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
712b273f
[Feature][Responses API]Support MCP tools with streaming mode + background mode (#23927) · a38f8bd5
wuhang authored Sep 04, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
```
a38f8bd5

03 Sep, 2025 1 commit
- Remove deprecated `PyNcclConnector` (#24151) · b5ee1e32
  Peter Pan authored Sep 04, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  b5ee1e32