Commits · 8f423e5f43eca54c9b0e5583ab388fd6d5cc8672 · OpenDAS / vllm_cscc

"gradio_webserver.py" did not exist on "721fa3df155e5649bbe2188517594f24f4e63523"

04 Sep, 2025 10 commits

[Feature][Response API] Add streaming support for non-harmony (#23741) · 8f423e5f
Kebe authored Sep 04, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
8f423e5f

[Attention] FlashAttn MLA (#14258) · 402759d4

Lucas Wilkinson authored Sep 04, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

402759d4

[Bugfix] Fix Incremental Detokenization with `tokenizers == 0.22.0` (#24159) · 2c301ee2

Fanli Lin authored Sep 04, 2025

Signed-off-by: Fanli Lin <fanli.lin@intel.com>
Signed-off-by: Fanli Lin <fanli0116@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

2c301ee2

[Attention][Platform] Refactor MLA to support Custom Op (#23332) · 3efb9f4d
whx authored Sep 04, 2025
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
3efb9f4d

[Core][Model] Terratorch backend integration (#23513) · 51d5e9be

mgazz authored Sep 04, 2025


Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

51d5e9be

[Model] Add MiDashengLM model support (#23652) · e7fc7001

bingchen-mi authored Sep 04, 2025


Signed-off-by: chenbing8 <chenbing8@xiaomi.com>
Signed-off-by: bingchen-mi <chenbing8@xiaomi.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

e7fc7001

[CPU] Refactor CPU unquantized linear (#24150) · 57b1ce94
Li, Jiang authored Sep 04, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
57b1ce94
Migrate ultravox inputs to TensorSchema (#23503) · cb55ad86
Benji Beck authored Sep 03, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
cb55ad86
[Refactor] Introduce basic Renderer for completion-style request (#24010) · 712b273f
Flora Feng authored Sep 03, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
712b273f
[Feature][Responses API]Support MCP tools with streaming mode + background mode (#23927) · a38f8bd5
wuhang authored Sep 04, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
```
a38f8bd5

03 Sep, 2025 23 commits
- Remove deprecated `PyNcclConnector` (#24151) · b5ee1e32
  Peter Pan authored Sep 04, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  b5ee1e32
- [Feature][gpt-oss] Add support for num_cached_tokens and num_reasoning_tokens tracking (#23460) · 36c260da
  George Nagy II authored Sep 03, 2025
```
Signed-off-by: George Nagy II <george.nagy0969@gmail.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  36c260da
- [Bugfix][DP] DP distribution does not require ray[default] (#23822) · a43a3f17
  Kebe authored Sep 04, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  a43a3f17
- [Feature][P/D]: Optimize NIXL Connector xfer Launch (#23887) · 6adaed42
  WeiQing Chen authored Sep 04, 2025
```
Signed-off-by: ycyaw66 <497410282@qq.com>
Co-authored-by: ycyaw66 <497410282@qq.com>
```
  6adaed42
- [Attention] Blackwell FP8 MLA support with CUTLASS_MLA backend (#23289) · a7423220
  Matthew Bonanni authored Sep 03, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  a7423220
- Migrate whisper inputs to TensorSchema (#23505) · 731a6940
  Benji Beck authored Sep 03, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  731a6940
- [Kernels] Overlap shared experts with send/recv (#23273) · e9b92dcd
  bnellnm authored Sep 03, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  e9b92dcd
- [V1] v1 engine + full CUDA graph support for PLaMo2 (#23998) · fa4311d8
  nopperl authored Sep 04, 2025
```
Signed-off-by: Hemmi Shinichi <shemmi@preferred.jp>
Signed-off-by: nopperl <54780682+nopperl@users.noreply.github.com>
Co-authored-by: Hemmi Shinichi <shemmi@preferred.jp>
Co-authored-by: Thomas Parnell <tom.parnell@gmail.com>
```
  fa4311d8
- [Bugfix] Fixing division by zero in triton_attn if query_heads/kv_heads > 16 (#23424) · 6d80ae83
  Burkhard Ringlein authored Sep 03, 2025
```
Signed-off-by: Burkhard Ringlein <ngl@zurich.ibm.com>
```
  6d80ae83
- [Model] Remove useless code from MiniMax implementation (#23982) · 6997a25a
  qscqesze authored Sep 03, 2025
```
Signed-off-by: QscQ <qscqesze@gmail.com>
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
  6997a25a
- Support add_generation_prompt in embeddings endpoint with chat request (#23931) · 28f350e1
  Jakub Smid authored Sep 03, 2025
```
Signed-off-by: biba10 <jaksmid@seznam.cz>
```
  28f350e1
- [Misc] Clean up deadcode for legacy processing pipeline (#24153) · 9c99e487
  Isotr0py authored Sep 03, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  9c99e487
- [CI/Build] Serve images used by multimodal tests through local HTTP Server (#23907) · 70549c12
  dsinghvi authored Sep 03, 2025
```
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com>
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  70549c12
- [Nixl] Heterogeneous TP support FlashInfer (#20189) · f0c503f6
  Nicolò Lucchesi authored Sep 03, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  f0c503f6
- [distributed][rl] remove nccl cumem env var override (#24141) · f38035c1
  youkaichao authored Sep 03, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  f38035c1
- [BugFix] Fix routed_scaling_factor double mul for dots1 and glm4 MoE models (#24132) · 426cc862
  Yong Hoon Shin authored Sep 02, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  426cc862
- [Misc] Add check for dual_chunk_attention (#24070) · e81d4e69
  Jiangyun Zhu authored Sep 03, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  e81d4e69
- [Doc]: fix typos in Python comments (#24115) · 02d411fd
  Didier Durand authored Sep 03, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  02d411fd
- [Doc]: fix typos in Python comments (#24093) · d7e1e599
  Didier Durand authored Sep 03, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  d7e1e599
- fix some typos (#24071) · 1bd007f2
  co63oc authored Sep 03, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  1bd007f2
- [V1] Wrapper which plumbs request-level logits processors into vLLM... · 136d853e
  afeldman-nm authored Sep 02, 2025
```
[V1] Wrapper which plumbs request-level logits processors into vLLM batch-level logits processing (#23656)
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
```
  136d853e
- Upgrade xgrammar to 0.1.23 (#22988) · e32a0e86
  Russell Bryant authored Sep 02, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  e32a0e86
- [XPU] Fix the bug of LoRA logits on the XPU platform (#24081) · 862f2ef8
  Chaojun Zhang authored Sep 03, 2025
```
Signed-off-by: chzhang <chaojun.zhang@intel.com>
```
  862f2ef8
02 Sep, 2025 7 commits
- [Bug] R1 Accuracy: Fix `routed_scaling_factor` Double Mul Issue (#24119) · 930a2414
  Wentao Ye authored Sep 02, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  930a2414
- [AMD][Kernel][Bugfix] Cast offsets tensor bn to tl.int64 to avoid GPU segfault (#23692) · 457e4719
  rasmith authored Sep 02, 2025
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  457e4719
- [Log] Only Print Profiler Results on Rank 0 (#23370) · 98aee612
  Wentao Ye authored Sep 02, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  98aee612
- Fix weights loading for Apertus (#24100) · 598bd74c
  nathan authored Sep 02, 2025
```
Signed-off-by: Nathan Ranchin <nranchin@student.ethz.ch>
```
  598bd74c
- [Metrics] Deprecate TPOT in favor of ITL (#24110) · 24177984
  Mark McLoughlin authored Sep 02, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  24177984
- [Bugfix] Fix packed_factor missing attribute error (#23902) · 9480ae24
  Kyuyeun Kim authored Sep 02, 2025
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  9480ae24
- Run ruff format on a few files. (#24075) · f399182e
  Chenheli Hua authored Sep 02, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  f399182e