Commits · ccb97338af73fe878731758040ec93c668d0b1a7 · OpenDAS / vllm_cscc

"tests/kernels/attention/test_cache.py" did not exist on "56f738ae9b631189e67795b397258afbed59b042"

09 Sep, 2025 21 commits
- [Misc] Add Codex settings to gitignore (#24493) · ccb97338
  Roger Wang authored Sep 09, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  ccb97338
- [Misc] Add claude settings to gitignore (#24492) · 45c9cb58
  Ye (Charlotte) Qi authored Sep 09, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  45c9cb58
- [Performance][MM] Building the inverse permutation in O(n) time in... · e283976f
  WeiQing Chen authored Sep 09, 2025
```
[Performance][MM] Building the inverse permutation in O(n) time in Qwen2_5_VisionTransformer (#24443)
Signed-off-by: Junhong <liujunhong11@huawei.com>
Co-authored-by: Junhong <liujunhong11@huawei.com>
```
  e283976f
- [Doc]: fixing typos to improve docs (#24480) · 46876dff
  Didier Durand authored Sep 09, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  46876dff
- [Misc] Support bench serve long context (#24373) · 1823a00d
  Ming Yang authored Sep 08, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  1823a00d
- [Doc] mention fpdb for multiprocess breakpoints (#24452) · ed16d0f2
  Mickaël Seznec authored Sep 09, 2025
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
```
  ed16d0f2
- [Misc] Improve Worker process title and logging prefix (#22205) · 0cdd2136
  22quinn authored Sep 08, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  0cdd2136
- [Bugfix] Fix Apertus HF repo name (#24447) · 948dd344
  Cyrus Leung authored Sep 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  948dd344
- Add data_parallel_size to VllmConfig string representation (#24298) · b2f77457
  cong-meta authored Sep 08, 2025
```
Co-authored-by: Cong Chen <congc@meta.com>
```
  b2f77457
- [Core] Use sha256 bytes instead of BlockHash to reduce GC overhead (#23673) · 82dfb12e
  Zebing Lin authored Sep 09, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
  82dfb12e
- [Flashinfer] Support Flashinfer TRTLLM FP8-qkv BF16/FP16-out Attention Kernel (#23647) · bba1042c
  elvischenv authored Sep 09, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  bba1042c
- [BugFix][Model] Fix Ernie4.5-VL hanging on long inputs (#24074) · b6fbc156
  CSWYF3634076 authored Sep 09, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  b6fbc156
- Move `KVTransferConfig` from `config/__init__.py` to `config/kv_transfer.py` (#24434) · 3e0d4a34
  Harry Mellor authored Sep 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3e0d4a34
- Bump actions/github-script from 7.0.1 to 8.0.0 (#24413) · 562663a0
  dependabot[bot] authored Sep 09, 2025
```
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  562663a0
- Bump actions/stale from 9.1.0 to 10.0.0 (#24412) · ed1623a8
  dependabot[bot] authored Sep 09, 2025
```
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  ed1623a8
- [doc] update `vllm serve` cli args documentation (#24329) · 13b89bd8
  cjackal authored Sep 09, 2025
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  13b89bd8
- Bump actions/setup-python from 5.4.0 to 6.0.0 (#24414) · 22a00705
  dependabot[bot] authored Sep 09, 2025
```
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  22a00705
- [gpt-oss] Harmony changes with container tool support (#23386) · 170129eb
  zhiweiz authored Sep 08, 2025
```
Signed-off-by: zhiweiz <zhiweiz@fb.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
Co-authored-by: zhiweiz <zhiweiz@fb.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  170129eb
- [Bugfix][Wide EP] Fix redundant work when using DeepEP, TP Attn, and EP MoE (#24134) · 955c6249
  Tyler Michael Smith authored Sep 08, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  955c6249
- Update reviewers for modelopt related files (#24468) · 4f87abdc
  Zhiyu authored Sep 08, 2025
  
  4f87abdc
- [CI] Add nightly multiarch manifests to dockerhub (#24102) · 6910b56d
  Sahithi Chigurupati authored Sep 08, 2025
```
Signed-off-by: Sahithi Chigurupati <chigurupati.sahithi@gmail.com>
Signed-off-by: Simon Mo <simon.mo@hey.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  6910b56d
08 Sep, 2025 19 commits

[Hardware][IBM Z] Fix Outlines Core issue for s390x (#24034) · e10fef08
R3hankhan authored Sep 09, 2025
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
e10fef08
[Bugfix] Disable the statslogger if the api_server_count is greater than 1 (#22227) · e680723e
Chauncey authored Sep 09, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
e680723e

[Attention] FlashAttention MLA cudagraph support (#23958) · 620db1fc

Matthew Bonanni authored Sep 08, 2025


Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

620db1fc

[Spec Decode] Fix offline spec_decode.py (#24257) · 41183c1f

Ekagra Ranjan authored Sep 08, 2025


Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

41183c1f

[Model loader]: support multi-thread model weight loading (#23928) · 43d9ad03

Yang Kaiyong authored Sep 09, 2025


Signed-off-by: Yang Kaiyong <yangkaiyong.yky@antgroup.com>
Signed-off-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

43d9ad03

[CI] Enable encoder model compilation test (#24442) · 7be141b2
Jiangyun Zhu authored Sep 09, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
7be141b2
[Model] Remove quantized mixtral (#24437) · 8d7f39b4
Jee Jee Li authored Sep 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
8d7f39b4

[Spec Decode][Benchmark] Add Blitzedit dataset (#23605) · cd086369

Ekagra Ranjan authored Sep 08, 2025


Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

cd086369

[Spec Decode][Benchmark] Add Spec Bench Dataset for benchmarking (#23563) · 3feeeb9f
Ekagra Ranjan authored Sep 08, 2025
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
3feeeb9f
[Model] Enable BNB support for qwen2_5_omni_thinker (#24420) · 6f4a82f8
Jee Jee Li authored Sep 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
6f4a82f8
[Docs]add eplb_config param use docs (#24213) · c44797a4
rongfu.leng authored Sep 09, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
c44797a4

[Doc]: fix 2 hyperlinks leading to Ray site after they changed Ray's doc structure (#24438) · 55be93ba

Didier Durand authored Sep 08, 2025

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

55be93ba

[Docs] Move feature compatibility tables to README (#24431) · 717fc00e
Harry Mellor authored Sep 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
717fc00e

[Frontend] User-provided uuids for medias in chat. (RFC #22044) (#23449) · 01dfb5e9

Chenheli Hua authored Sep 08, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

01dfb5e9

Move `KVEventsConfig` from `config/__init__.py` to `config/kv_events.py` (#24433) · 03dd652c
Harry Mellor authored Sep 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
03dd652c

[Misc] Terratorch related fixes (#24337) · 9cd76b71

Christian Pinto authored Sep 08, 2025


Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

9cd76b71

[Bugfix] Fix mamba2 prefill chunking (#23279) · e0413141

tomeras91 authored Sep 08, 2025

Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
Signed-off-by: tomeras91 <57313761+tomeras91@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

e0413141

[Bugfix] Fix get_quant_config when using modelscope (#24421) · 5e537f45
Li Wang authored Sep 08, 2025
```
Signed-off-by: wangli <wangli858794774@gmail.com>
```
5e537f45
[Doc] Fix issues in integrations/llamastack.md (#24428) · c2a8b08f
Michael Yao authored Sep 08, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
c2a8b08f