Commits · cf4cd53982161cb67c86b69f4a319625b231b0bd · OpenDAS / vllm_cscc

05 Jul, 2025 5 commits
- [Misc] Add logger.exception for TPU information collection failures (#20510) · cf4cd539
  Reid authored Jul 05, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  cf4cd539
- [v1] Re-add fp32 support to v1 engine through FlexAttention (#19754) · 32c9be22
  Isotr0py authored Jul 05, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  32c9be22
- Fix unknown attribute of topk_indices_dtype in CompressedTensorsW8A8Fp8MoECutlassMethod (#20507) · 8aeaa910
  Lucia Fang authored Jul 05, 2025
```
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>
```
  8aeaa910
- [Misc] Remove the unused LoRA test code (#20494) · 906e05d8
  Jee Jee Li authored Jul 05, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  906e05d8
- [Misc] Add security warning for development mode endpoints (#20508) · 7e908704
  Reid authored Jul 05, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  7e908704
04 Jul, 2025 11 commits
- [CI Bugfix] Fix pre-commit failures on main (#20502) · c108781c
  Michael Goin authored Jul 05, 2025
  
  c108781c
- [feat]: CUTLASS block scaled group gemm for SM100 (#19757) · 3d184b95
  Duncan Moss authored Jul 04, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Co-authored-by: Duncan Moss <dmoss@nvidia.com>
```
  3d184b95
- Enable V1 for Hybrid SSM/Attention Models (#20016) · 2f35a022
  Thomas Parnell authored Jul 04, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  2f35a022
- [Misc] Small: Remove global media connector. Each test should have its own... · ffe00ef7
  Chenheli Hua authored Jul 04, 2025
```
[Misc] Small: Remove global media connector. Each test should have its own test connector object. (#20395)
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  ffe00ef7
- [Model][3/N] Automatic conversion of CrossEncoding model (#20168) · 2e26f915
  wang.yuqi authored Jul 04, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  2e26f915
- [Bug][Frontend] Fix structure of transcription's decoder_prompt (#18809) · 9e5452ee
  sangbumlikeagod authored Jul 04, 2025
```
Signed-off-by: sangbumlikeagod <oironese@naver.com>
```
  9e5452ee
- Support Llama 4 for fused_marlin_moe (#20457) · 0e3fe896
  Michael Goin authored Jul 04, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0e3fe896
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
- [Structured Outputs][V1] Skipping with models doesn't contain tokenizers (#20365) · 4a98edff
  Aaron Pham authored Jul 04, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  4a98edff
- [Platform] Add custom default max tokens (#18557) · a4113b03
  Gabriel Marinho authored Jul 03, 2025
```
Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
```
  a4113b03
- [Misc] Change warn_for_unimplemented_methods to debug (#20455) · 7e1665b0
  Michael Goin authored Jul 04, 2025
  
  7e1665b0
03 Jul, 2025 17 commits
- [Bugfix] Register reducer even if transformers_modules not available (#19510) · 8d1096e7
  Seiji Eicher authored Jul 03, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  8d1096e7
- [Misc] Fix `Unable to detect current VLLM config. Defaulting to NHD kv cache... · 8d775dd3
  Nicolò Lucchesi authored Jul 03, 2025
```
[Misc] Fix `Unable to detect current VLLM config. Defaulting to NHD kv cache layout` warning (#20400)
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  8d775dd3
- [Kernel] Enable fp8 support for pplx and BatchedTritonExperts. (#18864) · 78fe7753
  bnellnm authored Jul 03, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  78fe7753
- [Misc] Remove _maybe_ignore_quant_config from GLM4.1v (#20432) · 2f2fcb31
  Yuxuan Zhang authored Jul 04, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  2f2fcb31
- [Misc] adjust for ipv6 for mookcacke url parse (#20107) · 1dba2c4e
  Ning Xie authored Jul 04, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  1dba2c4e
- [Misc] Clean up InternVL family config registration (#19992) · 71d6de3a
  Isotr0py authored Jul 04, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  71d6de3a
- [Frontend] fix duplicate output for bench subcmd (#20446) · 619b9f5c
  Reid authored Jul 03, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  619b9f5c
- [Frontend] improve vllm bench <bench_type> --help display (#20430) · 9854dc90
  Reid authored Jul 03, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  9854dc90
- [Model][2/N] Automatic conversion of CrossEncoding model (#19978) · 6f1229f9
  wang.yuqi authored Jul 03, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  6f1229f9
- [Quantization] Bump to use latest bitsandbytes (#20424) · 1819fbda
  Jee Jee Li authored Jul 03, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1819fbda
- [Kernel] refactor cpu worker v0 cache dtype (#20080) · fb14d53c
  Ning Xie authored Jul 03, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  fb14d53c
- [Core] Move multimodal placeholder from chat utils to model definition (#20355) · b024a42e
  Cyrus Leung authored Jul 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b024a42e
- [Feature] Support MiniMax-M1 function calls features (#20297) · 363528de
  qscqesze authored Jul 03, 2025
```
Signed-off-by: QscQ <qscqesze@gmail.com>
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
  363528de
- [Bugfix][CI/CD][CPU] Fix CPU CI tests (#20383) · 0ec3779d
  Li, Jiang authored Jul 03, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  0ec3779d
- [Misc] Small: Fix video loader return type annotations. (#20389) · b616f6a5
  Chenheli Hua authored Jul 02, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  b616f6a5
- [Bugfix] Fix import of CutlassExpertsFp8 in compressed_tensors_moe.py (#20381) · 2e25bb12
  bnellnm authored Jul 02, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  2e25bb12
- [BugFix] Fix DP headless mode arg validation (#20398) · 059d4cdb
  Nick Hill authored Jul 03, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  059d4cdb
02 Jul, 2025 7 commits

[DP] Support external DP Load Balancer mode (#19790) · 657f2f30
Nick Hill authored Jul 02, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
657f2f30
[ROCm][FEAT] Enable Full Graph Mode in AITER MLA V1 Attn Backend (Decode Phase only) (#20254) · a1aafc82
vllmellm authored Jul 03, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
a1aafc82
[Misc] add handler HF_TOKEN is emptry string (#20369) · 139508a4
rongfu.leng authored Jul 03, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
139508a4

[V1] LogitsProcessor programming model (#16728) · 48fb076c

afeldman-nm authored Jul 02, 2025


Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

48fb076c

[Kernels] MoE refactor (#19636) · c1909e7e

bnellnm authored Jul 02, 2025


Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: ElizaWszola <ewszola@redhat.com>

c1909e7e

[Model] Adds support for SlimMoE models Phi-tiny-MoE-instruct (#20286) · 706ff132

zichongli5 authored Jul 02, 2025

Signed-off-by: Zichong Li <t-lizichong@microsoft.com@Reasoning-H100-VM3.drbuo4tcjzruhloch3eo0b25ef.cx.internal.cloudapp.net>
Co-authored-by: Zichong Li <t-lizichong@microsoft.com@Reasoning-H100-VM3.drbuo4tcjzruhloch3eo0b25ef.cx.internal.cloudapp.net>
Co-authored-by: Isotr0py <2037008807@qq.com>

706ff132

[Bugfix] Fix the max_seq_len limit of 16384 for DeepSeek models (#20322) · ccbfb1d1
WangHuaqiang authored Jul 02, 2025
```
Signed-off-by: Wang Huaqiang <huaqiang.wang@intel.com>
```
ccbfb1d1