Commits · 31b96d1c643c5866dc080b57a71693de1b83cfc6 · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "e4e37ded563912d6d413cfc23cc1db098b3d2f09"

09 Jul, 2025 3 commits
- Support Llama 4 for cutlass_moe_fp4 (#20453) · 31b96d1c
  Michael Goin authored Jul 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  31b96d1c
- [Bugfix] Fix handling of Tensorizer arguments for LoadConfig (#20643) · 4ac9c33f
  Sanger Steel authored Jul 09, 2025
```
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
```
  4ac9c33f
- [feat] enable SM100 CUTLASS block scaled group gemm for smaller batch sizes (#20640) · 97abeb1d
  Duncan Moss authored Jul 08, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
```
  97abeb1d
08 Jul, 2025 8 commits
- [Bugfix] Fix GLM-4.1-V video prompt update (#20635) · b9fca832
  Isotr0py authored Jul 09, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  b9fca832
- [Core] Rename `get_max_tokens_per_item` for backward compatibility (#20630) · 32dffc27
  Cyrus Leung authored Jul 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  32dffc27
- [Bugfix] Fix topk_ids indices_type for CUTLASS w8a8 FP8 MoE (#20166) · c438183e
  Ming Yang authored Jul 08, 2025
```
Signed-off-by: Ming Yang <yming@meta.com>
```
  c438183e
- Revert invalid spellchecker fix on deepseek_vl2 (#20618) · c6c22f16
  viravera authored Jul 08, 2025
  
  c6c22f16
- [Model] Implement missing `get_language_model` for Keye-VL (#20631) · dd382e0f
  Cyrus Leung authored Jul 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dd382e0f
- [xpu]feat: support multi-lora on xpu (#20616) · a4c23314
  Yan Ma authored Jul 08, 2025
```
Signed-off-by: yan <yan.ma@intel.com>
```
  a4c23314
- [Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow... · 72d14d0e
  Sanger Steel authored Jul 08, 2025
```
[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow passing arbitrary arguments during save/load (#19619)
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
Co-authored-by: Eta <esyra@coreweave.com>
```
  72d14d0e
- [Bugfix] Fix Maverick correctness by filling zero to cache space in cutlass_moe (#20167) · afb7cff1
  Ming Yang authored Jul 07, 2025
```
Signed-off-by: Ming Yang <yming@meta.com>
```
  afb7cff1
07 Jul, 2025 3 commits
- [Config] Refactor mistral configs (#20570) · 14601f5f
  Patrick von Platen authored Jul 08, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  14601f5f
- Fix links in multi-modal model contributing page (#18615) · 042d131f
  Harry Mellor authored Jul 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  042d131f
- [Model][Last/4] Automatic conversion of CrossEncoding model (#19675) · 110df743
  wang.yuqi authored Jul 07, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  110df743
06 Jul, 2025 4 commits
- [Bugfix] Add `use_cross_encoder` flag to use correct activation in `ClassifierPooler` (#20527) · c18b3b8e
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c18b3b8e
- [Benchmark] Add support for multiple batch size benchmark through CLI in... · cede942b
  Brayden Zhong authored Jul 06, 2025
```
[Benchmark] Add support for multiple batch size benchmark through CLI in `benchmark_moe.py` (#20516)
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  cede942b
- [TPU][Bugfix] fix the MoE OOM issue (#20339) · 4548c03c
  Chengji Yao authored Jul 05, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  4548c03c
- [Bugfix] Fix missing per_act_token parameter in compressed_tensors_moe (#20509) · 43287082
  Lucia Fang authored Jul 06, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  43287082
05 Jul, 2025 2 commits
- [v1] Re-add fp32 support to v1 engine through FlexAttention (#19754) · 32c9be22
  Isotr0py authored Jul 05, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  32c9be22
- Fix unknown attribute of topk_indices_dtype in CompressedTensorsW8A8Fp8MoECutlassMethod (#20507) · 8aeaa910
  Lucia Fang authored Jul 05, 2025
```
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>
```
  8aeaa910
04 Jul, 2025 6 commits
- [feat]: CUTLASS block scaled group gemm for SM100 (#19757) · 3d184b95
  Duncan Moss authored Jul 04, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Co-authored-by: Duncan Moss <dmoss@nvidia.com>
```
  3d184b95
- Enable V1 for Hybrid SSM/Attention Models (#20016) · 2f35a022
  Thomas Parnell authored Jul 04, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  2f35a022
- [Model][3/N] Automatic conversion of CrossEncoding model (#20168) · 2e26f915
  wang.yuqi authored Jul 04, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  2e26f915
- [Bug][Frontend] Fix structure of transcription's decoder_prompt (#18809) · 9e5452ee
  sangbumlikeagod authored Jul 04, 2025
```
Signed-off-by: sangbumlikeagod <oironese@naver.com>
```
  9e5452ee
- Support Llama 4 for fused_marlin_moe (#20457) · 0e3fe896
  Michael Goin authored Jul 04, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0e3fe896
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
03 Jul, 2025 7 commits
- [Kernel] Enable fp8 support for pplx and BatchedTritonExperts. (#18864) · 78fe7753
  bnellnm authored Jul 03, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  78fe7753
- [Misc] Remove _maybe_ignore_quant_config from GLM4.1v (#20432) · 2f2fcb31
  Yuxuan Zhang authored Jul 04, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  2f2fcb31
- [Model][2/N] Automatic conversion of CrossEncoding model (#19978) · 6f1229f9
  wang.yuqi authored Jul 03, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  6f1229f9
- [Quantization] Bump to use latest bitsandbytes (#20424) · 1819fbda
  Jee Jee Li authored Jul 03, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1819fbda
- [Core] Move multimodal placeholder from chat utils to model definition (#20355) · b024a42e
  Cyrus Leung authored Jul 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b024a42e
- [Bugfix][CI/CD][CPU] Fix CPU CI tests (#20383) · 0ec3779d
  Li, Jiang authored Jul 03, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  0ec3779d
- [Bugfix] Fix import of CutlassExpertsFp8 in compressed_tensors_moe.py (#20381) · 2e25bb12
  bnellnm authored Jul 02, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  2e25bb12
02 Jul, 2025 7 commits
- [Kernels] MoE refactor (#19636) · c1909e7e
  bnellnm authored Jul 02, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: ElizaWszola <ewszola@redhat.com>
```
  c1909e7e
- [Model] Adds support for SlimMoE models Phi-tiny-MoE-instruct (#20286) · 706ff132
  zichongli5 authored Jul 02, 2025
```
Signed-off-by: Zichong Li <t-lizichong@microsoft.com@Reasoning-H100-VM3.drbuo4tcjzruhloch3eo0b25ef.cx.internal.cloudapp.net>
Co-authored-by: Zichong Li <t-lizichong@microsoft.com@Reasoning-H100-VM3.drbuo4tcjzruhloch3eo0b25ef.cx.internal.cloudapp.net>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  706ff132
- [Model] Add Ernie4.5 and Ernie4.5MoE Model Support (#20220) · e303dcf5
  CSWYF3634076 authored Jul 02, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  e303dcf5
- [Bugfix] Keye-VL compatibility with `tok_kwargs` (#20058) (#20353) · ba51aea6
  Cyrus Leung authored Jul 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ba51aea6
- [Model][VLM] Support Keye-VL-8B-Preview (#20126) · 8452946c
  Kwai-Keye authored Jul 02, 2025
```
Signed-off-by: Kwai-Keye <Keye@kuaishou.com>
```
  8452946c
- [Bugfix] Fix dynamic rotary embedding (#20343) · 1a03dd49
  Cyrus Leung authored Jul 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1a03dd49
- [Refactor] Remove Unused Env `VLLM_ENABLE_MOE_ALIGN_BLOCK_SIZE_TRITON` (#20334) · 9dae7d46
  Wentao Ye authored Jul 01, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  9dae7d46