Commits · b4f9e9631c84c73cbf05f18402074be1abf0471d · OpenDAS / vllm_cscc · GitLab

29 Aug, 2025 10 commits
- [CI/Build] Clean up LoRA test (#23890) · b4f9e963
  Jee Jee Li authored Aug 29, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  b4f9e963
- Fix(async): Add support for truncate_prompt_tokens in AsyncLLM (#23800) · 05d839c1
  Raghavan authored Aug 29, 2025
  
  05d839c1
- [Platform] import activation_quant_fusion for CUDA only (#23882) · 6597d7a4
  wangxiyuan authored Aug 29, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  6597d7a4
- [BugFix][AMD][Deepseek] fix a dtype mismatch error for deepseek running on AMD (#23864) · 5264015d
  Jinghui Zhang authored Aug 28, 2025
```
Signed-off-by: Jinghui Zhang <jinghuizhang0804@gmail.com>
```
  5264015d
- [Bugfix] Use `ReplicatedLinear` for SequenceClassification head (#23836) · 98ac0cb3
  Isotr0py authored Aug 29, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  98ac0cb3
- [tests] Improve speed and reliability of test_transcription_api_correctness (#23854) · c8b3b299
  Russell Bryant authored Aug 29, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  c8b3b299
- [ROCm][Fix] Fix rocm build caused by #23791 (#23847) · 006477e6
  Charlie Fu authored Aug 28, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  006477e6
- [Models] Improve iteration over layers (#19497) · de533ab2
  Lukas Geiger authored Aug 29, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  de533ab2
- [XPU] support data parallel for MoE models on XPU (#22887) · 235c9db8
  Chaojun Zhang authored Aug 29, 2025
```
Signed-off-by: chzhang <chaojun.zhang@intel.com>
```
  235c9db8
- [V0 Deprecation] Remove V0 Samplers test (#23862) · b668055a
  Woosuk Kwon authored Aug 28, 2025
  
  b668055a
28 Aug, 2025 30 commits
- [Log] Use Debug Once for DeepGEMM E8M0 When not Enabled (#23858) · d3d2aad5
  Wentao Ye authored Aug 28, 2025
  
  d3d2aad5
- [V1] Enable prefill optimization for Gemma3n (#22628) · cb293f6a
  Yong Hoon Shin authored Aug 28, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  cb293f6a
- [BugFix][FlashInfer] Fix potential race condition for paged_kv_indptr_cpu (#23737) · 7ffbf272
  Woosuk Kwon authored Aug 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7ffbf272
- chore: build release image by default (#23852) · 27e88cee
  Simon Mo authored Aug 28, 2025
```
Signed-off-by: Codex <codex@openai.com>
```
  27e88cee
- [NVIDIA] Support SiluMul + NVFP4 quant fusion (#23671) · 16a45b3a
  elvischenv authored Aug 29, 2025
```
Signed-off-by: jindih <jindih@nvidia.com>
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: jindih <jindih@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedic <lgovedic@redhat.com>
```
  16a45b3a
- [bugfix] [spec-decoding] fix data race in sample_recovered_tokens_kernel (vLLM v1) (#23829) · 57d4ede5
  Jingkai He authored Aug 29, 2025
```
Signed-off-by: He-Jingkai <he-jingkai@outlook.com>
```
  57d4ede5
- [ROCm][Aiter] Add triton fp8 bmm kernel for mla (#23264) · 04d1dd7f
  Divakar Verma authored Aug 28, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Co-authored-by: ShaoChunLee <Shao-Chun.Lee@amd.com>
```
  04d1dd7f
- Migrate Llama4ImagePatchInputs to TensorSchema (#22021) · f32a5bc5
  Benji Beck authored Aug 28, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  f32a5bc5
- Add scale_config.yml file for Meta autoscalers for GH Actions (#23840) · 8805ad9f
  Jean Schmidt authored Aug 28, 2025
```
Signed-off-by: Jean Schmidt <contato@jschmidt.me>
```
  8805ad9f
- [ci] breaks down V1 Test into 3 groups of approx 30 minutes runtime (#23757) · 0583578f
  Jean Schmidt authored Aug 28, 2025
```
Signed-off-by: Jean Schmidt <contato@jschmidt.me>
```
  0583578f
- [Bugfix] Add fake mode around passes (#23349) · db74d604
  Angela Yi authored Aug 28, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  db74d604
- [Model][gpt-oss] Support DP+EP for GPT-OSS with FlashInfer trtllm-gen MoE (#23819) · 95089607
  Po-Han Huang (NVIDIA) authored Aug 28, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
```
  95089607
- [CI] Fix linting error on main (#23835) · 1f096f9b
  Thomas Parnell authored Aug 28, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  1f096f9b
- [Bugfix] Fix benchmark_moe.py for blockwise fp8. (#23823) · 66548f66
  YUQI.CHENG authored Aug 28, 2025
```
Signed-off-by: crischeng <420985011@qq.com>
Co-authored-by: cris <grace@guisenbindeMacBook-Pro.local>
```
  66548f66
- [Doc]: fix typos in Python scripts (#23828) · d3da2eea
  Didier Durand authored Aug 28, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  d3da2eea
- [Model] [gpt-oss] fix gpt-oss pp support (#23815) · bfab2196
  Jiangyun Zhu authored Aug 28, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  bfab2196
- [BugFix][Spec Decode] Use float64 for uniform_probs (#23803) · a3432f18
  Woosuk Kwon authored Aug 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  a3432f18
- [CI/Build][Bugfix] Fix Qwen VL tests on CPU (#23818) · 67cee40d
  Li, Jiang authored Aug 28, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  67cee40d
- [Doc]: fix typos in .md files (including those of #23751) (#23825) · d99c3a4f
  Didier Durand authored Aug 28, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  d99c3a4f
- [FIXBUG] Add return_success parameter to moe_wna16_weight_loader function (#22797) · 3462c1c5
  JartX authored Aug 28, 2025
```
Signed-off-by: JartX <sagformas@epdcenter.es>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  3462c1c5
- [Model] Add PP support and VLM backbone compatability for GPT-OSS (#23680) · c5d004aa
  Isotr0py authored Aug 28, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  c5d004aa
- [New Model]: Support GteNewModelForSequenceClassification (#23524) · 11a7fafa
  wang.yuqi authored Aug 28, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  11a7fafa
- [Kernel] cuda kernels for upcoming decode context parallel feature (#23791) · 186aced5
  yzds authored Aug 28, 2025
```
Co-authored-by: hongchao <hongchao@msh.team>
```
  186aced5
- [Bugfix] when set offline model running error (#23711) · daa1273b
  rongfu.leng authored Aug 28, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  daa1273b
- [CI] enable idefics3 and fuyu-8b test in multimodal test (#23790) · c07a7331
  Jiangyun Zhu authored Aug 28, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  c07a7331
- [Transform] [Quantization] Add transforms to compressed tensors (#22486) · 22feac8e
  Kyle Sayers authored Aug 28, 2025
  
  22feac8e
- Add deprecation warning for lora_extra_vocab_size (#23635) · c8851a47
  Jinheng authored Aug 28, 2025
```
Signed-off-by: Jinheng Li <ahengljh@gmail.com>
```
  c8851a47
- [CI] make all multi-gpu weight loading tests run nightly (#23792) · f48a9af8
  Alex authored Aug 27, 2025
```
Signed-off-by: Alex Yun <alexyun04@gmail.com>
```
  f48a9af8
- Gracefully handle edge cases in harmony utils (#23155) · a11adafd
  Jan Kessler authored Aug 28, 2025
```
Signed-off-by: Jan Kessler <jakessle@uni-mainz.de>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a11adafd
- [Perf] Tune configs for triton block fp8 gemm H100/H200 (#23748) · a781e84e
  Michael Goin authored Aug 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a781e84e