Commits · cf4cd6c24f48e5efdcfa1a94915c77e1437a94b4 · OpenDAS / vllm_cscc

09 Oct, 2025 1 commit
- Bump Flashinfer to v0.4.0 (#26326) · 5e49c3e7
  elvischenv authored Oct 09, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  5e49c3e7
08 Oct, 2025 1 commit
- [torchao] safetensors integration (#25969) · b32260ab
  liangel-02 authored Oct 07, 2025
```
Signed-off-by: Angel Li <liangel@meta.com>
```
  b32260ab
07 Oct, 2025 2 commits
- [ci] Rename `test_mxfp4_moe.py` to `test_ocp_mx_moe.py` (#26364) · a38c1bfe
  fxmarty-amd authored Oct 07, 2025
```
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
```
  a38c1bfe
- [Feature][OCP MX] Support mxfp6 and mixed mxfp6-mxfp4 (#21166) · 41f1cf38
  fxmarty-amd authored Oct 07, 2025
  
  41f1cf38
06 Oct, 2025 1 commit

[CI Bugfix] Make sure TRTLLM attention is available in test_blackwell_moe (#26188) · 20db99cc

Michael Goin authored Oct 06, 2025

Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

20db99cc

05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
02 Oct, 2025 2 commits

[Perf] Fix and reapply move apply w8a8 block fp8 linear to class (#25696) · 502640c3

ElizaWszola authored Oct 02, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: ElizaWszola <elizaw.9289@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

502640c3

[CI] Add Blackwell DeepSeek FP8 FlashInfer MoE tests (#26040) · 3b279a84
Michael Goin authored Oct 02, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
3b279a84

01 Oct, 2025 1 commit
- Support RL online quantization with torchao (#23014) · c3124680
  Jerry Zhang authored Oct 01, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  c3124680
26 Sep, 2025 1 commit
- [CI] Add E2E Blackwell Quantized MoE Test (#25723) · f708bd49
  Michael Goin authored Sep 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f708bd49
25 Sep, 2025 1 commit
- Revert "[Performance] Move apply_w8a8_block_fp8_linear to an op class… (#25607) · 1260180c
  Tyler Michael Smith authored Sep 25, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  1260180c
23 Sep, 2025 1 commit

[Performance] Move apply_w8a8_block_fp8_linear to an op class (#24666) · 63400259

ElizaWszola authored Sep 23, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: ElizaWszola <elizaw.9289@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

63400259

21 Sep, 2025 1 commit
- [CI] Skip tests failing on main (#25326) · 72dd1595
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  72dd1595
20 Sep, 2025 1 commit
- [V1] Support `LLM.apply_model` (#18465) · 3d9a1d2d
  Cyrus Leung authored Sep 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3d9a1d2d
17 Sep, 2025 1 commit
- [Rocm] [quantization] Fix quark ptpc moe and add test case (#24649) · ca2d1925
  haoyangli-amd authored Sep 17, 2025
```
Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
Co-authored-by: Haoyang Li <haoyang.li@amd.com>
```
  ca2d1925
11 Sep, 2025 1 commit
- [torchao] Support quantization configs using module swap (#21982) · 2048c4e3
  Jerry Zhang authored Sep 10, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  2048c4e3
03 Sep, 2025 1 commit
- fix some typos (#24071) · 1bd007f2
  co63oc authored Sep 03, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  1bd007f2
28 Aug, 2025 1 commit
- [Transform] [Quantization] Add transforms to compressed tensors (#22486) · 22feac8e
  Kyle Sayers authored Aug 28, 2025
  
  22feac8e
27 Aug, 2025 1 commit
- [quantization] use channel scales for w4a8 + misc fixes (#23570) · 2c2b140a
  czhu-cohere authored Aug 26, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  2c2b140a
22 Aug, 2025 1 commit
- [Deprecation] Remove `prompt_token_ids` arg fallback in `LLM.generate` and `LLM.embed` (#18800) · 8896eb72
  Cyrus Leung authored Aug 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8896eb72
20 Aug, 2025 1 commit
- [Kernel/Quant] Remove the original marlin format and qqq (#23204) · 0cdbf5e6
  Michael Goin authored Aug 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0cdbf5e6
06 Aug, 2025 1 commit

Update transformers to `v4.55` (#21931) · 796bae07

Harry Mellor authored Aug 06, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

796bae07

05 Aug, 2025 1 commit
- [Feature] Non-contiguous Support for FP8 Quantization (#21961) · 4771df7b
  Wentao Ye authored Aug 05, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  4771df7b
28 Jul, 2025 2 commits

[Model] Support TP/PP/mamba2 kernel for PLaMo2 (#19674) · c7ffe93d

Shinichi Hemmi authored Jul 28, 2025


Signed-off-by: Shinichi Hemmi <shemmi@preferred.jp>
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
Co-authored-by: Calvin Metzger <metzger@preferred.jp>
Co-authored-by: Sixue Wang <cecilwang@preferred.jp>

c7ffe93d

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f

27 Jul, 2025 1 commit
- [Refactor] Refactor MOE NVFP4 Code Base: ModelOpt + Compressed Tensor (#21631) · bda9d053
  Wentao Ye authored Jul 27, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  bda9d053
26 Jul, 2025 1 commit
- [Feature] Add support for MoE models in the calibration-free RTN-based quantization (#20766) · 7ae75fa6
  Alex Kogan authored Jul 25, 2025
```
Signed-off-by: Alex Kogan <alex.kogan@oracle.com>
```
  7ae75fa6
21 Jul, 2025 2 commits
- Add Nvidia ModelOpt config adaptation (#19815) · 6b46c4b6
  Zhiyu authored Jul 21, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  6b46c4b6
- [Misc] unify variable for LLM instance (#20996) · d9784107
  Ning Xie authored Jul 21, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  d9784107
10 Jul, 2025 1 commit
- [Misc] Clean up mark to fork process in BNB tests (#20692) · 77f77a95
  Isotr0py authored Jul 10, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  77f77a95
09 Jul, 2025 1 commit

[Feature][Quantization] MXFP4 support for MOE models (#17888) · 332d4cb1

fxmarty-amd authored Jul 09, 2025


Signed-off-by: Felix Marty <felmarty@amd.com>
Signed-off-by: Bowen Bao <bowenbao@amd.com>
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Bowen Bao <bowenbao@amd.com>

332d4cb1

08 Jul, 2025 1 commit
- [CI/Build][CPU] Fix CPU CI and remove all CPU V0 files (#20560) · 7721ef17
  Li, Jiang authored Jul 08, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7721ef17
04 Jul, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
01 Jul, 2025 2 commits
- [Quant] [Bugfix] Fix quantization config matching with `hf_to_vllm_mapper` (#20046) · 9025a9a7
  Kyle Sayers authored Jul 01, 2025
  
  9025a9a7
- [Feature] A calibration-free RTN-based quantization for accurate and... · 27949354
  Alex Kogan authored Jul 01, 2025
```
[Feature] A calibration-free RTN-based quantization for accurate and accelerated INT4/INT8 inference (#18768)
Signed-off-by: Alex Kogan <alex.kogan@oracle.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  27949354
29 Jun, 2025 1 commit
- [Quantization] Add compressed-tensors NVFP4 MoE Support (#19990) · 6f2f53a8
  Dipika Sikka authored Jun 30, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
Signed-off-by: Dipika <dipikasikka1@gmail.com>
```
  6f2f53a8
23 Jun, 2025 2 commits
- [Bugfix][v1] Fix step pooler implementation and step pooling usage in v1 (#19956) · 61f4fc5d
  Isotr0py authored Jun 24, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  61f4fc5d
- [Bugfix] Fix CI bitsandbytes failure (#19969) · a6e6604d
  Jee Jee Li authored Jun 23, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a6e6604d
16 Jun, 2025 1 commit
- [Quantization] Remove FP4 emulation; Fall-back to marlin for device < 100 (#19563) · 6bc7b573
  Dipika Sikka authored Jun 16, 2025
  
  6bc7b573
12 Jun, 2025 1 commit
- Fix TorchAOConfig skip layers (#19265) · 96846bb3
  mobicham authored Jun 12, 2025
```
Signed-off-by: mobicham <hicham@mobiuslabs.com>
```
  96846bb3