Commits · 16d2ad1d384e8b3d89434ae60508b26d0ce6ac99 · OpenDAS / vllm_cscc

04 Mar, 2026 1 commit

[Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d

Kunshang Ji authored Mar 04, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

16d2ad1d

03 Mar, 2026 1 commit

[MoE Refactor] Create MK for TRTLLM Kernels (#32564) · 97995f63

Robert Shaw authored Mar 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

97995f63

13 Feb, 2026 1 commit
- [Perf] fused_moe: add int4_w4a16 benchmark support and tuning config (#34130) · 934acdde
  Matthias Gehre authored Feb 13, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  934acdde
12 Feb, 2026 1 commit
- [Refactor] Replace `activation: str` with `MoEActivation` enum (#33843) · ff1f83b0
  Michael Goin authored Feb 11, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  ff1f83b0
11 Feb, 2026 1 commit
- [Bugfix] Fix benchmark_moe.py inplace assertion with torch >= 2.9 (#34149) · 7a048ee6
  Matthias Gehre authored Feb 11, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
```
  7a048ee6
09 Feb, 2026 1 commit
- [Model] GLM adaptation (#34124) · 978a37c8
  Jee Jee Li authored Feb 09, 2026
  
  978a37c8
31 Jan, 2026 1 commit

Add support for Mistral Large 3 inference with Flashinfer MoE (#33174) · f0bca83e

Dimitrios Bariamis authored Jan 31, 2026

Signed-off-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

f0bca83e

21 Jan, 2026 2 commits
- Add missing import of fused_topk to benchmark_moe (#32784) · f9995398
  danisereb authored Jan 21, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  f9995398
- [MoE Refactor] Oracle Select FP8+NVFP4 Kernels In Priority (#32414) · 42135d68
  Robert Shaw authored Jan 21, 2026
  
  42135d68
19 Jan, 2026 1 commit

[GLM-4.7] GLM Model support for GLM-Lite (#31386) · 71832ba7

Yuxuan Zhang authored Jan 19, 2026


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Yuxuan Zhang <2448370773@qq.com>

71832ba7

08 Jan, 2026 1 commit
- [MoE Refactor][15/N] Apply Refactor to Fp8 (#31415) · 5dcd7ef1
  Robert Shaw authored Jan 07, 2026
  
  5dcd7ef1
06 Jan, 2026 1 commit
- [Misc] Use `deprecated` for `seed_everything` (#31780) · db318326
  Cyrus Leung authored Jan 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  db318326
02 Jan, 2026 1 commit
- [Benchmark] Fix OOM during MoE kernel tuning for large models (#31604) · a0e9ee83
  Alfred authored Jan 03, 2026
```
Signed-off-by: Alfred <massif0601@gmail.com>
```
  a0e9ee83
18 Nov, 2025 1 commit
- Replace `torch.cuda.Event` with `torch.Event` for better hardware compatibility (#26985) · 2a2d5d27
  Kunshang Ji authored Nov 19, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  2a2d5d27
10 Nov, 2025 1 commit

[Hardware][AMD][Model] Add Triton MoE tuning support and optimized configs for... · 03fa4d3f

Xiake Sun authored Nov 10, 2025


[Hardware][AMD][Model] Add Triton MoE tuning support and optimized configs for Qwen3 omni for MI308X (#28373)
Signed-off-by: Xiake Sun <xiake.sun@amd.com>
Signed-off-by: Xiake Sun <xisun@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

03fa4d3f

04 Nov, 2025 1 commit
- [Model] add optimal triton fused moe configs for NemotronH MoE (#27967) · e4ee6586
  tomeras91 authored Nov 04, 2025
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
  e4ee6586
26 Oct, 2025 1 commit

[Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6

Yeshwanth N authored Oct 26, 2025


Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>

71b1c8b6

15 Oct, 2025 1 commit
- [Misc] rename torch_dtype to dtype (#26695) · 8f4b313c
  wangxiyuan authored Oct 15, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  8f4b313c
08 Oct, 2025 1 commit
- [Benchmarks] Add support for Qwen 3 VL MoE tuning (#26419) · 338b1bf0
  Lukas Geiger authored Oct 08, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  338b1bf0
30 Sep, 2025 1 commit
- [Bench] Add DeepSeekV32 to MoE benchmark (#25962) · 67f3fb08
  Jee Jee Li authored Oct 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  67f3fb08
17 Sep, 2025 1 commit
- [Kernel] Delegate construction of FusedMoEQuantConfig to FusedMoEMethodBase subclasses (#22537) · 5963b98b
  bnellnm authored Sep 17, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  5963b98b
16 Sep, 2025 1 commit
- [benchmark] Add triton version in the moe tuned config (#24769) · 04ad0dc2
  Jee Jee Li authored Sep 16, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  04ad0dc2
11 Sep, 2025 1 commit
- [Bench] Add qwen-next in benchmark_moe.py (#24661) · d11ec124
  Jee Jee Li authored Sep 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  d11ec124
07 Sep, 2025 1 commit
- [Bugfix] Fix Qwen3-coder moe tuned config (#24072) · 62f66be1
  Jee Jee Li authored Sep 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  62f66be1
28 Aug, 2025 1 commit

[Bugfix] Fix benchmark_moe.py for blockwise fp8. (#23823) · 66548f66

YUQI.CHENG authored Aug 28, 2025


Signed-off-by: crischeng <420985011@qq.com>
Co-authored-by: cris <grace@guisenbindeMacBook-Pro.local>

66548f66

19 Aug, 2025 1 commit
- [Bugfix] Fix benchmark_moe.py (#23177) · 4d9c6199
  Jee Jee Li authored Aug 19, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4d9c6199
16 Aug, 2025 1 commit
- [Misc] Add --save-dir option to benchmark_moe (#23020) · 6d3da472
  Jee Jee Li authored Aug 16, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6d3da472
11 Aug, 2025 1 commit
- [Misc] benchmark_moe supports expert parallel (#22251) · 384a0529
  Jee Jee Li authored Aug 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  384a0529
01 Aug, 2025 1 commit
- [Misc] Minor enhancement of benchmark_moe (#22068) · 8d705996
  Jee Jee Li authored Aug 02, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8d705996
19 Jul, 2025 1 commit

GLM-4 Update (#20736) · 10eb24cc

Yuxuan Zhang authored Jul 20, 2025


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Lu Fang <fanglu@fb.com>

10eb24cc

17 Jul, 2025 1 commit
- [Model] Add ToolParser and MoE Config for Hunyuan A13B (#20820) · 5a7fb3ab
  Asher authored Jul 17, 2025
```
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
```
  5a7fb3ab
11 Jul, 2025 1 commit
- [Feature] Integrate SM100 DeepGEMM support (#20087) · e2de455c
  Wentao Ye authored Jul 10, 2025
  
  e2de455c
06 Jul, 2025 1 commit

[Benchmark] Add support for multiple batch size benchmark through CLI in... · cede942b

Brayden Zhong authored Jul 06, 2025


[Benchmark] Add support for multiple batch size benchmark through CLI in `benchmark_moe.py` (#20516)
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>

cede942b

25 Jun, 2025 1 commit
- Revert "[Feature] Integrate new deepgemm (#19820)" (#20049) · a6c4b87f
  Wentao Ye authored Jun 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  a6c4b87f
24 Jun, 2025 1 commit
- [Feature] Integrate new deepgemm (#19820) · c6e3bba8
  Wentao Ye authored Jun 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c6e3bba8
10 Jun, 2025 1 commit
- [Bugfix] Fix benchmark_moe.py (#19016) · 4589b940
  Tianyu Guo authored Jun 10, 2025
```
Signed-off-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn>
```
  4589b940
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
13 May, 2025 1 commit
- Convert `benchmarks` to `ruff format` (#18068) · 009d9e75
  Harry Mellor authored May 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  009d9e75
08 May, 2025 1 commit
- [Misc] support model prefix & add deepseek vl2 tiny fused moe config (#17763) · 0a9bbaa1
  xsank authored May 08, 2025
```
Signed-off-by: 唯勤 <xsank.mz@alibaba-inc.com>
Co-authored-by: 唯勤 <xsank.mz@alibaba-inc.com>
```
  0a9bbaa1
06 May, 2025 1 commit
- [Bugfix] Fix triton import with local TritonPlaceholder (#17446) · f9bc5a06
  Mengqing Cao authored May 06, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  f9bc5a06