Commits · a99300bda69edba0082a9038143ecd66de4d078b · OpenDAS / vllm_cscc · GitLab

28 Aug, 2025 1 commit

[Bugfix] Fix benchmark_moe.py for blockwise fp8. (#23823) · 66548f66

YUQI.CHENG authored Aug 28, 2025


Signed-off-by: crischeng <420985011@qq.com>
Co-authored-by: cris <grace@guisenbindeMacBook-Pro.local>

66548f66

19 Aug, 2025 1 commit
- [Bugfix] Fix benchmark_moe.py (#23177) · 4d9c6199
  Jee Jee Li authored Aug 19, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4d9c6199
16 Aug, 2025 1 commit
- [Misc] Add --save-dir option to benchmark_moe (#23020) · 6d3da472
  Jee Jee Li authored Aug 16, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6d3da472
11 Aug, 2025 1 commit
- [Misc] benchmark_moe supports expert parallel (#22251) · 384a0529
  Jee Jee Li authored Aug 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  384a0529
04 Aug, 2025 1 commit
- add step3-vl tuning · 4e2ff6b5
  zhuwenwen authored Aug 04, 2025
  
  4e2ff6b5
01 Aug, 2025 1 commit
- [Misc] Minor enhancement of benchmark_moe (#22068) · 8d705996
  Jee Jee Li authored Aug 02, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8d705996
29 Jul, 2025 1 commit
- GLM-4.5 Model Support · 751c492c
  zhuwenwen authored Jul 29, 2025
  
  751c492c
19 Jul, 2025 1 commit

GLM-4 Update (#20736) · 10eb24cc

Yuxuan Zhang authored Jul 20, 2025


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Lu Fang <fanglu@fb.com>

10eb24cc

17 Jul, 2025 1 commit
- [Model] Add ToolParser and MoE Config for Hunyuan A13B (#20820) · 5a7fb3ab
  Asher authored Jul 17, 2025
```
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
```
  5a7fb3ab
11 Jul, 2025 1 commit
- [Feature] Integrate SM100 DeepGEMM support (#20087) · e2de455c
  Wentao Ye authored Jul 10, 2025
  
  e2de455c
06 Jul, 2025 1 commit

[Benchmark] Add support for multiple batch size benchmark through CLI in... · cede942b

Brayden Zhong authored Jul 06, 2025


[Benchmark] Add support for multiple batch size benchmark through CLI in `benchmark_moe.py` (#20516)
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>

cede942b

25 Jun, 2025 1 commit
- Revert "[Feature] Integrate new deepgemm (#19820)" (#20049) · a6c4b87f
  Wentao Ye authored Jun 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  a6c4b87f
24 Jun, 2025 1 commit
- [Feature] Integrate new deepgemm (#19820) · c6e3bba8
  Wentao Ye authored Jun 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c6e3bba8
10 Jun, 2025 1 commit
- [Bugfix] Fix benchmark_moe.py (#19016) · 4589b940
  Tianyu Guo authored Jun 10, 2025
```
Signed-off-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn>
```
  4589b940
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
13 May, 2025 1 commit
- Convert `benchmarks` to `ruff format` (#18068) · 009d9e75
  Harry Mellor authored May 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  009d9e75
08 May, 2025 1 commit
- [Misc] support model prefix & add deepseek vl2 tiny fused moe config (#17763) · 0a9bbaa1
  xsank authored May 08, 2025
```
Signed-off-by: 唯勤 <xsank.mz@alibaba-inc.com>
Co-authored-by: 唯勤 <xsank.mz@alibaba-inc.com>
```
  0a9bbaa1
06 May, 2025 1 commit
- [Bugfix] Fix triton import with local TritonPlaceholder (#17446) · f9bc5a06
  Mengqing Cao authored May 06, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  f9bc5a06
02 May, 2025 2 commits
- [Hardware][AMD] Improve OAM device ID + llama4 Maverick MOE tuning (#16263) · 9352cdb5
  Xiaodong Wang authored May 02, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
Co-authored-by: Lu Fang <lufang@fb.com>
```
  9352cdb5
- permute/unpermute kernel for moe optimization (#14568) · 3e887d2e
  Caleb_Du authored May 03, 2025
```
Signed-off-by: Caleb_Du <Caleb_Du@zju.edu.cn>
```
  3e887d2e
28 Apr, 2025 2 commits
- [Model] Add tuned triton fused_moe configs for Qwen3Moe (#17328) · ba41cc90
  Michael Goin authored Apr 28, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  ba41cc90
- [Model] Add tuned triton fused_moe configs for Qwen3Moe (#17328) · 8fc88d63
  Michael Goin authored Apr 28, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  8fc88d63
25 Apr, 2025 1 commit
- Use Transformers helper `get_text_config()` instead of checking for `text_config` (#17105) · 423e9f1c
  Harry Mellor authored Apr 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  423e9f1c
07 Apr, 2025 1 commit

Upstream Llama4 Support to Main (#16113) · 55dcce91

Lu Fang authored Apr 07, 2025


Signed-off-by: Aston Zhang <22279212+astonzhang@users.noreply.github.com>
Signed-off-by: Chris Thi <chris.c.thi@gmail.com>
Signed-off-by: drisspg <drisspguessous@gmail.com>
Signed-off-by: Jon Swenson <jmswen@gmail.com>
Signed-off-by: Keyun Tong <tongkeyun@gmail.com>
Signed-off-by: Lu Fang <fanglu@meta.com>
Signed-off-by: Xiaodong Wang <xdwang@meta.com>
Signed-off-by: Yang Chen <yangche@fb.com>
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
Signed-off-by: Lu Fang <lufang@fb.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

55dcce91

06 Apr, 2025 1 commit
- [Model] Support Llama4 in vLLM (#16104) · c5752323
  Lu Fang authored Apr 05, 2025
  
  c5752323
01 Apr, 2025 2 commits
- Add option to use DeepGemm contiguous grouped gemm kernel for fused MoE operations. (#13932) · e59ca942
  bnellnm authored Apr 01, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  e59ca942
- 去掉自研专家并行代码 · 9beadbfb
  王敏 authored Apr 01, 2025
  
  9beadbfb
13 Mar, 2025 1 commit
- [Bugfix] fix benchmark moe (#14653) · a73122de
  Jee Jee Li authored Mar 13, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a73122de
11 Mar, 2025 2 commits
- dynamic distpatch of fp8 kernels (#14245) · a1c8f379
  Jeff Daily authored Mar 11, 2025
```
Signed-off-by: Jeff Daily <jeff.daily@amd.com>
```
  a1c8f379
- [feat]优化fused_moe tuning，上传K100_AI的configs · e3a0d6bb
  zhuwenwen authored Mar 11, 2025
  
  e3a0d6bb
07 Mar, 2025 1 commit
- [Bugfix] Correctly call `cudaProfilerStop` in benchmarks script (#14183) · c34eeec5
  Brayden Zhong authored Mar 06, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  c34eeec5
05 Mar, 2025 1 commit
- [Misc] Add Qwen2MoeForCausalLM moe tuning support (#14276) · 7bab4bb0
  Jee Jee Li authored Mar 05, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7bab4bb0
04 Mar, 2025 2 commits
- Fix benchmark_moe.py tuning for CUDA devices (#14164) · f78c0be8
  Michael Goin authored Mar 04, 2025
  
  f78c0be8
- [core] moe fp8 block quant tuning support (#14068) · bb5b6403
  Divakar Verma authored Mar 03, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  bb5b6403
03 Mar, 2025 1 commit
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8
24 Feb, 2025 1 commit
- Expert Parallelism (EP) Support for DeepSeek V2 (#12583) · 781096e3
  Jongseok Park authored Feb 24, 2025
  
  781096e3
18 Feb, 2025 1 commit
- [fix]修复0.7.2版本benchmark_moe因新增rocm参数报错问题 · 7581e4cb
  王敏 authored Feb 18, 2025
  
  7581e4cb
12 Feb, 2025 1 commit
- 优化benchmark moe · a3dec59c
  王敏 authored Feb 12, 2025
  
  a3dec59c
11 Feb, 2025 2 commits
- 添加ep moe tuning · 10213be4
  王敏 authored Feb 11, 2025
  
  10213be4
- [feat]添加ep moe功能 · d0dafaf4
  王敏 authored Feb 11, 2025
  
  d0dafaf4