Commits · 4ddb544712330512ef9fd8a4320dd980e806819d · OpenDAS / vllm_cscc · GitLab

23 Jun, 2025 1 commit
- fix moe run error · 10184690
  zhuwenwen authored Jun 23, 2025
  
  10184690
21 Jun, 2025 3 commits
- support ndhwc of qwen2-vl and qwen2.5-vl · 5f71c3f8
  zhuwenwen authored Jun 21, 2025
  
  5f71c3f8
- 添加moe smquant量化支持模块 · 7996b363
  zhuwenwen authored Jun 21, 2025
  
  7996b363
- skip is_rocm_aiter_moe_enabled and remove qwen unused int8 code · bbd14169
  zhuwenwen authored Jun 21, 2025
  
  bbd14169
18 Jun, 2025 1 commit
- 暂时去掉fused_moe中量化kernel的bug修复 · 35dbdc41
  王敏 authored Jun 18, 2025
  
  35dbdc41
17 Jun, 2025 2 commits
- [fix]1.修复medusa、scorer等并行解码单测；2.修复moe... · 8db76782
  王敏 authored Jun 17, 2025
```
[fix]1.修复medusa、scorer等并行解码单测；2.修复moe kernel单测问题，优化代码；3.修复rejection_sampler中test_compare_nonflashinfer_backend单测问题
```
  8db76782
- 修复int4选取config的bug · 44e87dde
  yangql authored Jun 17, 2025
  
  44e87dde
16 Jun, 2025 1 commit
- 分离fuse moe awq算子到lmslim上 · b3312eec
  yangql authored Jun 16, 2025
  
  b3312eec
13 Jun, 2025 4 commits
- 增加fused_experts_impl_int8的接入 · 483acdc4
  xuxz authored Jun 13, 2025
  
  483acdc4
- [fix]修复并行解码eagle和mlp相关单测问题 · 08cb5d8f
  王敏 authored Jun 13, 2025
  
  08cb5d8f
- 解耦w8a8 的gemm以及moe算子相关实现 · 942368c7
  gaoqiong authored Jun 13, 2025
  
  942368c7
- [New Model]: Support Qwen3 Embedding & Reranker · 9bcbaafc
  zhuwenwen authored Jun 13, 2025
  
  9bcbaafc
12 Jun, 2025 4 commits
- add bw qwen3 moe configs · 2f6f5bb3
  zhuwenwen authored Jun 12, 2025
  
  2f6f5bb3
- 修复qwen3-moe的awq配置导致fp16加载错误，修复dpsk-moe手写算子首字耗时增加问题 · 99ffef47
  zhuwenwen authored Jun 12, 2025
  
  99ffef47
- Update int8_utils.py · 550a1e5e
  zhuwenwen authored Jun 12, 2025
  
  550a1e5e
- update qwen2&2.5-vl prefill interface and fix pixtral run error · 4fd5389b
  zhuwenwen authored Jun 12, 2025
  
  4fd5389b
10 Jun, 2025 2 commits

[Misc] Slight improvement of the BNB (#19418) · b6553be1

Jee Jee Li authored Jun 10, 2025

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

b6553be1

Update qwen3_moe.py · 07c69390
zhuwenwen authored Jun 10, 2025

07c69390

09 Jun, 2025 1 commit
- [Misc] Fixes and Optimizations for DeepEP + DeepGEMM combination. (#19298) · 5cf2daea
  Varun Sundar Rabindranath authored Jun 09, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun <vsundarr@redhat.com>
```
  5cf2daea
08 Jun, 2025 2 commits
- [Quantization] Add compressed-tensors NVFP4 support (#18312) · c123bc33
  Dipika Sikka authored Jun 08, 2025
  
  c123bc33
- Add H20-3e fused MoE kernel tuning configs for Qwen3-235B-A22B (#19315) · 989dcee9
  Xu Wenqing authored Jun 08, 2025
```
Signed-off-by: Xu Wenqing <xuwq1993@qq.com>
```
  989dcee9
07 Jun, 2025 2 commits
- 新增fusemoe手写算子的支持，需要group-gemm包 · e7a963f5
  yangql authored Jun 07, 2025
  
  e7a963f5
- [Kernel] Integrate CUTLASS MoE kernel with PPLX (#18762) · 84166fee
  ElizaWszola authored Jun 07, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  84166fee
06 Jun, 2025 5 commits
- [Model] Optimize nemotron_h implementation (#19249) · 7661e92e
  Jee Jee Li authored Jun 06, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7661e92e
- [Quantization] Bump compressed-tensors version; update NVFP4A16 test model (#19224) · 94870359
  Dipika Sikka authored Jun 06, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
```
  94870359
- [Model] Add VLLM_USE_NN to use nn layout · 6880bf15
  zhuwenwen authored Jun 06, 2025
  
  6880bf15
- [Bugfix] Fix EAGLE vocab embedding construction for Llama 70B (#19033) · 3465b87e
  Benjamin Chislett authored Jun 05, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
  3465b87e
- Fix AOPerModuleConfig name changes (#18869) · c8134bea
  Jerry Zhang authored Jun 05, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  c8134bea
05 Jun, 2025 6 commits
- [Model] NemotronH support (#18863) · cb6d572e
  Luis Vega authored Jun 05, 2025
```
Signed-off-by: Luis Vega <2478335+vegaluisjose@users.noreply.github.com>
Co-authored-by: Luis Vega <2478335+vegaluisjose@users.noreply.github.com>
```
  cb6d572e
- [Hardware][NVIDIA] FP4 MoE kernel optimization (#19110) · 61059bee
  Chiyue Wei authored Jun 05, 2025
```
Signed-off-by: Chiyue Wei <chiyuew@nvidia.com>
Co-authored-by: Chiyue Wei <chiyuew@nvidia.com>
```
  61059bee
- Add H20-3e fused MoE kernel tuning configs for DeepSeek-R1/V3 (#19205) · ec89524f
  Xu Wenqing authored Jun 06, 2025
  
  ec89524f
- 新增qwen3 fusemoe优化支持 · 1cb37dab
  yangql authored Jun 05, 2025
  
  1cb37dab
- Update w8a8_int8.py · 53250530
  gaoqiong authored Jun 05, 2025
  
  53250530
- 修改deepseelk block-int8 权重处理流程，增加per-channel bestconfig配置以及首次triton warmup代码 · 40b94473
  gaoqiong authored Jun 05, 2025
  
  40b94473
04 Jun, 2025 6 commits
- [Kernel] Integrate batched/masked deepgemm kernel (#19111) · c3fd4d66
  Varun Sundar Rabindranath authored Jun 04, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun <vsundarr@redhat.com>
```
  c3fd4d66
- Sm100 blockwise fp8 swap ab (#18564) · 5f2cd251
  Lain authored Jun 04, 2025
  
  5f2cd251
- 修复qwen3-moe-awq的bug问题 · 1a4e4cad
  yangql authored Jun 04, 2025
  
  1a4e4cad
- [CI/Build][Bugfix] Ensure compatibility with transformers 4.52 (#18678) · 01dc9a76
  Cyrus Leung authored Jun 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  01dc9a76
- Improve the output precision of embedding models (#19092) · 35cf32df
  wang.yuqi authored Jun 04, 2025
  
  35cf32df
- [feat]add 120cu nn fused_moe configs of qwen3, mixtral8*7b and mixtral8*22b · d36deb1a
  zhuwenwen authored Jun 04, 2025
  
  d36deb1a