Commits · 13feffd0827d9dc1ea4be8e3935ec32d2ba9899d · zhaoyu6 / sglang

20 May, 2025 3 commits
- Fix master CI for DeepSeek (#6447) · 13feffd0
  fzyzcjy authored May 20, 2025
  
  13feffd0
- Support dispatching logical to physical experts (#6385) · e98afbe0
  fzyzcjy authored May 20, 2025
  
  e98afbe0
- Support loading weights when physical experts are different from logical experts (#6386) · c471d39e
  fzyzcjy authored May 20, 2025
  
  c471d39e
17 May, 2025 1 commit
- Minor code cleanup refactor for DeepSeek models (#6324) · 2df9d40a
  fzyzcjy authored May 17, 2025
  
  2df9d40a
15 May, 2025 1 commit
- Reduce MoE memory usage (#6147) · f194e14f
  fzyzcjy authored May 16, 2025
  
  f194e14f
11 May, 2025 1 commit
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
08 May, 2025 1 commit

DeepEP normal support deepgemm-contiguous (#5626) · acc816d8

lukec authored May 08, 2025


Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Xuting Zhou <xutingz@nvidia.com>
Co-authored-by: ZhengHSI <zhenghsi@qq.com>

acc816d8

20 Apr, 2025 1 commit
- Fix DeepEP cannot run on latest master (#5567) · 463d4b74
  fzyzcjy authored Apr 21, 2025
  
  463d4b74
19 Apr, 2025 2 commits
- simplify the control logic for using shared experts fusion (#5504) · d58e3544
  Xiaoyu Zhang authored Apr 20, 2025
  
  d58e3544
- Fix DeepGEMM masked cannot be run on groups not being multiple or 4 (#5340) · 1e0806f3
  fzyzcjy authored Apr 19, 2025
  
  1e0806f3
16 Apr, 2025 1 commit
- Clean up imports (#5467) · 177320a5
  Lianmin Zheng authored Apr 16, 2025
  
  177320a5
03 Apr, 2025 1 commit
- Small refactor DeepEPMode to clean up code a bit (#4992) · 8e10fec9
  fzyzcjy authored Apr 03, 2025
  
  8e10fec9
01 Apr, 2025 1 commit

[Feature] Support DeepEP Low Latency (#4767) · 23c764b1

Jinyan Chen authored Apr 02, 2025


Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
Co-authored-by: ch-wan <cwan39@gatech.edu>

23c764b1

22 Mar, 2025 1 commit
- Optimize Permute Kernel in DeepEP (#4643) · c2bd094d
  xutizhou authored Mar 23, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  c2bd094d
19 Mar, 2025 1 commit

[Feature] Integrate DeepEP into SGLang (#4232) · f44db16c

Jinyan Chen authored Mar 19, 2025


Co-authored-by: Cheng Wan <cwan39@gatech.edu>
Co-authored-by: Xuting Zhou <xutingz@nvidia.com>

f44db16c

14 Mar, 2025 1 commit
- cleanup deps 1/n (#4400) · 977d7cd2
  Yineng Zhang authored Mar 14, 2025
```
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
```
  977d7cd2
12 Mar, 2025 2 commits
- Remove vllm ops scaled fp8 quant and accelerate per token quant by 20-28% (#4215) · e0917e6b
  Stefan He authored Mar 12, 2025
```
Co-authored-by: Stefan He <bhe@linkedin.com>
```
  e0917e6b
- unify is_cuda and is_hip (#4321) · d1da58e2
  Yineng Zhang authored Mar 11, 2025
  
  d1da58e2
03 Mar, 2025 2 commits

Improve code styles (#4021) · 66301e12
Lianmin Zheng authored Mar 03, 2025

66301e12

Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727

Lianmin Zheng authored Mar 03, 2025


Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

ac238727

26 Feb, 2025 1 commit

Expert Parallelism (EP) Support for DeepSeek V3/R1 (#3602) · 21463e32

lukec authored Feb 26, 2025


Co-authored-by: laixin <xielx@shanghaitech.edu.cn>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: laixin <q865809639@gmail.com>

21463e32

01 Feb, 2025 1 commit
- update and simplify CustomOp (#3249) · 4eb4b401
  Yineng Zhang authored Feb 01, 2025
  
  4eb4b401
27 Jan, 2025 2 commits
- Improve weight loading and code style (#3174) · 53cef815
  Lianmin Zheng authored Jan 27, 2025
  
  53cef815
- Add activation parameters to fused_moe (#3170) · 52c03f16
  Lianmin Zheng authored Jan 27, 2025
  
  52c03f16
17 Jan, 2025 2 commits
- cleanup models dependencies 1/n (#2948) · 033c715b
  Yineng Zhang authored Jan 17, 2025
  
  033c715b
- feat: remove vllm distributed (#2907) · 5dc54f1a
  Yineng Zhang authored Jan 17, 2025
```
Co-authored-by: Zhangyi <1109276519@qq.com>
```
  5dc54f1a
23 Dec, 2024 1 commit
- Reorg moe code (#2563) · e835a500
  Ke Bao authored Dec 24, 2024
  
  e835a500
16 Dec, 2024 1 commit
- fix moe-ep accuracy issue for fp8 (#2489) · b532a5fd
  xiaobochen authored Dec 16, 2024
  
  b532a5fd
06 Dec, 2024 1 commit
- Resubmit MoE-EP (#2371) · 3d32e4a3
  xiaobochen authored Dec 06, 2024
  
  3d32e4a3