Commits · 94371dbbd6359139cb0a90912838a47a27f61bcc · change / sglang · GitLab

17 Aug, 2025 1 commit

[feature] Ascend NPU graph support (#8027) · 94371dbb

VDV1985 authored Aug 17, 2025


Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: yezhifeng (D) <y00897525@china.huawei.com>
Co-authored-by: anon189Ty <Stari_Falcon@outlook.com>
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>

94371dbb

16 Aug, 2025 1 commit
- Add fp4 quantize before all-gather for Flashinfer cutlass MoE DP (max throughput) (#7667) · eff4eb3f
  Trevor Morris authored Aug 15, 2025
  
  eff4eb3f
09 Aug, 2025 1 commit
- [Feature] Optimize DeepSeek's DeepEP on Ascend NPU (#8355) · 137e75da
  Even Zhou authored Aug 09, 2025
```
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: Hexq0210 <hexq0809521@gmail.com>
```
  137e75da
07 Aug, 2025 1 commit
- [CPU] Fix fallback allgather issue (#8041) · 62f8eb48
  blzheng authored Aug 07, 2025
  
  62f8eb48
01 Aug, 2025 1 commit
- Add support for NCCL symmetric memory for TP allreduces (#8238) · 82e6c3a6
  Nicolas Castet authored Aug 01, 2025
  
  82e6c3a6
31 Jul, 2025 1 commit
- [Feature] Hybrid EP and TP (#8590) · 7a1f7fc5
  Cheng Wan authored Jul 31, 2025
  
  7a1f7fc5
25 Jul, 2025 2 commits
- DP Enhancement (#8280) · c0fb25e9
  Cheng Wan authored Jul 24, 2025
  
  c0fb25e9
- [Feature] Integrate quick allreduce and select the best allreduce implementation (#6619) · 28d4d472
  li haoyang authored Jul 25, 2025
```
Signed-off-by: Haoyang Li <Haoyang.Li@amd.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  28d4d472
18 Jul, 2025 1 commit
- Revert "Fix different device type adjustment in PP" (#8141) · d0510f08
  Sai Enduri authored Jul 18, 2025
  
  d0510f08
16 Jul, 2025 1 commit
- Fix different device type adjustment in PP (#7760) · 3bc43c68
  Qiaolin Yu authored Jul 15, 2025
  
  3bc43c68
14 Jul, 2025 1 commit
- [Feature]TP Group Switching for PD-Multiplexing (#7653) · d4d0c7c3
  ykcombat authored Jul 15, 2025
  
  d4d0c7c3
03 Jul, 2025 2 commits
- feat: use D2D instead of H2H in pp (#7673) · 00991723
  TianyuZhang1214 authored Jul 04, 2025
```
Co-authored-by: alpha-baby <fujianhao1997@qq.com>
```
  00991723
- [CPU] fix all_reduce and all_gather (#6770) · 8f844db6
  Chunyuan WU authored Jul 03, 2025
```
Co-authored-by: blzheng <beilei.zheng@intel.com>
```
  8f844db6
20 Jun, 2025 1 commit
- Fix All-Gather under world size one (#7219) · 8609e637
  Cheng Wan authored Jun 20, 2025
  
  8609e637
05 Jun, 2025 1 commit
- support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277) · 8e3797be
  zyksir authored Jun 05, 2025
  
  8e3797be
27 May, 2025 1 commit
- Add environment flag for disabling message queue broadcaster (#6403) · bdaefbbf
  Baizhou Zhang authored May 26, 2025
  
  bdaefbbf
12 May, 2025 2 commits
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd
- fix some typos (#6209) · d738ab52
  applesaucethebun authored May 12, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  d738ab52
07 May, 2025 1 commit

[Feature] Support for Ascend NPU backend (#3853) · 00c2c1f0

Song Zhang authored May 07, 2025


Signed-off-by: Song Zhang <gepin.zs@antgroup.com>
Co-authored-by: 22dimensions <waitingwind@foxmail.com>

00c2c1f0

27 Apr, 2025 2 commits
- Revert "Use device_id in dist init to reduce NCCL communicator warmup & creation overhead" (#5786) · 9c088829
  Lianmin Zheng authored Apr 27, 2025
  
  9c088829
- Use device_id in dist init to reduce NCCL communicator warmup & creation overhead (#5728) · dfb32264
  Wenxuan Tan authored Apr 26, 2025
  
  dfb32264
28 Mar, 2025 2 commits
- Fix error due to CustomAllreduce setup failure (#4815) · 10a9ab7b
  Kebe authored Mar 28, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  10a9ab7b
- Support (1 <= dp < tp) in the dp attention in DeepEP (#4770) · 7f19e083
  tarinkk authored Mar 27, 2025
```
Co-authored-by: Cheng Wan <cwan39@gatech.edu>
```
  7f19e083
26 Mar, 2025 1 commit
- Support compressed tensors fp8w8a8 (#4743) · 04e3ff69
  Xiaoyu Zhang authored Mar 27, 2025
  
  04e3ff69
18 Mar, 2025 1 commit
- Reduce computation and communication in DP attention (#4521) · 3196999f
  Cheng Wan authored Mar 18, 2025
  
  3196999f
13 Mar, 2025 1 commit
- [Fix] Check the device backend before calling empty_cache function (#4212) · f1cf6eef
  Chen Shengzhi authored Mar 13, 2025
  
  f1cf6eef
02 Mar, 2025 1 commit
- Fix all gather torch compile (#3992) · 00ce7e31
  Ke Bao authored Mar 02, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  00ce7e31
25 Feb, 2025 2 commits
- Fix allgather ops inside cuda graphs (#3709) · 127998cc
  Nicolas Castet authored Feb 25, 2025
  
  127998cc
- [improve] made timeout configurable (#3803) · c0bb9eb3
  Shenggui Li authored Feb 25, 2025
  
  c0bb9eb3
23 Jan, 2025 1 commit
- Revert "disable custom allreduce on HIP" (#3067) · ea535dc5
  Lianmin Zheng authored Jan 22, 2025
  
  ea535dc5
22 Jan, 2025 1 commit
- disable custom allreduce on HIP (#3058) · ddc2001f
  Hui Liu authored Jan 22, 2025
  
  ddc2001f
20 Jan, 2025 1 commit
- Sync distributed package from vllm 0.6.4.post1 (#3010) · 73401fd0
  Lianmin Zheng authored Jan 20, 2025
  
  73401fd0
01 Dec, 2024 1 commit
- adapt vllm distributed module to sglang (#2244) · d5b95cbb
  yizhang2077 authored Dec 01, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  d5b95cbb