Commits · a071dc4084ea08aea1ab2fe96baace67b5f29b5f · zhaoyu6 / sglang

21 May, 2025 1 commit
- aiter attention-backend (default enabled on AMD/ROCm) (#6381) · 5c0b38f3
  HAI authored May 20, 2025
  
  5c0b38f3
20 May, 2025 2 commits
- Support dispatching logical to physical experts (#6385) · e98afbe0
  fzyzcjy authored May 20, 2025
  
  e98afbe0
- Expert distribution recording without overhead for EPLB (#4957) · f0653886
  fzyzcjy authored May 20, 2025
  
  f0653886
18 May, 2025 4 commits
- [Misc] Implement RankZeroFilter for rank-specific logging in model_runner.py (#6333) · ebe58d54
  Chang Su authored May 18, 2025
  
  ebe58d54
- refactor: minor refactors regarding multimodal processing (#6187) · 01dd39ba
  Mick authored May 18, 2025
  
  01dd39ba
- Reland tiny refactor DefaultModelLoader.Source (#6041) · 73187152
  fzyzcjy authored May 18, 2025
  
  73187152
- Support custom DeepEP tuning config (#6257) · fd08c048
  fzyzcjy authored May 18, 2025
  
  fd08c048
17 May, 2025 1 commit
- Use monotonic clock for interval measurement (#6211) · 3cf1473a
  Lifu Huang authored May 17, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  3cf1473a
15 May, 2025 1 commit
- [fix][RL] Remove the incorrect barrier in init_weights_update_group (#5914) · 44a3783d
  Zilin Zhu authored May 15, 2025
  
  44a3783d
13 May, 2025 1 commit

Fix two issues related to `--moe-dense-tp-size=1` (#5657) · b2e95f62

Cheng Wan authored May 13, 2025


Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
Co-authored-by: 颉沆 <xiehang.lsy@alibaba-inc.com>

b2e95f62

12 May, 2025 4 commits
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd
- [PP] Fix init_memory_pool desync & add PP for mixtral (#6223) · bad7c26f
  Ying Sheng authored May 12, 2025
  
  bad7c26f
- fix some typos (#6209) · d738ab52
  applesaucethebun authored May 12, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  d738ab52
- Log if cuda graph is used & extend cuda graph capture to cuda-graph-max-bs (#6201) · fba8eccd
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  fba8eccd
10 May, 2025 1 commit
- Revert "feat: add thinking_budget (#6089)" (#6181) · 66fc63d6
  Yineng Zhang authored May 10, 2025
  
  66fc63d6
09 May, 2025 1 commit
- feat: add thinking_budget (#6089) · 63484f9f
  thyecust authored May 09, 2025
  
  63484f9f
08 May, 2025 3 commits
- [Feature] Add FlashAttention3 as a backend for VisionAttention (#5764) · fa7d7fd9
  Zhu Chen authored May 09, 2025
```
Co-authored-by: othame <chenzhu_912@zju.edu.cn>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>
```
  fa7d7fd9
- Tiny refactor weight loading logic (#5232) · 6450c122
  fzyzcjy authored May 08, 2025
  
  6450c122
- Clean logs for DeepSeek-V3 launching (#6079) · 73600673
  Baizhou Zhang authored May 07, 2025
  
  73600673
07 May, 2025 1 commit

[Feature] Support for Ascend NPU backend (#3853) · 00c2c1f0

Song Zhang authored May 07, 2025


Signed-off-by: Song Zhang <gepin.zs@antgroup.com>
Co-authored-by: 22dimensions <waitingwind@foxmail.com>

00c2c1f0

01 May, 2025 2 commits
- fix: update model runner (#5934) · 8441baad
  Yineng Zhang authored Apr 30, 2025
  
  8441baad
- [PP] Add pipeline parallelism (#5724) · 11383cec
  Ying Sheng authored Apr 30, 2025
  
  11383cec
30 Apr, 2025 1 commit
- chore: upgrade sgl-kernel 0.1.1 (#5933) · 9a6ad891
  Yineng Zhang authored Apr 30, 2025
  
  9a6ad891
29 Apr, 2025 1 commit
- Auto set draft model path for MTP (#5793) · dd408ee4
  Ke Bao authored Apr 30, 2025
  
  dd408ee4
28 Apr, 2025 4 commits
- [CI] test chunked prefill more (#5798) · 849c83a0
  Lianmin Zheng authored Apr 28, 2025
  
  849c83a0
- Revert "Tiny refactor DefaultModelLoader.Source" (#5825) · 693723d1
  Lianmin Zheng authored Apr 28, 2025
  
  693723d1
- Tiny refactor DefaultModelLoader.Source (#5482) · 644ed409
  fzyzcjy authored Apr 28, 2025
  
  644ed409
- Add Cutlass MLA attention backend (#5390) · 84810da4
  Trevor Morris authored Apr 27, 2025
  
  84810da4
27 Apr, 2025 1 commit
- [CI] Fix ci tests (#5769) · 621e96bf
  Lianmin Zheng authored Apr 27, 2025
  
  621e96bf
25 Apr, 2025 1 commit
- Disable flaky eagle tests (#5753) · 21514ff5
  Lianmin Zheng authored Apr 25, 2025
  
  21514ff5
24 Apr, 2025 1 commit
- vlm: enable radix cache for qwen-vl models (#5349) · c998d04b
  Mick authored Apr 24, 2025
```
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
```
  c998d04b
21 Apr, 2025 2 commits
- [feature] enable pre compile jit deep_gemm (#5580) · c2942907
  JieXin Liang authored Apr 22, 2025
  
  c2942907
- Add Speculative Decoding Eagle3 topk > 1 (#5318) · 188f0955
  Qingquan Song authored Apr 20, 2025
```
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
Co-authored-by: Yubo Wang <yubowang2019@gmail.com>
```
  188f0955
20 Apr, 2025 1 commit
- [Fix] fix outlines and xgrammar (#4947) · bca832c7
  JieXin Liang authored Apr 21, 2025
  
  bca832c7
19 Apr, 2025 1 commit
- simplify the control logic for using shared experts fusion (#5504) · d58e3544
  Xiaoyu Zhang authored Apr 20, 2025
  
  d58e3544
18 Apr, 2025 2 commits
- Introduce moe_dense_tp_size to fix dense layer errors in DeepSeek V3 + 4x8xH100 (#4836) · 53dcf388
  fzyzcjy authored Apr 18, 2025
  
  53dcf388
- Fix: fix the exception 'the memory capacity is unbalanced. Some GPUs … (#5426) · 27e9538a
  mlmz authored Apr 18, 2025
```
Co-authored-by: ocss884 <ocss.lin@gmail.com>
```
  27e9538a
17 Apr, 2025 2 commits
- Deprecate enable-flashinfer-mla and enable-flashmla (#5480) · 6fb29ffd
  Baizhou Zhang authored Apr 17, 2025
  
  6fb29ffd
- Deprecate disable-mla (#5481) · 4fb05583
  Baizhou Zhang authored Apr 17, 2025
  
  4fb05583
16 Apr, 2025 1 commit
- Clean up imports (#5467) · 177320a5
  Lianmin Zheng authored Apr 16, 2025
  
  177320a5