Commits · 3f2702ae51cc8bf1d34bbb3896762ad76a174d9f · zhaoyu6 / sglang

11 May, 2025 2 commits
- [CI] Reorganize the 8 gpu tests (#6192) · 03227c5f
  Lianmin Zheng authored May 11, 2025
  
  03227c5f
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
08 May, 2025 1 commit

[Feature] Add FlashAttention3 as a backend for VisionAttention (#5764) · fa7d7fd9

Zhu Chen authored May 09, 2025


Co-authored-by: othame <chenzhu_912@zju.edu.cn>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>

fa7d7fd9

07 May, 2025 2 commits
- Hint users DeepEP normal mode is incompatible with CUDA Graph (#5014) · 4c7b4242
  fzyzcjy authored May 07, 2025
  
  4c7b4242
- [Feature] Support for Ascend NPU backend (#3853) · 00c2c1f0
  Song Zhang authored May 07, 2025
```
Signed-off-by: Song Zhang <gepin.zs@antgroup.com>
Co-authored-by: 22dimensions <waitingwind@foxmail.com>
```
  00c2c1f0
06 May, 2025 1 commit
- Better PD initialization (#5751) · a3e4e9bf
  Liangsheng Yin authored May 07, 2025
  
  a3e4e9bf
05 May, 2025 1 commit
- [PD] Optimize disaggregation ib device help info (#5781) · 56f6589e
  shangmingc authored May 05, 2025
  
  56f6589e
01 May, 2025 2 commits
- Update ci test and doc for MTP api change (#5952) · ebaba856
  Ke Bao authored May 02, 2025
  
  ebaba856
- [PP] Add pipeline parallelism (#5724) · 11383cec
  Ying Sheng authored Apr 30, 2025
  
  11383cec
30 Apr, 2025 2 commits
- feat: support pythonic tool call and index in tool call streaming (#5725) · 2b06484b
  Chang Su authored Apr 29, 2025
  
  2b06484b
- [fix] relax mem_fraction_static for h200 (#5893) · e4b6133b
  JieXin Liang authored Apr 30, 2025
```
Co-authored-by: alcanerian <alcanerian@gmail.com>
```
  e4b6133b
29 Apr, 2025 2 commits
- Auto set draft model path for MTP (#5793) · dd408ee4
  Ke Bao authored Apr 30, 2025
  
  dd408ee4
- Feat: support cuda graph for LoRA (#4115) · 8c0cfca8
  Qiaolin Yu authored Apr 29, 2025
```
Co-authored-by: Beichen Ma <mabeichen12@gmail.com>
```
  8c0cfca8
28 Apr, 2025 2 commits
- [CI] test chunked prefill more (#5798) · 849c83a0
  Lianmin Zheng authored Apr 28, 2025
  
  849c83a0
- Add Cutlass MLA attention backend (#5390) · 84810da4
  Trevor Morris authored Apr 27, 2025
  
  84810da4
27 Apr, 2025 3 commits
- [CI] Fix ci tests (#5769) · 621e96bf
  Lianmin Zheng authored Apr 27, 2025
  
  621e96bf
- Add memory_saver check (#4986) · 7e944246
  Kebe authored Apr 27, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  7e944246
- we fix the non existent access of `decrypted_config_file` (#5685) · df2cf583
  vzed authored Apr 26, 2025
  
  df2cf583
24 Apr, 2025 1 commit
- vlm: enable radix cache for qwen-vl models (#5349) · c998d04b
  Mick authored Apr 24, 2025
```
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
```
  c998d04b
22 Apr, 2025 2 commits
- fix: gemma 3 not use softcap (#5622) · 04f2abcb
  Yineng Zhang authored Apr 22, 2025
  
  04f2abcb
- Clean up mem settings (#5610) · 13432002
  Lianmin Zheng authored Apr 21, 2025
  
  13432002
21 Apr, 2025 9 commits
- Enhance GPU memory settings (#5604) · e69a2190
  Liangsheng Yin authored Apr 22, 2025
  
  e69a2190
- [PD] Support prefill overlap + Ensure no race condition (#5609) · bf98d2e3
  Byron Hsu authored Apr 21, 2025
  
  bf98d2e3
- [PD] Support decode overlap schedule (#5608) · e65b9f21
  Byron Hsu authored Apr 21, 2025
  
  e65b9f21
- [PD] Add NIXL transfer backend (#5477) · 4dce1cc6
  Trevor Morris authored Apr 21, 2025
  
  4dce1cc6
- Tiny remove duplicated code (#5021) · dc86f25a
  fzyzcjy authored Apr 21, 2025
  
  dc86f25a
- upstream hicache fixes (#5570) · 70645f4d
  Zhiqiang Xie authored Apr 20, 2025
  
  70645f4d
- Add Speculative Decoding Eagle3 topk > 1 (#5318) · 188f0955
  Qingquan Song authored Apr 20, 2025
```
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
Co-authored-by: Yubo Wang <yubowang2019@gmail.com>
```
  188f0955
- Perform Batch Tokenization. (#5141) · f0815419
  Sundara Raman Ramachandran authored Apr 20, 2025
  
  f0815419
- add function call parser for DeepSeek V3 (#5224) · fac17acf
  Yi Zhou authored Apr 21, 2025
  
  fac17acf
20 Apr, 2025 1 commit
- [Fix] fix outlines and xgrammar (#4947) · bca832c7
  JieXin Liang authored Apr 21, 2025
  
  bca832c7
19 Apr, 2025 2 commits
- simplify the control logic for using shared experts fusion (#5504) · d58e3544
  Xiaoyu Zhang authored Apr 20, 2025
  
  d58e3544
- [PD] Remove the requirement of config file for mooncake backend (#5460) · dca90f1d
  shangmingc authored Apr 19, 2025
  
  dca90f1d
18 Apr, 2025 1 commit
- Introduce moe_dense_tp_size to fix dense layer errors in DeepSeek V3 + 4x8xH100 (#4836) · 53dcf388
  fzyzcjy authored Apr 18, 2025
  
  53dcf388
17 Apr, 2025 2 commits
- Deprecate enable-flashinfer-mla and enable-flashmla (#5480) · 6fb29ffd
  Baizhou Zhang authored Apr 17, 2025
  
  6fb29ffd
- Deprecate disable-mla (#5481) · 4fb05583
  Baizhou Zhang authored Apr 17, 2025
  
  4fb05583
16 Apr, 2025 2 commits
- Clean up imports (#5467) · 177320a5
  Lianmin Zheng authored Apr 16, 2025
  
  177320a5
- Support MHA with chunked prefix cache for DeepSeek chunked prefill (#5113) · a42736bb
  Baizhou Zhang authored Apr 15, 2025
  
  a42736bb
13 Apr, 2025 1 commit
- [PD] Add transfer backend abstraction (#5328) · a9499885
  Byron Hsu authored Apr 13, 2025
  
  a9499885
12 Apr, 2025 1 commit
- [VLM] Adopt fast image processor by default (#5065) · 34ef6c81
  Mick authored Apr 12, 2025
  
  34ef6c81