Commits · 3a6e8b6d78d8d33b5c241b4d95f531ac20e31964 · zhaoyu6 / sglang

10 Sep, 2024 2 commits
- [Minor] move triton attention kernels into a separate folder (#1379) · 3a6e8b6d
  Lianmin Zheng authored Sep 10, 2024
  
  3a6e8b6d
- Support MiniCPM3 (#1371) · e72275cf
  William authored Sep 10, 2024
  
  e72275cf
09 Sep, 2024 1 commit
- [triton] Support head_dim not 2^n in triton extend and decode attention (#1281) · 8e6bdf85
  Byron Hsu authored Sep 09, 2024
  
  8e6bdf85
24 Aug, 2024 1 commit
- Cleanup readme, llava examples, usage examples and nccl init (#1194) · f6af3a65
  Lianmin Zheng authored Aug 24, 2024
  
  f6af3a65
19 Aug, 2024 1 commit
- Optimize MLA/GQA/MQA Triton decoding (#1138) · df191254
  Ke Bao authored Aug 19, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  df191254
12 Aug, 2024 1 commit
- Clean up the comments and names under python/sglang/srt/layers (#1047) · fb1f28cb
  Lianmin Zheng authored Aug 11, 2024
  
  fb1f28cb
04 Aug, 2024 1 commit
- Support MLA for DeepSeek-V2 with Triton - step 1 (#905) · e1eae1fd
  Ke Bao authored Aug 05, 2024
  
  e1eae1fd
30 Jul, 2024 1 commit
- Code structure refactor (#807) · cdcbde5f
  Liangsheng Yin authored Jul 29, 2024
  
  cdcbde5f
28 Jul, 2024 2 commits
- chore: add copyright for srt (#790) · dd7e8b94
  Yineng Zhang authored Jul 28, 2024
  
  dd7e8b94
- Allow disabling flashinfer sampling kernel (#778) · 752e6430
  Lianmin Zheng authored Jul 27, 2024
  
  752e6430
19 Jul, 2024 1 commit
- Remove cached triton launcher (#656) · e1792cca
  Lianmin Zheng authored Jul 18, 2024
  
  e1792cca
17 Jul, 2024 1 commit
- Move `global_server_args_dict` (#642) · abd5385a
  Liangsheng Yin authored Jul 17, 2024
  
  abd5385a
13 Jul, 2024 1 commit
- Cleanup attention backend: flashinfer and triton (#611) · 396a6924
  Lianmin Zheng authored Jul 12, 2024
  
  396a6924
12 Jul, 2024 1 commit
- Clean up the usage of flashinfer (#610) · af4e7910
  Lianmin Zheng authored Jul 12, 2024
  
  af4e7910
05 Jul, 2024 1 commit
- Add Gemma2 (#592) · 5a57b8ad
  Ying Sheng authored Jul 05, 2024
  
  5a57b8ad
28 May, 2024 1 commit

Support data parallelism (static) (#480) · 0463f7fb

Ying Sheng authored May 27, 2024


Co-authored-by: Ying Sheng <ying.sheng@databricks.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

0463f7fb

24 May, 2024 1 commit
- Improve logging & add logit cap (#471) · 2cea6146
  Lianmin Zheng authored May 24, 2024
  
  2cea6146
22 Apr, 2024 1 commit
- add `.isort.cfg` (#378) · 9acc6e35
  Liangsheng Yin authored Apr 22, 2024
  
  9acc6e35
11 Mar, 2024 4 commits
- Update version to v0.1.13 (#280) · 4aa5dd2c
  Lianmin Zheng authored Mar 11, 2024
  
  4aa5dd2c
- Organize `server_args` (#277) · 1b355479
  Liangsheng Yin authored Mar 11, 2024
  
  1b355479
- Improve gemma and documentations (#278) · faba293a
  Lianmin Zheng authored Mar 11, 2024
  
  faba293a
- Gemma Support (#256) · 89885b31
  Liangsheng Yin authored Mar 11, 2024
  
  89885b31
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081