Commits · fa7d7fd9e5eccd388c0a2ce3fcb07691425d2260 · change / sglang · GitLab

08 May, 2025 2 commits
- [Feature] Add FlashAttention3 as a backend for VisionAttention (#5764) · fa7d7fd9
  Zhu Chen authored May 09, 2025
```
Co-authored-by: othame <chenzhu_912@zju.edu.cn>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>
```
  fa7d7fd9
- Update doc for MLA attention backends (#6034) · 8f508cc7
  Baizhou Zhang authored May 07, 2025
  
  8f508cc7
07 May, 2025 1 commit
- [Doc]Fix description for dp_size argument (#6063) · fee37d9e
  Baizhou Zhang authored May 07, 2025
  
  fee37d9e
05 May, 2025 3 commits
- feat: append more comprehensive fields in messages instead of merely role and content (#5996) · a68ed766
  mlmz authored May 06, 2025
  
  a68ed766
- Fix "Avoid computing lse in Ragged Prefill when there's no prefix match" (#5555) · 22da3d97
  Wenxuan Tan authored May 05, 2025
  
  22da3d97
- Update dev container config to support live code sync and improve docker setup guide (#6018) · 1232f7e8
  Lifu Huang authored May 04, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  1232f7e8
04 May, 2025 1 commit
- Tool Call: Add `chat_template_kwargs` documentation (#5679) · 95c231e5
  vzed authored May 04, 2025
  
  95c231e5
02 May, 2025 2 commits
- Remove token in token out in Native API (#5967) · 73dcf2b3
  Chayenne authored May 01, 2025
  
  73dcf2b3
- feat: Refactor DeepSeekV3 function call (#5908) · 170d1f21
  Chang Su authored May 01, 2025
  
  170d1f21
01 May, 2025 3 commits
- docs: Fix Qwen model typo (#5944) · ad506a4e
  江家瑋 authored May 02, 2025
```
Signed-off-by: JiangJiaWei1103 <waynechuang97@gmail.com>
```
  ad506a4e
- Update ci test and doc for MTP api change (#5952) · ebaba856
  Ke Bao authored May 02, 2025
  
  ebaba856
- chore: bump v0.4.6.post2 (#5939) · 9858113c
  Yineng Zhang authored Apr 30, 2025
  
  9858113c
30 Apr, 2025 3 commits
- [Feature] add support kimi vl model (#5383) · 8fefdd32
  liwenju0 authored Apr 30, 2025
```
Co-authored-by: wenju.li <wenju.li@deepctr.cn>
```
  8fefdd32
- Bump Flashinfer to 0.2.5 (#5870) · 799789af
  Baizhou Zhang authored Apr 29, 2025
```
Co-authored-by: Yuhao Chen <yxckeis8@gmail.com>
```
  799789af
- feat: support pythonic tool call and index in tool call streaming (#5725) · 2b06484b
  Chang Su authored Apr 29, 2025
  
  2b06484b
29 Apr, 2025 3 commits
- [Doc] Tables instead of bulletpoints for sampling doc (#5841) · ae523675
  simveit authored Apr 29, 2025
  
  ae523675
- [Docs] Update docs for Qwen3 and Qwen3MoE (#5836) · 5c08aa49
  Adarsh Shirawalmath authored Apr 30, 2025
  
  5c08aa49
- Feat: support cuda graph for LoRA (#4115) · 8c0cfca8
  Qiaolin Yu authored Apr 29, 2025
```
Co-authored-by: Beichen Ma <mabeichen12@gmail.com>
```
  8c0cfca8
28 Apr, 2025 5 commits
- chore: bump v0.4.6.post1 (#5845) · dcae1fb2
  Yineng Zhang authored Apr 28, 2025
  
  dcae1fb2
- [CI] test chunked prefill more (#5798) · 849c83a0
  Lianmin Zheng authored Apr 28, 2025
  
  849c83a0
- [Doc] Recover history of server_arguments.md (#5851) · f48b007c
  Baizhou Zhang authored Apr 28, 2025
  
  f48b007c
- [Docs] Replace lists with tables for cleanup and readability in server_arguments (#5276) · 966eb908
  Michael Yao authored Apr 28, 2025
  
  966eb908
- Add Cutlass MLA attention backend (#5390) · 84810da4
  Trevor Morris authored Apr 27, 2025
  
  84810da4
27 Apr, 2025 4 commits
- [Docs] update grafana setup guide in production metrics (#5643) · 86317c09
  Huapeng Zhou authored Apr 28, 2025
```
Co-authored-by: NoahM <88418672+zhudianGG@users.noreply.github.com>
```
  86317c09
- Release v0.4.6 (#5795) · 84022c0e
  Baizhou Zhang authored Apr 27, 2025
  
  84022c0e
- support for the DeepSeek model by enabling streaming response parsing (#5592) · a21ef363
  Frankey_8080 authored Apr 27, 2025
  
  a21ef363
- [Minor] fix documentations (#5756) · 155890e4
  Lianmin Zheng authored Apr 26, 2025
  
  155890e4
25 Apr, 2025 2 commits
- Revert "[Model] Support `ArcticForCausalLM` architecture... · 5641a094
  Lianmin Zheng authored Apr 25, 2025
```
Revert "[Model] Support `ArcticForCausalLM` architecture (Snowflake/snowflake-arctic-instruct)" (#5754)
```
  5641a094
- [Model] Support `ArcticForCausalLM` architecture (Snowflake/snowflake-arctic-instruct) (#5078) · 43fb95c2
  Brayden Zhong authored Apr 25, 2025
```
Co-authored-by: vincent-4 <vincentzhongy+githubvincent4@gmail.com>
```
  43fb95c2
24 Apr, 2025 1 commit
- [Doc] Fix a link to Weilin Zhao (#5706) · b5be5694
  Michael Yao authored Apr 25, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  b5be5694
23 Apr, 2025 1 commit
- [Doc] Fix two 404 links caused by sglang typo (#5667) · 7c99103f
  Michael Yao authored Apr 23, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  7c99103f
22 Apr, 2025 3 commits
- Turn on DeepGemm By Default and Update Doc (#5628) · ce5412b6
  Baizhou Zhang authored Apr 22, 2025
  
  ce5412b6
- [Doc] Fix a 404 link to llama-405b (#5615) · 92bb64bc
  Michael Yao authored Apr 22, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  92bb64bc
- chore: bump v0.4.5.post3 (#5611) · b9c87e78
  Yineng Zhang authored Apr 21, 2025
  
  b9c87e78
21 Apr, 2025 4 commits
- [Feat.] Enable grafana to show metrics (#4718) · 57131dd9
  Huapeng Zhou authored Apr 21, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  57131dd9
- smaller and non gated models for docs (#5378) · 8de53da9
  simveit authored Apr 21, 2025
  
  8de53da9
- add function call parser for DeepSeek V3 (#5224) · fac17acf
  Yi Zhou authored Apr 21, 2025
  
  fac17acf
- [Feature] Prefill assistant response - add continue_final_message parameter (#4226) · 8b39274e
  Adarsh Shirawalmath authored Apr 21, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  8b39274e
20 Apr, 2025 2 commits
- [Feat] upgrade pytorch2.6 (#5417) · 417b44eb
  lukec authored Apr 21, 2025
  
  417b44eb
- Add document for LoRA serving (#5521) · 072b4d03
  Baizhou Zhang authored Apr 20, 2025
  
  072b4d03