Commits · f04c80dc42beee26851cb03a2b49fa3cca876607 · change / sglang

07 Apr, 2025 1 commit

Chang Su authored Apr 07, 2025


Co-authored-by: Cheng Wan <cwan39@gatech.edu>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: ispobock <ispobaoke@163.com>

f04c80dc

05 Apr, 2025 1 commit
- [Revision] Replace enable_flashinfer_mla argument with attention_backend (#5052) · efbae697
  Baizhou Zhang authored Apr 05, 2025
  
  efbae697
03 Apr, 2025 2 commits
- Revert "Replace enable_flashinfer_mla argument with attention_backend" (#5048) · 74885a84
  Lianmin Zheng authored Apr 03, 2025
  
  74885a84
- Replace enable_flashinfer_mla argument with attention_backend (#5005) · e8999b13
  Baizhou Zhang authored Apr 03, 2025
  
  e8999b13
29 Mar, 2025 1 commit
- Tiny fix doc error (#4795) · 736502d4
  fzyzcjy authored Mar 29, 2025
  
  736502d4
27 Mar, 2025 3 commits
- Update doc for DeepSeek-V3-0324 (#4825) · b3953258
  Ke Bao authored Mar 28, 2025
  
  b3953258
- support clip embedding model (#4506) · c913ed40
  uylnap authored Mar 27, 2025
  
  c913ed40
- Update supported_models.md: adding open-r1 Olympic Code 32B by HuggingFace (#4628) · 44f47d3e
  Didier Durand authored Mar 27, 2025
  
  44f47d3e
25 Mar, 2025 2 commits
- model: Minicpmo (#3023) · 1e86457c
  Mick authored Mar 25, 2025
  
  1e86457c
- [Model] Support Qwen2ForSequenceClassification (#4609) · 22c3702e
  Ximingwang-09 authored Mar 25, 2025
```
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  22c3702e
22 Mar, 2025 1 commit
- [Docs] Update docs for gemma3 and VLM chat templates (#4674) · fb888603
  Adarsh Shirawalmath authored Mar 22, 2025
  
  fb888603
21 Mar, 2025 1 commit
- [docs] Add links and fix grammars in deploy_on_k8s.md (#4641) · c6ec7029
  Michael Yao authored Mar 21, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  c6ec7029
20 Mar, 2025 1 commit
- Update doc for MTP and DP attention (#4622) · bfb03c61
  Ke Bao authored Mar 21, 2025
  
  bfb03c61
18 Mar, 2025 1 commit
- Fix the incorrect args in benchmark_and_profiling.md (#4542) · 2d004512
  Albert authored Mar 18, 2025
```
Signed-off-by: Tianyu Zhou <albert.zty@antgroup.com>
```
  2d004512
17 Mar, 2025 3 commits
- Support serving DeepSeek-R1-Channel-INT8 with 32 L40S. (#4418) · 75b65648
  Wenbo Yang authored Mar 17, 2025
  
  75b65648
- [Feature] Support Deepseek-VL2 (#2798) · d6d21640
  萝卜菜 authored Mar 17, 2025
```
Co-authored-by: Edenzzzz <wtan45@wisc.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>
```
  d6d21640
- Urgent model support: support gemma-3-it (#4424) · 9d02bb3e
  Mick authored Mar 17, 2025
  
  9d02bb3e
15 Mar, 2025 1 commit
- docs: Add Llama 3.3 to supported models (#4453) · 26c372c1
  江家瑋 authored Mar 16, 2025
```
Signed-off-by: JiangJiaWei1103 <waynechuang97@gmail.com>
```
  26c372c1
14 Mar, 2025 1 commit
- [Doc] fix wrong flag in deepseek documentation (#4427) · 660305c3
  Zhan Lu authored Mar 14, 2025
  
  660305c3
12 Mar, 2025 2 commits
- model: Support Janus-pro (#3203) · 01090e8a
  Mick authored Mar 13, 2025
  
  01090e8a
- [Docs] Clean up benchmark_and_profiling.md (#4297) · 8f1f614e
  Michael Yao authored Mar 12, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  8f1f614e
11 Mar, 2025 1 commit
- Update MTP doc (#4290) · 3a08f546
  Ke Bao authored Mar 11, 2025
  
  3a08f546
09 Mar, 2025 2 commits
- Support nextn for flashinfer mla attention backend (#4218) · 9fb48f95
  Baizhou Zhang authored Mar 09, 2025
  
  9fb48f95
- [docs] Unhide production metrics page (#4193) · dceb256f
  Stefan He authored Mar 08, 2025
  
  dceb256f
07 Mar, 2025 4 commits
- [Docs] Improve bullets appearance and grammar (#4174) · c827c671
  Michael Yao authored Mar 07, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  c827c671
- fix int8 doc link (#4179) · b55a621f
  Yineng Zhang authored Mar 07, 2025
  
  b55a621f
- Add an example of using deepseekv3 int8 sglang. (#4177) · ffa1b3e3
  lukec authored Mar 07, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  ffa1b3e3
- Add Support for Qwen2-VL Multi-modal Embedding Models (#3694) · 361971b8
  uylnap authored Mar 07, 2025
  
  361971b8
06 Mar, 2025 3 commits
- Docs: add torch compile cache (#4151) · ebddb65a
  Chayenne authored Mar 06, 2025
```
Co-authored-by: ybyang <ybyang7@iflytek.com>
```
  ebddb65a
- [docs] fix HF reference script command (#4148) · 19fd57bc
  Adarsh Shirawalmath authored Mar 07, 2025
  
  19fd57bc
- fix cross-reference error and spelling mistakes (#4101) · d2d0d061
  samzong authored Mar 06, 2025
```
Signed-off-by: samzong <samzong.lu@gmail.com>
```
  d2d0d061
05 Mar, 2025 4 commits
- revert deepseek docs (#4109) · 0aaccbbf
  Yineng Zhang authored Mar 05, 2025
  
  0aaccbbf
- Docs: reorganize dpsk docs (#4108) · e70fa279
  Chayenne authored Mar 05, 2025
  
  e70fa279
- Docs: Add DeepSeek optimization ablations documentation (#4107) · abe74b7b
  Tommy Yang authored Mar 06, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  abe74b7b
- [Revision] Add fast decode plan for flashinfer mla (#4012) · fc91d08a
  Baizhou Zhang authored Mar 05, 2025
  
  fc91d08a
04 Mar, 2025 1 commit
- Reasoning parser (#4000) · 95575aa7
  Xihuai Wang authored Mar 04, 2025
```
Co-authored-by: Lucas Pickup <lupickup@microsoft.com>
```
  95575aa7
03 Mar, 2025 4 commits
- Add examples in sampling parameters (#4039) · 146ac8df
  Chayenne authored Mar 03, 2025
  
  146ac8df
- Misc clean up; Remove the support of jump forward (#4032) · 935cda94
  Lianmin Zheng authored Mar 03, 2025
  
  935cda94
- Update metrics documentation (#3264) · a7000a76
  Yudi Xue authored Mar 03, 2025
  
  a7000a76
- Revert "Add fast decode plan for flashinfer mla" (#4008) · 9e1014cf
  Lianmin Zheng authored Mar 02, 2025
  
  9e1014cf