Commits · e235be16fe720f62aed1ec1dd3dbf7b9dfcf2107 · change / sglang · GitLab

25 May, 2025 1 commit
- Fix some issues with current docs. (#6588) · e235be16
  simveit authored May 25, 2025
  
  e235be16
15 May, 2025 1 commit

[Feat] Support FlashMLA backend with MTP and FP8 KV cache (#6109) · 2e4babdb

quinnrong94 authored May 15, 2025


Co-authored-by: Yingyi <yingyihuang2000@outlook.com>
Co-authored-by: neiltian <neiltian@tencent.com>
Co-authored-by: lukec <118525388+sleepcoo@users.noreply.github.com>
Co-authored-by: kexueyu <kexueyu@tencent.com>
Co-authored-by: vincentmeng <vincentmeng@tencent.com>
Co-authored-by: pengmeng <pengmeng@tencent.com>

2e4babdb

13 May, 2025 1 commit
- [Llama4] Add docs note about enable multimodal (#6235) · 3c32895c
  Brayden Zhong authored May 12, 2025
  
  3c32895c
12 May, 2025 3 commits
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd
- [Docs] Add docs for `SGLANG_` and `SGL_` environment variables (#6206) · 12319a67
  Brayden Zhong authored May 12, 2025
  
  12319a67
- fix some typos (#6209) · d738ab52
  applesaucethebun authored May 12, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  d738ab52
08 May, 2025 1 commit
- Update doc for MLA attention backends (#6034) · 8f508cc7
  Baizhou Zhang authored May 07, 2025
  
  8f508cc7
02 May, 2025 1 commit
- feat: Refactor DeepSeekV3 function call (#5908) · 170d1f21
  Chang Su authored May 01, 2025
  
  170d1f21
01 May, 2025 1 commit
- Update ci test and doc for MTP api change (#5952) · ebaba856
  Ke Bao authored May 02, 2025
  
  ebaba856
27 Apr, 2025 3 commits
- [Docs] update grafana setup guide in production metrics (#5643) · 86317c09
  Huapeng Zhou authored Apr 28, 2025
```
Co-authored-by: NoahM <88418672+zhudianGG@users.noreply.github.com>
```
  86317c09
- support for the DeepSeek model by enabling streaming response parsing (#5592) · a21ef363
  Frankey_8080 authored Apr 27, 2025
  
  a21ef363
- [Minor] fix documentations (#5756) · 155890e4
  Lianmin Zheng authored Apr 26, 2025
  
  155890e4
22 Apr, 2025 1 commit
- Turn on DeepGemm By Default and Update Doc (#5628) · ce5412b6
  Baizhou Zhang authored Apr 22, 2025
  
  ce5412b6
21 Apr, 2025 2 commits
- [Feat.] Enable grafana to show metrics (#4718) · 57131dd9
  Huapeng Zhou authored Apr 21, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  57131dd9
- add function call parser for DeepSeek V3 (#5224) · fac17acf
  Yi Zhou authored Apr 21, 2025
  
  fac17acf
20 Apr, 2025 2 commits
- Super tiny fix typo (#5559) · 9c434777
  fzyzcjy authored Apr 21, 2025
  
  9c434777
- [Doc]Add instruction for profiling with bench_one_batch (#5581) · b54b5a96
  Baizhou Zhang authored Apr 20, 2025
  
  b54b5a96
17 Apr, 2025 2 commits
- Deprecate enable-flashinfer-mla and enable-flashmla (#5480) · 6fb29ffd
  Baizhou Zhang authored Apr 17, 2025
  
  6fb29ffd
- Deprecate disable-mla (#5481) · 4fb05583
  Baizhou Zhang authored Apr 17, 2025
  
  4fb05583
16 Apr, 2025 2 commits
- [doc] Update benchmark_and_profiling.md (#5449) · 06a1656e
  Xiaoyu Zhang authored Apr 16, 2025
  
  06a1656e
- Support MHA with chunked prefix cache for DeepSeek chunked prefill (#5113) · a42736bb
  Baizhou Zhang authored Apr 15, 2025
  
  a42736bb
15 Apr, 2025 1 commit
- [Fix] Turn off DeepGEMM by default (#5263) · f6772f14
  Baizhou Zhang authored Apr 14, 2025
  
  f6772f14
11 Apr, 2025 1 commit
- [Docs] Remove the older supported docs section (#5301) · a0a9f6d6
  Adarsh Shirawalmath authored Apr 12, 2025
  
  a0a9f6d6
09 Apr, 2025 1 commit
- docs: remove the use of Downward API for LWS_WORKER_INDEX (#5110) · f2b70afd
  Kay Yan authored Apr 09, 2025
```
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
```
  f2b70afd
08 Apr, 2025 1 commit
- Add Llama4 user guide (#5133) · ade714a6
  Ke Bao authored Apr 08, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  ade714a6
07 Apr, 2025 1 commit

Add Llama4 support (#5092) · f04c80dc

Chang Su authored Apr 07, 2025


Co-authored-by: Cheng Wan <cwan39@gatech.edu>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: ispobock <ispobaoke@163.com>

f04c80dc

05 Apr, 2025 1 commit
- [Revision] Replace enable_flashinfer_mla argument with attention_backend (#5052) · efbae697
  Baizhou Zhang authored Apr 05, 2025
  
  efbae697
03 Apr, 2025 2 commits
- Revert "Replace enable_flashinfer_mla argument with attention_backend" (#5048) · 74885a84
  Lianmin Zheng authored Apr 03, 2025
  
  74885a84
- Replace enable_flashinfer_mla argument with attention_backend (#5005) · e8999b13
  Baizhou Zhang authored Apr 03, 2025
  
  e8999b13
29 Mar, 2025 1 commit
- Tiny fix doc error (#4795) · 736502d4
  fzyzcjy authored Mar 29, 2025
  
  736502d4
27 Mar, 2025 3 commits
- Update doc for DeepSeek-V3-0324 (#4825) · b3953258
  Ke Bao authored Mar 28, 2025
  
  b3953258
- support clip embedding model (#4506) · c913ed40
  uylnap authored Mar 27, 2025
  
  c913ed40
- Update supported_models.md: adding open-r1 Olympic Code 32B by HuggingFace (#4628) · 44f47d3e
  Didier Durand authored Mar 27, 2025
  
  44f47d3e
25 Mar, 2025 2 commits
- model: Minicpmo (#3023) · 1e86457c
  Mick authored Mar 25, 2025
  
  1e86457c
- [Model] Support Qwen2ForSequenceClassification (#4609) · 22c3702e
  Ximingwang-09 authored Mar 25, 2025
```
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  22c3702e
22 Mar, 2025 1 commit
- [Docs] Update docs for gemma3 and VLM chat templates (#4674) · fb888603
  Adarsh Shirawalmath authored Mar 22, 2025
  
  fb888603
21 Mar, 2025 1 commit
- [docs] Add links and fix grammars in deploy_on_k8s.md (#4641) · c6ec7029
  Michael Yao authored Mar 21, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  c6ec7029
20 Mar, 2025 1 commit
- Update doc for MTP and DP attention (#4622) · bfb03c61
  Ke Bao authored Mar 21, 2025
  
  bfb03c61
18 Mar, 2025 1 commit
- Fix the incorrect args in benchmark_and_profiling.md (#4542) · 2d004512
  Albert authored Mar 18, 2025
```
Signed-off-by: Tianyu Zhou <albert.zty@antgroup.com>
```
  2d004512
17 Mar, 2025 1 commit
- Support serving DeepSeek-R1-Channel-INT8 with 32 L40S. (#4418) · 75b65648
  Wenbo Yang authored Mar 17, 2025
  
  75b65648