Commits · 5156d5a413517d9ecb17c877aa36764ad2673375 · change / sglang

20 Apr, 2025 1 commit
- Add document for LoRA serving (#5521) · 072b4d03
  Baizhou Zhang authored Apr 20, 2025
  
  072b4d03
18 Apr, 2025 3 commits
- Revert "Avoid computing lse in Ragged Prefill when there's no prefix.… (#5544) · a6f892e5
  Yineng Zhang authored Apr 18, 2025
  
  a6f892e5
- Avoid computing lse in Ragged Prefill when there's no prefix. (#5476) · bfa39224
  Wenxuan Tan authored Apr 18, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  bfa39224
- [docs] Fix several consistency issues in sampling_params.md (#5373) · a0fc5bc1
  Michael Yao authored Apr 18, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  a0fc5bc1
17 Apr, 2025 4 commits
- Doc: fix problems of the 'Execute Notebooks / run-all-notebooks' ci caused by... · f13d65a7
  mlmz authored Apr 18, 2025
```
Doc: fix problems of the 'Execute Notebooks / run-all-notebooks' ci caused by the unstability of deepseek-ai/DeepSeek-R1-Distill-Qwen-7B (#5503)
```
  f13d65a7
- Deprecate enable-flashinfer-mla and enable-flashmla (#5480) · 6fb29ffd
  Baizhou Zhang authored Apr 17, 2025
  
  6fb29ffd
- Deprecate disable-mla (#5481) · 4fb05583
  Baizhou Zhang authored Apr 17, 2025
  
  4fb05583
- Update attention_backend.md: plural form (#5489) · 92d1561b
  Didier Durand authored Apr 17, 2025
  
  92d1561b
16 Apr, 2025 2 commits
- Support MHA with chunked prefix cache for DeepSeek chunked prefill (#5113) · a42736bb
  Baizhou Zhang authored Apr 15, 2025
  
  a42736bb
- add attention backend supporting matrix in the doc (#5211) · 3efc8e2d
  mRSun15 authored Apr 15, 2025
```
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
```
  3efc8e2d
12 Apr, 2025 2 commits
- Fix: docs/backend/structured_outputs.ipynb (#4884) · 2074a2e6
  thyecust authored Apr 12, 2025
  
  2074a2e6
- [VLM] Adopt fast image processor by default (#5065) · 34ef6c81
  Mick authored Apr 12, 2025
  
  34ef6c81
11 Apr, 2025 3 commits
- [Docs] Supported Model Docs - Major restructuring (#5290) · 4aa6bab0
  Adarsh Shirawalmath authored Apr 11, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  4aa6bab0
- Fix a 404 link in send_request.ipynb (#5280) · fc14cca0
  Michael Yao authored Apr 11, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  fc14cca0
- doc: nested loop code for offline engine (#5244) · 4d2e3051
  mlmz authored Apr 11, 2025
  
  4d2e3051
08 Apr, 2025 2 commits
- Small improvement of native api docs (#5139) · f8194b26
  simveit authored Apr 08, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  f8194b26
- feat: disable grammar restrictions within reasoning sections (#4984) · 7c5658c1
  mlmz authored Apr 08, 2025
```
Co-authored-by: tianhaoyu <thy@mail.ecust.edu.cn>
Co-authored-by: DarkSharpness <2040703891@qq.com>
```
  7c5658c1
05 Apr, 2025 1 commit
- [Revision] Replace enable_flashinfer_mla argument with attention_backend (#5052) · efbae697
  Baizhou Zhang authored Apr 05, 2025
  
  efbae697
03 Apr, 2025 3 commits
- update eagle-3 docs (#4796) · 98f768d1
  simveit authored Apr 04, 2025
```
Co-authored-by: Yifan Zhang <zhangyif21@mails.tsinghua.edu.cn>
```
  98f768d1
- Revert "Replace enable_flashinfer_mla argument with attention_backend" (#5048) · 74885a84
  Lianmin Zheng authored Apr 03, 2025
  
  74885a84
- Replace enable_flashinfer_mla argument with attention_backend (#5005) · e8999b13
  Baizhou Zhang authored Apr 03, 2025
  
  e8999b13
01 Apr, 2025 1 commit

[Feature] Support DeepEP Low Latency (#4767) · 23c764b1

Jinyan Chen authored Apr 02, 2025


Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
Co-authored-by: ch-wan <cwan39@gatech.edu>

23c764b1

29 Mar, 2025 1 commit
- update torch compile doc (#4874) · aa08aeac
  Ke Bao authored Mar 29, 2025
  
  aa08aeac
28 Mar, 2025 2 commits
- [CI] Remove unused imports with Ruff to pre-commit config, only to... · b149b393
  Brayden Zhong authored Mar 27, 2025
```
[CI] Remove unused imports with Ruff to pre-commit config, only to benchmarks/docs/examples folder (#3969)
```
  b149b393
- Support (1 <= dp < tp) in the dp attention in DeepEP (#4770) · 7f19e083
  tarinkk authored Mar 27, 2025
```
Co-authored-by: Cheng Wan <cwan39@gatech.edu>
```
  7f19e083
27 Mar, 2025 1 commit
- [k8s] Clarified the usage of shared memory. (#4341) · f60f2931
  Jiří Suchomel authored Mar 27, 2025
  
  f60f2931
25 Mar, 2025 1 commit
- Add endpoints to dump selected expert ids (#4435) · 199bb01d
  yuhsaun-t authored Mar 24, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  199bb01d
22 Mar, 2025 3 commits
- fix typo SGLang supports three grammar backends (#4679) · 8796cebb
  BroadbentJim authored Mar 22, 2025
  
  8796cebb
- [Docs] Update docs for gemma3 and VLM chat templates (#4674) · fb888603
  Adarsh Shirawalmath authored Mar 22, 2025
  
  fb888603
- fix: fix ipython running error for Engine due to outlines nest_asyncio (#4582) · f6ab4ca6
  mlmz authored Mar 22, 2025
```
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
```
  f6ab4ca6
19 Mar, 2025 1 commit

[Feature] Integrate DeepEP into SGLang (#4232) · f44db16c

Jinyan Chen authored Mar 19, 2025


Co-authored-by: Cheng Wan <cwan39@gatech.edu>
Co-authored-by: Xuting Zhou <xutingz@nvidia.com>

f44db16c

18 Mar, 2025 1 commit
- [Feature] Support EAGLE 3 (#4247) · 9e0186f3
  James Liu authored Mar 18, 2025
  
  9e0186f3
17 Mar, 2025 3 commits
- [Doc] add doc for quantization w8a8_fp8 or w8a8_int8 (#4495) · f2ab37e5
  HandH1998 authored Mar 17, 2025
  
  f2ab37e5
- Constraint Decoding: Tool call with text (#4067) · 927ca935
  Xihuai Wang authored Mar 17, 2025
  
  927ca935
- Constraint Decoding: Set xgrammar as the default grammar backend (#4386) · 452db508
  mlmz authored Mar 17, 2025
  
  452db508
15 Mar, 2025 2 commits
- typos: Update sampling_params.md (#4391) · 22c96f78
  Wang Ran (汪然) authored Mar 16, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  22c96f78
- docs: hot fix torch compile cache (#4442) · e1a5e7e4
  Chayenne authored Mar 14, 2025
  
  e1a5e7e4
13 Mar, 2025 3 commits
- [Doc] Fix typo in backend/sampling_params (#3835) · ad46550d
  yang_zcybb authored Mar 13, 2025
```
Co-authored-by: yangzhice.124 <yangzhice.124@bytedance.com>
```
  ad46550d
- [docs] Update outdated description about `torch.compile` (#3844) · 14344caa
  Jun Liu authored Mar 13, 2025
  
  14344caa
- Fix the doc of FR-Spec (#4295) · 0a59a465
  William authored Mar 13, 2025
  
  0a59a465