Commits · b8559764f64ed07232dfe2c99c3d010c3b957889 · change / sglang

04 May, 2025 1 commit
- Tool Call: Add `chat_template_kwargs` documentation (#5679) · 95c231e5
  vzed authored May 04, 2025
  
  95c231e5
02 May, 2025 1 commit
- Remove token in token out in Native API (#5967) · 73dcf2b3
  Chayenne authored May 01, 2025
  
  73dcf2b3
30 Apr, 2025 1 commit
- feat: support pythonic tool call and index in tool call streaming (#5725) · 2b06484b
  Chang Su authored Apr 29, 2025
  
  2b06484b
29 Apr, 2025 2 commits
- [Doc] Tables instead of bulletpoints for sampling doc (#5841) · ae523675
  simveit authored Apr 29, 2025
  
  ae523675
- Feat: support cuda graph for LoRA (#4115) · 8c0cfca8
  Qiaolin Yu authored Apr 29, 2025
```
Co-authored-by: Beichen Ma <mabeichen12@gmail.com>
```
  8c0cfca8
28 Apr, 2025 4 commits
- [CI] test chunked prefill more (#5798) · 849c83a0
  Lianmin Zheng authored Apr 28, 2025
  
  849c83a0
- [Doc] Recover history of server_arguments.md (#5851) · f48b007c
  Baizhou Zhang authored Apr 28, 2025
  
  f48b007c
- [Docs] Replace lists with tables for cleanup and readability in server_arguments (#5276) · 966eb908
  Michael Yao authored Apr 28, 2025
  
  966eb908
- Add Cutlass MLA attention backend (#5390) · 84810da4
  Trevor Morris authored Apr 27, 2025
  
  84810da4
27 Apr, 2025 1 commit
- [Minor] fix documentations (#5756) · 155890e4
  Lianmin Zheng authored Apr 26, 2025
  
  155890e4
24 Apr, 2025 1 commit
- [Doc] Fix a link to Weilin Zhao (#5706) · b5be5694
  Michael Yao authored Apr 25, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  b5be5694
22 Apr, 2025 1 commit
- [Doc] Fix a 404 link to llama-405b (#5615) · 92bb64bc
  Michael Yao authored Apr 22, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  92bb64bc
21 Apr, 2025 2 commits
- smaller and non gated models for docs (#5378) · 8de53da9
  simveit authored Apr 21, 2025
  
  8de53da9
- [Feature] Prefill assistant response - add continue_final_message parameter (#4226) · 8b39274e
  Adarsh Shirawalmath authored Apr 21, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  8b39274e
20 Apr, 2025 1 commit
- Add document for LoRA serving (#5521) · 072b4d03
  Baizhou Zhang authored Apr 20, 2025
  
  072b4d03
18 Apr, 2025 3 commits
- Revert "Avoid computing lse in Ragged Prefill when there's no prefix.… (#5544) · a6f892e5
  Yineng Zhang authored Apr 18, 2025
  
  a6f892e5
- Avoid computing lse in Ragged Prefill when there's no prefix. (#5476) · bfa39224
  Wenxuan Tan authored Apr 18, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  bfa39224
- [docs] Fix several consistency issues in sampling_params.md (#5373) · a0fc5bc1
  Michael Yao authored Apr 18, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  a0fc5bc1
17 Apr, 2025 4 commits
- Doc: fix problems of the 'Execute Notebooks / run-all-notebooks' ci caused by... · f13d65a7
  mlmz authored Apr 18, 2025
```
Doc: fix problems of the 'Execute Notebooks / run-all-notebooks' ci caused by the unstability of deepseek-ai/DeepSeek-R1-Distill-Qwen-7B (#5503)
```
  f13d65a7
- Deprecate enable-flashinfer-mla and enable-flashmla (#5480) · 6fb29ffd
  Baizhou Zhang authored Apr 17, 2025
  
  6fb29ffd
- Deprecate disable-mla (#5481) · 4fb05583
  Baizhou Zhang authored Apr 17, 2025
  
  4fb05583
- Update attention_backend.md: plural form (#5489) · 92d1561b
  Didier Durand authored Apr 17, 2025
  
  92d1561b
16 Apr, 2025 2 commits
- Support MHA with chunked prefix cache for DeepSeek chunked prefill (#5113) · a42736bb
  Baizhou Zhang authored Apr 15, 2025
  
  a42736bb
- add attention backend supporting matrix in the doc (#5211) · 3efc8e2d
  mRSun15 authored Apr 15, 2025
```
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
```
  3efc8e2d
12 Apr, 2025 2 commits
- Fix: docs/backend/structured_outputs.ipynb (#4884) · 2074a2e6
  thyecust authored Apr 12, 2025
  
  2074a2e6
- [VLM] Adopt fast image processor by default (#5065) · 34ef6c81
  Mick authored Apr 12, 2025
  
  34ef6c81
11 Apr, 2025 3 commits
- [Docs] Supported Model Docs - Major restructuring (#5290) · 4aa6bab0
  Adarsh Shirawalmath authored Apr 11, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  4aa6bab0
- Fix a 404 link in send_request.ipynb (#5280) · fc14cca0
  Michael Yao authored Apr 11, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  fc14cca0
- doc: nested loop code for offline engine (#5244) · 4d2e3051
  mlmz authored Apr 11, 2025
  
  4d2e3051
08 Apr, 2025 2 commits
- Small improvement of native api docs (#5139) · f8194b26
  simveit authored Apr 08, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  f8194b26
- feat: disable grammar restrictions within reasoning sections (#4984) · 7c5658c1
  mlmz authored Apr 08, 2025
```
Co-authored-by: tianhaoyu <thy@mail.ecust.edu.cn>
Co-authored-by: DarkSharpness <2040703891@qq.com>
```
  7c5658c1
05 Apr, 2025 1 commit
- [Revision] Replace enable_flashinfer_mla argument with attention_backend (#5052) · efbae697
  Baizhou Zhang authored Apr 05, 2025
  
  efbae697
03 Apr, 2025 3 commits
- update eagle-3 docs (#4796) · 98f768d1
  simveit authored Apr 04, 2025
```
Co-authored-by: Yifan Zhang <zhangyif21@mails.tsinghua.edu.cn>
```
  98f768d1
- Revert "Replace enable_flashinfer_mla argument with attention_backend" (#5048) · 74885a84
  Lianmin Zheng authored Apr 03, 2025
  
  74885a84
- Replace enable_flashinfer_mla argument with attention_backend (#5005) · e8999b13
  Baizhou Zhang authored Apr 03, 2025
  
  e8999b13
01 Apr, 2025 1 commit

[Feature] Support DeepEP Low Latency (#4767) · 23c764b1

Jinyan Chen authored Apr 02, 2025


Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
Co-authored-by: ch-wan <cwan39@gatech.edu>

23c764b1

29 Mar, 2025 1 commit
- update torch compile doc (#4874) · aa08aeac
  Ke Bao authored Mar 29, 2025
  
  aa08aeac
28 Mar, 2025 2 commits
- [CI] Remove unused imports with Ruff to pre-commit config, only to... · b149b393
  Brayden Zhong authored Mar 27, 2025
```
[CI] Remove unused imports with Ruff to pre-commit config, only to benchmarks/docs/examples folder (#3969)
```
  b149b393
- Support (1 <= dp < tp) in the dp attention in DeepEP (#4770) · 7f19e083
  tarinkk authored Mar 27, 2025
```
Co-authored-by: Cheng Wan <cwan39@gatech.edu>
```
  7f19e083
27 Mar, 2025 1 commit
- [k8s] Clarified the usage of shared memory. (#4341) · f60f2931
  Jiří Suchomel authored Mar 27, 2025
  
  f60f2931