Commits · 8b39274e3429c7813a5459d06b02cc032e8cb116 · change / sglang

21 Apr, 2025 1 commit
- [Feature] Prefill assistant response - add continue_final_message parameter (#4226) · 8b39274e
  Adarsh Shirawalmath authored Apr 21, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  8b39274e
20 Apr, 2025 5 commits
- [Feat] upgrade pytorch2.6 (#5417) · 417b44eb
  lukec authored Apr 21, 2025
  
  417b44eb
- Add document for LoRA serving (#5521) · 072b4d03
  Baizhou Zhang authored Apr 20, 2025
  
  072b4d03
- Super tiny fix typo (#5559) · 9c434777
  fzyzcjy authored Apr 21, 2025
  
  9c434777
- Release v0.4.5.post2 (#5582) · fbdc94ba
  Lianmin Zheng authored Apr 20, 2025
  
  fbdc94ba
- [Doc]Add instruction for profiling with bench_one_batch (#5581) · b54b5a96
  Baizhou Zhang authored Apr 20, 2025
  
  b54b5a96
19 Apr, 2025 1 commit
- feat: use flashinfer jit package (#5547) · 0961feef
  Yineng Zhang authored Apr 19, 2025
  
  0961feef
18 Apr, 2025 3 commits
- Revert "Avoid computing lse in Ragged Prefill when there's no prefix.… (#5544) · a6f892e5
  Yineng Zhang authored Apr 18, 2025
  
  a6f892e5
- Avoid computing lse in Ragged Prefill when there's no prefix. (#5476) · bfa39224
  Wenxuan Tan authored Apr 18, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  bfa39224
- [docs] Fix several consistency issues in sampling_params.md (#5373) · a0fc5bc1
  Michael Yao authored Apr 18, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  a0fc5bc1
17 Apr, 2025 4 commits
- Doc: fix problems of the 'Execute Notebooks / run-all-notebooks' ci caused by... · f13d65a7
  mlmz authored Apr 18, 2025
```
Doc: fix problems of the 'Execute Notebooks / run-all-notebooks' ci caused by the unstability of deepseek-ai/DeepSeek-R1-Distill-Qwen-7B (#5503)
```
  f13d65a7
- Deprecate enable-flashinfer-mla and enable-flashmla (#5480) · 6fb29ffd
  Baizhou Zhang authored Apr 17, 2025
  
  6fb29ffd
- Deprecate disable-mla (#5481) · 4fb05583
  Baizhou Zhang authored Apr 17, 2025
  
  4fb05583
- Update attention_backend.md: plural form (#5489) · 92d1561b
  Didier Durand authored Apr 17, 2025
  
  92d1561b
16 Apr, 2025 6 commits
- add multi-lora feature in README.md (#5463) · d7bc19a4
  Ying Sheng authored Apr 16, 2025
  
  d7bc19a4
- [doc] Update benchmark_and_profiling.md (#5449) · 06a1656e
  Xiaoyu Zhang authored Apr 16, 2025
  
  06a1656e
- chore: bump v0.4.5.post1 (#5445) · 5b5c7237
  Yineng Zhang authored Apr 15, 2025
  
  5b5c7237
- Support MHA with chunked prefix cache for DeepSeek chunked prefill (#5113) · a42736bb
  Baizhou Zhang authored Apr 15, 2025
  
  a42736bb
- [Docs] Update start/install.md (#5398) · b64b88e7
  Michael Yao authored Apr 16, 2025
  
  b64b88e7
- add attention backend supporting matrix in the doc (#5211) · 3efc8e2d
  mRSun15 authored Apr 15, 2025
```
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
```
  3efc8e2d
15 Apr, 2025 1 commit
- [Fix] Turn off DeepGEMM by default (#5263) · f6772f14
  Baizhou Zhang authored Apr 14, 2025
  
  f6772f14
12 Apr, 2025 2 commits
- Fix: docs/backend/structured_outputs.ipynb (#4884) · 2074a2e6
  thyecust authored Apr 12, 2025
  
  2074a2e6
- [VLM] Adopt fast image processor by default (#5065) · 34ef6c81
  Mick authored Apr 12, 2025
  
  34ef6c81
11 Apr, 2025 4 commits
- [Docs] Remove the older supported docs section (#5301) · a0a9f6d6
  Adarsh Shirawalmath authored Apr 12, 2025
  
  a0a9f6d6
- [Docs] Supported Model Docs - Major restructuring (#5290) · 4aa6bab0
  Adarsh Shirawalmath authored Apr 11, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  4aa6bab0
- Fix a 404 link in send_request.ipynb (#5280) · fc14cca0
  Michael Yao authored Apr 11, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  fc14cca0
- doc: nested loop code for offline engine (#5244) · 4d2e3051
  mlmz authored Apr 11, 2025
  
  4d2e3051
09 Apr, 2025 1 commit
- docs: remove the use of Downward API for LWS_WORKER_INDEX (#5110) · f2b70afd
  Kay Yan authored Apr 09, 2025
```
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
```
  f2b70afd
08 Apr, 2025 3 commits
- Small improvement of native api docs (#5139) · f8194b26
  simveit authored Apr 08, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  f8194b26
- feat: disable grammar restrictions within reasoning sections (#4984) · 7c5658c1
  mlmz authored Apr 08, 2025
```
Co-authored-by: tianhaoyu <thy@mail.ecust.edu.cn>
Co-authored-by: DarkSharpness <2040703891@qq.com>
```
  7c5658c1
- Add Llama4 user guide (#5133) · ade714a6
  Ke Bao authored Apr 08, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  ade714a6
07 Apr, 2025 2 commits

bump v0.4.5 (#5117) · 57f99608
Yineng Zhang authored Apr 07, 2025

57f99608

Chang Su authored Apr 07, 2025


Co-authored-by: Cheng Wan <cwan39@gatech.edu>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: ispobock <ispobaoke@163.com>

f04c80dc

06 Apr, 2025 1 commit
- Fix: Reduce the number of document ci attempts to avoid long ci running (#5097) · d1bb1711
  mlmz authored Apr 06, 2025
```
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
```
  d1bb1711
05 Apr, 2025 2 commits
- bump v0.4.4.post4 (#5091) · 35e0856b
  Yineng Zhang authored Apr 05, 2025
  
  35e0856b
- [Revision] Replace enable_flashinfer_mla argument with attention_backend (#5052) · efbae697
  Baizhou Zhang authored Apr 05, 2025
  
  efbae697
04 Apr, 2025 1 commit
- Feature/revise docs ci (#5056) · 913e38df
  renxin authored Apr 03, 2025
  
  913e38df
03 Apr, 2025 3 commits
- update eagle-3 docs (#4796) · 98f768d1
  simveit authored Apr 04, 2025
```
Co-authored-by: Yifan Zhang <zhangyif21@mails.tsinghua.edu.cn>
```
  98f768d1
- Revert "Replace enable_flashinfer_mla argument with attention_backend" (#5048) · 74885a84
  Lianmin Zheng authored Apr 03, 2025
  
  74885a84
- Replace enable_flashinfer_mla argument with attention_backend (#5005) · e8999b13
  Baizhou Zhang authored Apr 03, 2025
  
  e8999b13