Commits · 706bd69cc58aefb7c0a4d7b269f1cbe2908f955b · change / sglang

09 Aug, 2025 1 commit
- Clean up server_args.py to have a dedicated function for model specific adjustments (#8983) · 706bd69c
  Lianmin Zheng authored Aug 08, 2025
  
  706bd69c
27 Jul, 2025 1 commit

Support precomputed_embeddings for Llama 4 (#8156) · 44d600cd

Kevin Xiang Li authored Jul 27, 2025


Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xiang (Kevin) Li <lik@nvidia.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>

44d600cd

11 Jun, 2025 2 commits
- Do not run frontend_reasoning.ipynb to reduce the CI load (#7073) · 0f218731
  Lianmin Zheng authored Jun 10, 2025
  
  0f218731
- Frontend language separate reasoning support (#6031) · 14c18d25
  Yudi Xue authored Jun 10, 2025
  
  14c18d25
10 Jun, 2025 1 commit
- Update README.md (#7040) · bb185b0e
  Lianmin Zheng authored Jun 10, 2025
  
  bb185b0e
04 Jun, 2025 1 commit
- [FEAT] Add transformers backend support (#5929) · 37f15475
  Marc Sun authored Jun 04, 2025
  
  37f15475
27 May, 2025 1 commit
- update toc for doc and dockerfile code style format (#6450) · 7a0bbe6a
  linzhuo authored May 27, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  7a0bbe6a
25 May, 2025 1 commit
- Fix some issues with current docs. (#6588) · e235be16
  simveit authored May 25, 2025
  
  e235be16
22 May, 2025 1 commit
- [PD] Add doc and simplify sender.send (#6019) · 75135580
  Byron Hsu authored May 21, 2025
  
  75135580
14 May, 2025 1 commit

doc: update developer guide regarding mllms (#6138) · cd7c8a8d

Mick authored May 14, 2025

Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: XinyuanTong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>

cd7c8a8d

12 May, 2025 2 commits
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd
- fix some typos (#6209) · d738ab52
  applesaucethebun authored May 12, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  d738ab52
01 May, 2025 1 commit
- docs: Fix Qwen model typo (#5944) · ad506a4e
  江家瑋 authored May 02, 2025
```
Signed-off-by: JiangJiaWei1103 <waynechuang97@gmail.com>
```
  ad506a4e
27 Apr, 2025 1 commit
- [Minor] fix documentations (#5756) · 155890e4
  Lianmin Zheng authored Apr 26, 2025
  
  155890e4
20 Apr, 2025 1 commit
- Add document for LoRA serving (#5521) · 072b4d03
  Baizhou Zhang authored Apr 20, 2025
  
  072b4d03
17 Apr, 2025 1 commit

Doc: fix problems of the 'Execute Notebooks / run-all-notebooks' ci caused by... · f13d65a7

mlmz authored Apr 18, 2025

Doc: fix problems of the 'Execute Notebooks / run-all-notebooks' ci caused by the unstability of deepseek-ai/DeepSeek-R1-Distill-Qwen-7B (#5503)

f13d65a7

16 Apr, 2025 2 commits
- add multi-lora feature in README.md (#5463) · d7bc19a4
  Ying Sheng authored Apr 16, 2025
  
  d7bc19a4
- add attention backend supporting matrix in the doc (#5211) · 3efc8e2d
  mRSun15 authored Apr 15, 2025
```
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
```
  3efc8e2d
11 Apr, 2025 1 commit
- [Docs] Supported Model Docs - Major restructuring (#5290) · 4aa6bab0
  Adarsh Shirawalmath authored Apr 11, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  4aa6bab0
08 Apr, 2025 2 commits
- feat: disable grammar restrictions within reasoning sections (#4984) · 7c5658c1
  mlmz authored Apr 08, 2025
```
Co-authored-by: tianhaoyu <thy@mail.ecust.edu.cn>
Co-authored-by: DarkSharpness <2040703891@qq.com>
```
  7c5658c1
- Add Llama4 user guide (#5133) · ade714a6
  Ke Bao authored Apr 08, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  ade714a6
17 Mar, 2025 1 commit
- Update readme (#4517) · c38ca4fc
  Lianmin Zheng authored Mar 17, 2025
  
  c38ca4fc
11 Mar, 2025 1 commit
- update doc (#4299) · 00f42707
  Yineng Zhang authored Mar 11, 2025
  
  00f42707
05 Mar, 2025 2 commits
- Docs: reorganize dpsk docs (#4108) · e70fa279
  Chayenne authored Mar 05, 2025
  
  e70fa279
- Docs: Add DeepSeek optimization ablations documentation (#4107) · abe74b7b
  Tommy Yang authored Mar 06, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  abe74b7b
04 Mar, 2025 1 commit
- Reasoning parser (#4000) · 95575aa7
  Xihuai Wang authored Mar 04, 2025
```
Co-authored-by: Lucas Pickup <lupickup@microsoft.com>
```
  95575aa7
26 Feb, 2025 2 commits
- Docs: Implemented frontend docs (#3791) · acd1a159
  simveit authored Feb 27, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  acd1a159
- Docs: Move dpsk docs forward a step (#3894) · 8f019c7d
  Chayenne authored Feb 26, 2025
  
  8f019c7d
19 Feb, 2025 2 commits
- Docs: Fix layout with sub-section (#3710) · 3c7bfd7e
  Chayenne authored Feb 19, 2025
  
  3c7bfd7e
- [Docs]: Fix Multi-User Port Allocation Conflicts (#3601) · 55de40f7
  Shi Shuai authored Feb 19, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
Co-authored-by: simveit <simp.veitner@gmail.com>
```
  55de40f7
18 Feb, 2025 1 commit
- Docs: Deploy multi-node inference (LWS method) using sglang in a K8s cluster (#3624) · c51dc2cc
  ybyang authored Feb 18, 2025
  
  c51dc2cc
15 Feb, 2025 1 commit
- [CI] Improve Docs CI Efficiency (#3587) · 7443197a
  Shi Shuai authored Feb 15, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  7443197a
09 Feb, 2025 1 commit
- [Docs] Add quantization docs (#3410) · 0af1d239
  Wenxuan Tan authored Feb 09, 2025
```
Co-authored-by: yinfan98 <1106310035@qq.com>
```
  0af1d239
07 Feb, 2025 2 commits
- added amd_configure.md to references (#3275) · 0a6f18f0
  Zachary Streeter authored Feb 07, 2025
```
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  0a6f18f0
- Docs/CI: Enable Fake Finish for Docs Only PR (#3350) · 76ca91df
  Chayenne authored Feb 06, 2025
  
  76ca91df
03 Feb, 2025 1 commit

Add a Doc about guide on nvidia jetson #3182 (#3205) · 455bfe8d

Liangjun Song authored Feb 03, 2025


Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>

455bfe8d

02 Feb, 2025 1 commit

docs/accuracy evaluation (#3114) · c27c378a

simveit authored Feb 02, 2025


Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>

c27c378a

27 Jan, 2025 1 commit

Doc: Add Docs about EAGLE speculative decoding (#3144) · 9472e699

Jhin authored Jan 26, 2025


Co-authored-by: Chayenne <zhaochenyang@ucla.edu>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>

9472e699

26 Jan, 2025 1 commit
- [Docs]: Add function calling in index.rst (#3155) · 1acc1f56
  Chayenne authored Jan 26, 2025
  
  1acc1f56
11 Jan, 2025 1 commit
- Improve: Token-In Token-Out Usage for RLHF (#2843) · c4f9707e
  Shi Shuai authored Jan 11, 2025
  
  c4f9707e