Commits · ef959d7b857d64c3e10aa8827e9af742283c1571 · change / sglang

11 Sep, 2025 1 commit
- [CPU] fix OOM when mem-fraction is not set (#9090) · ef959d7b
  Zaili Wang authored Sep 11, 2025
  
  ef959d7b
08 Sep, 2025 1 commit
- Add graph runner support with torch compile on CPU (#7843) · 7577f0e4
  Cao E authored Sep 08, 2025
  
  7577f0e4
05 Sep, 2025 1 commit
- Tiny support setting numa nodes for different ranks (#10006) · df97b31f
  fzyzcjy authored Sep 05, 2025
  
  df97b31f
04 Sep, 2025 1 commit

Optimized deepseek-v3/r1 model performance on mxfp4 run (#10008) · e9697374

kk authored Sep 05, 2025


Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>

e9697374

03 Sep, 2025 2 commits
- Revert "Optimized deepseek-v3/r1 model performance on mxfp4 run (#9671)" (#9959) · 1b2ff4fb
  Yineng Zhang authored Sep 03, 2025
  
  1b2ff4fb
- Optimized deepseek-v3/r1 model performance on mxfp4 run (#9671) · 0dfd54d1
  kk authored Sep 03, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: wghuang <wghuang@amd.com>
```
  0dfd54d1
02 Sep, 2025 1 commit
- Move multi-tokenizer event loop to better place (#9902) · a25e8e42
  Shangming Cai authored Sep 02, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  a25e8e42
01 Sep, 2025 1 commit

Support Multi Process Tokenizer Manager(#6555) (#8964) · 5f77e129

ybyang authored Sep 01, 2025


Signed-off-by: ybyang <ybyang7@iflytek.com>
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>
Co-authored-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>

5f77e129

27 Aug, 2025 2 commits
- Fix get_ip when no external network (#9700) · fd18995c
  ybyang authored Aug 28, 2025
  
  fd18995c
- move is_sm90_supported/is_sm100_supported to python/sglang/srt/utils.py (#9679) · fd71b11b
  Lianmin Zheng authored Aug 27, 2025
  
  fd71b11b
26 Aug, 2025 1 commit
- [RL] fix register the same ops multiple times (#9564) · a530b3ff
  Stefan He authored Aug 26, 2025
  
  a530b3ff
25 Aug, 2025 1 commit
- remove redundant rank0_log function. (#9560) · a0b22f2f
  miter authored Aug 25, 2025
```
Co-authored-by: linhuang <linhuang@ruijie.com.cn>
```
  a0b22f2f
23 Aug, 2025 2 commits
- Overlapped weight offload (#8034) · 2600fc0d
  fzyzcjy authored Aug 23, 2025
  
  2600fc0d
- Support GC Freezing to improve latency & throughput (#9241) · 127d4b0d
  Chanh Nguyen authored Aug 22, 2025
```
Co-authored-by: Chanh Nguyen <cnguyen@linkedin.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
```
  127d4b0d
21 Aug, 2025 1 commit
- Refactor weight offloading logic (#8521) · 55d336cb
  fzyzcjy authored Aug 21, 2025
  
  55d336cb
17 Aug, 2025 3 commits
- Set the default attention backend for GLM-4.5v to fa3 (#9245) · 84b30d9e
  zifeitong authored Aug 17, 2025
  
  84b30d9e
- [chore] Clean up redundant lora_weight_names concept to simplify code (#9131) · 4b74c3fc
  Lifu Huang authored Aug 17, 2025
  
  4b74c3fc
- model: support nvidia/Llama-3_3-Nemotron-Super-49B-v1 (#9067) · 845d12a9
  Netanel Haber authored Aug 17, 2025
```
Co-authored-by: Kyle Huang <kylhuang@nvidia.com>
```
  845d12a9
15 Aug, 2025 1 commit
- [6/N] MoE Refactor: Cleanup MoE-related configs (#8849) · 29589512
  Cheng Wan authored Aug 14, 2025
  
  29589512
12 Aug, 2025 1 commit
- Fix race condition in async lora unload (#9084) · 5ded39ca
  Lifu Huang authored Aug 11, 2025
  
  5ded39ca
09 Aug, 2025 1 commit

Support glm4.1v and glm4.5v (#8798) · f29aba8c

Binyao Jiang authored Aug 09, 2025


Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
Co-authored-by: Chang Su <csu272@usc.edu>

f29aba8c

08 Aug, 2025 3 commits
- Revert "Support Multi Process Tokenizer Manager" (#8960) · a9471542
  Lianmin Zheng authored Aug 08, 2025
  
  a9471542
- Support Multi Process Tokenizer Manager (#6555) · 7490e3f6
  ybyang authored Aug 08, 2025
```
Signed-off-by: ybyang <ybyang7@iflytek.com>
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: lw9527 <952799980@qq.com>
Co-authored-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>
```
  7490e3f6
- Expert Parallelism for GPT-OSS (#8944) · 1d24db83
  Cheng Wan authored Aug 08, 2025
  
  1d24db83
06 Aug, 2025 2 commits

Support v1/responses and use harmony in serving_chat (#8837) · 92cc32d9

Chang Su authored Aug 06, 2025


Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>

92cc32d9

Support mxfp4 for GPT-OSS (#8843) · 168033d5

Ying Sheng authored Aug 06, 2025


Co-authored-by: Co-author fzyzcjy <ch271828n@outlook.com>
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
Co-authored-by: zhuofan1123 <zhuofanl@nvidia.com>
Co-authored-by: liz-badada <jinyanc@nvidia.com>
Co-authored-by: xutizhou <xutingz@nvidia.com>
Co-authored-by: linhu-nv <linhu@nvidia.com>

168033d5

05 Aug, 2025 2 commits
- [feat] Add detail in image_data (#8596) · 873f384a
  Yuhao Yao authored Aug 05, 2025
  
  873f384a
- Support OCP MXFP4 quantization on AMD GPUs (#8255) · d4bf5a85
  kk authored Aug 05, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
```
  d4bf5a85
03 Aug, 2025 1 commit

[Improvements] Merge health check route (#8444) · 6f9baf10

ybyang authored Aug 03, 2025


Signed-off-by: ybyang <ybyang7@iflytek.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Kan Wu <wukanustc@gmail.com>

6f9baf10

01 Aug, 2025 1 commit
- [5/N] MoE Refactor: Update MoE parallelism arguments (#8658) · 6c88f6c8
  Cheng Wan authored Aug 01, 2025
  
  6c88f6c8
31 Jul, 2025 1 commit
- Update step3v default config (#8626) · 8fbcfd07
  Ke Bao authored Aug 01, 2025
  
  8fbcfd07
28 Jul, 2025 1 commit

GLM-4.5 Model Support (#8224) · 6d6a8bc2

Yuxuan Zhang authored Jul 28, 2025


Co-authored-by: Lifu Huang <lifu.hlf@gmail.com>
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>

6d6a8bc2

27 Jul, 2025 2 commits
- Support overlapped lora updates (#8213) · df906455
  Lifu Huang authored Jul 27, 2025
  
  df906455
- fix: fix the missing metrics on non-rank0 nodes (#7720) · 36d6f0ba
  Yingchun Lai authored Jul 27, 2025
  
  36d6f0ba
25 Jul, 2025 3 commits
- Clean up server_args, triton cache manager (#8332) · ed2e313e
  Lianmin Zheng authored Jul 25, 2025
  
  ed2e313e
- [P/D] Support ipv6 in P/D scenario (#7858) · 1b9cea5a
  Stepan Kargaltsev authored Jul 25, 2025
```
Co-authored-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  1b9cea5a
- fix: Fix failed functional tests https://github.com/meta-llama/llama-stack-evals (#8266) · 7ad6b766
  Ying Wang authored Jul 24, 2025
  
  7ad6b766
20 Jul, 2025 2 commits
- Revert "[Feature] Simple Improve Health Check Mechanism for Production-Grade Stability" (#8181) · 55381a46
  Lianmin Zheng authored Jul 19, 2025
  
  55381a46
- [Feature] Simple Improve Health Check Mechanism for Production-Grade Stability (#8115) · 4540a466
  ybyang authored Jul 20, 2025
```
Signed-off-by: ybyang <ybyang7@iflytek.com>
```
  4540a466
19 Jul, 2025 1 commit
- Support start up LoRA server without initial adapters (#8019) · 4e3defe5
  Lifu Huang authored Jul 19, 2025
  
  4e3defe5