Commits · 6a29003410315a84148c22d6f51cf36c94a1069a · zhaoyu6 / sglang · GitLab

02 Oct, 2025 2 commits
- Remove unused pack `.item()` in paged allocator. (#11156) · 6a290034
  Liangsheng Yin authored Oct 02, 2025
  
  6a290034
- Intoduce cpu tensor as metadata to avoid blocking gpu kernel launch (#10720) · 0b2aa8a7
  Zhang Junda authored Oct 02, 2025
```
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
```
  0b2aa8a7
30 Sep, 2025 1 commit
- [CPU] Adding Memory Capacity Acquisition Functionality (#11102) · 229d2b95
  Zaili Wang authored Sep 30, 2025
  
  229d2b95
29 Sep, 2025 1 commit
- Fix sgl-kernel benchmark dead code (#11022) · 11965b0d
  Xiaoyu Zhang authored Sep 29, 2025
  
  11965b0d
25 Sep, 2025 1 commit
- [minor] Remove deprecated function `get_ip` (#10883) · 35ec2a45
  Lianmin Zheng authored Sep 25, 2025
  
  35ec2a45
23 Sep, 2025 4 commits
- move `environ` into `sglang.srt` to avoid break SRT auto sync. (#10791) · 4a762041
  Liangsheng Yin authored Sep 23, 2025
  
  4a762041
- Move cached kernel to srt.utils (#10776) · 9241f4fd
  Lifu Huang authored Sep 22, 2025
  
  9241f4fd
- [Ascend]optimize Qwen3 on Ascend (#10574) · e22f3a5e
  ronnie_zheng authored Sep 23, 2025
```
Co-authored-by: c30031083 <chenxu140@huawei.com>
```
  e22f3a5e
- [Feature] Add MLAProcess for DeepSeek MLA on NPU (#10130) · d27a6f70
  Even Zhou authored Sep 23, 2025
  
  d27a6f70
19 Sep, 2025 1 commit
- [Feature]feat(get_ip): unify get_ip_xxx (#10081) · 56b991b1
  Jimmy authored Sep 19, 2025
  
  56b991b1
17 Sep, 2025 2 commits
- [Auto Sync] Update activation.py, chunk_cache.py, utils.py (20250917) (#10538) · f949ad57
  Lianmin Zheng authored Sep 16, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
```
  f949ad57
- [Auto Sync] Update scheduler_profiler_mixin.py, rpd_utils.p... (20250916) (#10494) · c49484a6
  Lianmin Zheng authored Sep 16, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
```
  c49484a6
16 Sep, 2025 1 commit
- Cache the result of `is_blackwell` platform check (#10498) · b2435be6
  b8zhong authored Sep 15, 2025
  
  b2435be6
15 Sep, 2025 2 commits
- [Env] minimal version for organizing envs (#10479) · c3c26f76
  Liangsheng Yin authored Sep 16, 2025
  
  c3c26f76
- [4/N]DP refactor: support watching mode `get_load` and shortest queue strategy (#10201) · 305c9e8c
  Liangsheng Yin authored Sep 15, 2025
  
  305c9e8c
12 Sep, 2025 1 commit

Support loading weights from remote instance (#8215) · 30d20ce8

amysaq2023 authored Sep 12, 2025


Signed-off-by: Anqi Shen <amy.saq@antgroup.com>
Co-authored-by: Chayenne <74843776+zhaochenyang20@users.noreply.github.com>

30d20ce8

11 Sep, 2025 1 commit
- [CPU] fix OOM when mem-fraction is not set (#9090) · ef959d7b
  Zaili Wang authored Sep 11, 2025
  
  ef959d7b
08 Sep, 2025 1 commit
- Add graph runner support with torch compile on CPU (#7843) · 7577f0e4
  Cao E authored Sep 08, 2025
  
  7577f0e4
05 Sep, 2025 1 commit
- Tiny support setting numa nodes for different ranks (#10006) · df97b31f
  fzyzcjy authored Sep 05, 2025
  
  df97b31f
04 Sep, 2025 1 commit

Optimized deepseek-v3/r1 model performance on mxfp4 run (#10008) · e9697374

kk authored Sep 05, 2025


Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>

e9697374

03 Sep, 2025 2 commits
- Revert "Optimized deepseek-v3/r1 model performance on mxfp4 run (#9671)" (#9959) · 1b2ff4fb
  Yineng Zhang authored Sep 03, 2025
  
  1b2ff4fb
- Optimized deepseek-v3/r1 model performance on mxfp4 run (#9671) · 0dfd54d1
  kk authored Sep 03, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: wghuang <wghuang@amd.com>
```
  0dfd54d1
02 Sep, 2025 1 commit
- Move multi-tokenizer event loop to better place (#9902) · a25e8e42
  Shangming Cai authored Sep 02, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  a25e8e42
01 Sep, 2025 1 commit

Support Multi Process Tokenizer Manager(#6555) (#8964) · 5f77e129

ybyang authored Sep 01, 2025


Signed-off-by: ybyang <ybyang7@iflytek.com>
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>
Co-authored-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>

5f77e129

27 Aug, 2025 2 commits
- Fix get_ip when no external network (#9700) · fd18995c
  ybyang authored Aug 28, 2025
  
  fd18995c
- move is_sm90_supported/is_sm100_supported to python/sglang/srt/utils.py (#9679) · fd71b11b
  Lianmin Zheng authored Aug 27, 2025
  
  fd71b11b
26 Aug, 2025 1 commit
- [RL] fix register the same ops multiple times (#9564) · a530b3ff
  Stefan He authored Aug 26, 2025
  
  a530b3ff
25 Aug, 2025 1 commit
- remove redundant rank0_log function. (#9560) · a0b22f2f
  miter authored Aug 25, 2025
```
Co-authored-by: linhuang <linhuang@ruijie.com.cn>
```
  a0b22f2f
23 Aug, 2025 2 commits
- Overlapped weight offload (#8034) · 2600fc0d
  fzyzcjy authored Aug 23, 2025
  
  2600fc0d
- Support GC Freezing to improve latency & throughput (#9241) · 127d4b0d
  Chanh Nguyen authored Aug 22, 2025
```
Co-authored-by: Chanh Nguyen <cnguyen@linkedin.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
```
  127d4b0d
21 Aug, 2025 1 commit
- Refactor weight offloading logic (#8521) · 55d336cb
  fzyzcjy authored Aug 21, 2025
  
  55d336cb
17 Aug, 2025 3 commits
- Set the default attention backend for GLM-4.5v to fa3 (#9245) · 84b30d9e
  zifeitong authored Aug 17, 2025
  
  84b30d9e
- [chore] Clean up redundant lora_weight_names concept to simplify code (#9131) · 4b74c3fc
  Lifu Huang authored Aug 17, 2025
  
  4b74c3fc
- model: support nvidia/Llama-3_3-Nemotron-Super-49B-v1 (#9067) · 845d12a9
  Netanel Haber authored Aug 17, 2025
```
Co-authored-by: Kyle Huang <kylhuang@nvidia.com>
```
  845d12a9
15 Aug, 2025 1 commit
- [6/N] MoE Refactor: Cleanup MoE-related configs (#8849) · 29589512
  Cheng Wan authored Aug 14, 2025
  
  29589512
12 Aug, 2025 1 commit
- Fix race condition in async lora unload (#9084) · 5ded39ca
  Lifu Huang authored Aug 11, 2025
  
  5ded39ca
09 Aug, 2025 1 commit

Support glm4.1v and glm4.5v (#8798) · f29aba8c

Binyao Jiang authored Aug 09, 2025


Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
Co-authored-by: Chang Su <csu272@usc.edu>

f29aba8c

08 Aug, 2025 3 commits
- Revert "Support Multi Process Tokenizer Manager" (#8960) · a9471542
  Lianmin Zheng authored Aug 08, 2025
  
  a9471542
- Support Multi Process Tokenizer Manager (#6555) · 7490e3f6
  ybyang authored Aug 08, 2025
```
Signed-off-by: ybyang <ybyang7@iflytek.com>
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: lw9527 <952799980@qq.com>
Co-authored-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>
```
  7490e3f6
- Expert Parallelism for GPT-OSS (#8944) · 1d24db83
  Cheng Wan authored Aug 08, 2025
  
  1d24db83