Commits · d17986f8c6b50e8acc97ad8fc0a965d8ef70a30e · change / sglang · GitLab

30 Sep, 2025 1 commit
- Enable optional FP32 compute for LM Head (#10729) · d17986f8
  narutolhy authored Sep 29, 2025
```
Thanks to MiniMax Team and Chenyang Zhao's support.
```
  d17986f8
29 Sep, 2025 2 commits
- Use more general heuristics to set the default value of --mem-fraction-static (#10975) · a17e70f5
  Lianmin Zheng authored Sep 29, 2025
```
Co-authored-by: sglang-bot <sglangbot@gmail.com>
```
  a17e70f5
- [speculative decoding] rename lookahead to ngram (#11010) · 24f7cb1e
  Zhihao Zhang authored Sep 29, 2025
```
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
```
  24f7cb1e
27 Sep, 2025 1 commit
- Use jsonschema to constrain required or specific tool choice (#10550) · 8cc27fdc
  Tejesh Anand authored Sep 27, 2025
  
  8cc27fdc
26 Sep, 2025 2 commits
- ci: refactor nightly test (#10495) · 777eb538
  Mick authored Sep 27, 2025
  
  777eb538
- ci: fix rate-limit of huggingface with hf auth login (#10947) · fff7fbab
  Mick authored Sep 27, 2025
  
  fff7fbab
24 Sep, 2025 1 commit
- Add CI timeout guidelines (#10829) · b1f0fc1c
  Lianmin Zheng authored Sep 23, 2025
  
  b1f0fc1c
23 Sep, 2025 1 commit
- Fix latest main ci (#10799) · 23632d35
  Shangming Cai authored Sep 24, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  23632d35
22 Sep, 2025 2 commits
- [Generative Score API] Added test_scores_api.py to github CICD to run per commit (#10755) · 2f555c4c
  Vedant Jhaveri authored Sep 22, 2025
```
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
Co-authored-by: Sundara Raman Ramachandran <sundar24295@gmail.com>
```
  2f555c4c
- fix: disable gpt-oss b200 ut (#10716) · 2f18602f
  Yineng Zhang authored Sep 21, 2025
  
  2f18602f
21 Sep, 2025 1 commit
- Refactors radix cache for extra key support (#10317) · 12d6cf18
  Xinyuan Tong authored Sep 21, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  12d6cf18
20 Sep, 2025 1 commit
- fix: update run_suite (#10685) · ba94b829
  Yineng Zhang authored Sep 20, 2025
  
  ba94b829
18 Sep, 2025 1 commit
- [Feature] Speculative decoding support lookahead (#9873) · e7bc6003
  Zhihao Zhang authored Sep 19, 2025
```
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
```
  e7bc6003
17 Sep, 2025 2 commits
- [HiCache] Add tests for hicache storage mooncake backend (#10171) · 77098aea
  Teng Ma authored Sep 18, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  77098aea
- feat: add priority based scheduling with priority based request acceptance and preemption (#8746) · 14fdd527
  harrisonlimh authored Sep 16, 2025
  
  14fdd527
16 Sep, 2025 1 commit

Add Logprobs unit test with a loose threshold (#10230) · f1c692f6

Night authored Sep 16, 2025


Co-authored-by: Yusheng Su <yushengsu.thu@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Ryan <ryan@ryanmini.mynetworksettings.com>

f1c692f6

15 Sep, 2025 2 commits
- [2/2] Introduce Chunked-SGMV kernels and corresponding LoRA backend for... · 3f41b48c
  Lifu Huang authored Sep 15, 2025
```
[2/2] Introduce Chunked-SGMV kernels and corresponding LoRA backend for improved performance (#10286)
```
  3f41b48c
- Run tests based on labels (#10456) · 50dc0c1e
  Lianmin Zheng authored Sep 15, 2025
  
  50dc0c1e
12 Sep, 2025 3 commits
- feat: add deepseek v3 fp4 ut (#10391) · 9d775b1a
  Yineng Zhang authored Sep 12, 2025
  
  9d775b1a
- add qwen3-next ut (#10355) · fe6cdf89
  Yi Zhang authored Sep 12, 2025
  
  fe6cdf89
- Support loading weights from remote instance (#8215) · 30d20ce8
  amysaq2023 authored Sep 12, 2025
```
Signed-off-by: Anqi Shen <amy.saq@antgroup.com>
Co-authored-by: Chayenne <74843776+zhaochenyang20@users.noreply.github.com>
```
  30d20ce8
11 Sep, 2025 1 commit
- [Feature] Support DeepEP normal & Redundant Experts on NPU (#9881) · 5b64f006
  Even Zhou authored Sep 11, 2025
  
  5b64f006
10 Sep, 2025 1 commit
- Add tests to AMD CI for MI35x (#9662) · 91b3555d
  Hubert Lu authored Sep 10, 2025
```
Co-authored-by: Sai Enduri <saimanas.enduri@amd.com>
```
  91b3555d
08 Sep, 2025 4 commits
- [Hicache]: Add E2E CI For 3FS-KVStore (#10131) · ec99668a
  hzh0425 authored Sep 08, 2025
  
  ec99668a
- [Bugfix] Qwen3MoE aclrtMemcpy failed with NPUGraph (#10013) · b67c277f
  Even Zhou authored Sep 08, 2025
  
  b67c277f
- Add graph runner support with torch compile on CPU (#7843) · 7577f0e4
  Cao E authored Sep 08, 2025
  
  7577f0e4
- Standalone speculative decoding (#10090) · 8cda5a62
  Qiaolin Yu authored Sep 07, 2025
  
  8cda5a62
06 Sep, 2025 2 commits
- [CI] Refactor disaggregation tests (#10068) · 00974e4f
  Shangming Cai authored Sep 06, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  00974e4f
- support Llama4 with non uniformed intermediate size across layers for… (#10047) · ab62b135
  gongwei-130 authored Sep 05, 2025
  
  ab62b135
04 Sep, 2025 3 commits
- metrics: support customer buckets for prompt/generation_tokens_histogram (#9634) · b32ab070
  Yingchun Lai authored Sep 04, 2025
  
  b32ab070
- feat(hicache): Add generic hicache ci e2e test and benchmark test (#9846) · 106c2b31
  hzh0425 authored Sep 04, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  106c2b31
- feat: add gpt oss b200 ci (#9988) · de921733
  Yineng Zhang authored Sep 03, 2025
  
  de921733
01 Sep, 2025 1 commit

Support Multi Process Tokenizer Manager(#6555) (#8964) · 5f77e129

ybyang authored Sep 01, 2025


Signed-off-by: ybyang <ybyang7@iflytek.com>
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>
Co-authored-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>

5f77e129

29 Aug, 2025 1 commit

feat: add original logprobs to response (#8375) · 839c93bd

narutolhy authored Aug 29, 2025


Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: luhongyu.4869 <luhongyu.4869@bytedance.com>

839c93bd

28 Aug, 2025 1 commit
- [AMD] Support Hierarchical Caching on AMD GPUs (#8236) · 711390a9
  Hubert Lu authored Aug 28, 2025
  
  711390a9
26 Aug, 2025 1 commit
- [new feat] ascend backend support fia fusion kernel (#8328) · f92b729d
  ZhengdQin authored Aug 26, 2025
```
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
```
  f92b729d
25 Aug, 2025 1 commit

Fix Harmony reasoning parser for and auto-separation for gpt-oss models (#9190) · a0a77d93

Jonas authored Aug 26, 2025


Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com>
Co-authored-by: minleminzui <2969413251@qq.com>
Co-authored-by: maocheng23 <maocheng@berkeley.edu>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>

a0a77d93

21 Aug, 2025 1 commit

[feature] Ascend NPU graph support (#9399) · 2c4b4b78

VDV1985 authored Aug 21, 2025


Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: yezhifeng (D) <y00897525@china.huawei.com>
Co-authored-by: anon189Ty <Stari_Falcon@outlook.com>
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>

2c4b4b78

20 Aug, 2025 2 commits

Revert "[feature] Rework Ascend NPU graph support" (#9385) · de2dd738
Even Zhou authored Aug 20, 2025

de2dd738

[feature] Rework Ascend NPU graph support (#9350) · 3680d6f8

Even Zhou authored Aug 20, 2025


Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: yezhifeng (D) <y00897525@china.huawei.com>
Co-authored-by: anon189Ty <Stari_Falcon@outlook.com>
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>

3680d6f8