Commits · 25e7dbe8af835953bc63e55f0fc4eb0aa8aa1900 · change / sglang

02 Oct, 2025 1 commit
- Fix ngram spec with page size > 1 (#11135) · 25e7dbe8
  Liangsheng Yin authored Oct 02, 2025
  
  25e7dbe8
01 Oct, 2025 2 commits
- Refactor AMD CI. (#11128) · 195a59fe
  Sai Enduri authored Oct 01, 2025
  
  195a59fe
- Organize spec-related data structures (#10735) · 73d4a5f8
  Liangsheng Yin authored Oct 01, 2025
  
  73d4a5f8
30 Sep, 2025 2 commits
- Fix eagle radix cache (#10846) · 91847e38
  Ke Bao authored Sep 30, 2025
  
  91847e38
- Enable optional FP32 compute for LM Head (#10729) · d17986f8
  narutolhy authored Sep 29, 2025
```
Thanks to MiniMax Team and Chenyang Zhao's support.
```
  d17986f8
29 Sep, 2025 4 commits
- Fix mem fraction static for nightly tests (#11076) · dda34c2f
  Lianmin Zheng authored Sep 29, 2025
  
  dda34c2f
- Use more general heuristics to set the default value of --mem-fraction-static (#10975) · a17e70f5
  Lianmin Zheng authored Sep 29, 2025
```
Co-authored-by: sglang-bot <sglangbot@gmail.com>
```
  a17e70f5
- [speculative decoding] rename lookahead to ngram (#11010) · 24f7cb1e
  Zhihao Zhang authored Sep 29, 2025
```
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
```
  24f7cb1e
- [HiCacheStorage] mooncake store support page_first_direct layout (#10591) · e05555fa
  huangtingwei authored Sep 29, 2025
  
  e05555fa
28 Sep, 2025 1 commit
- fix: show failed models in nightly ci (#10986) · 2e763398
  Mick authored Sep 29, 2025
  
  2e763398
27 Sep, 2025 1 commit
- Use jsonschema to constrain required or specific tool choice (#10550) · 8cc27fdc
  Tejesh Anand authored Sep 27, 2025
  
  8cc27fdc
26 Sep, 2025 4 commits
- ci: refactor nightly test (#10495) · 777eb538
  Mick authored Sep 27, 2025
  
  777eb538
- ci: fix rate-limit of huggingface with hf auth login (#10947) · fff7fbab
  Mick authored Sep 27, 2025
  
  fff7fbab
- [PD-HiCache]: Support Async Offloading KVCache In Decode Side (#10192) · 7ec5b4e8
  hzh0425 authored Sep 26, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  7ec5b4e8
- Replace the Kimi-K2 generated tool call idx with history tool call count (#10612) · 0ac61146
  eraser00 authored Sep 26, 2025
```
Co-authored-by: eraser00 <eraser00@github.com>
```
  0ac61146
25 Sep, 2025 2 commits
- Rename customer label -> custom label (#10899) · f68dd998
  Lianmin Zheng authored Sep 25, 2025
```
Co-authored-by: Yingchun Lai <laiyingchun@apache.org>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  f68dd998
- [minor] Remove deprecated function `get_ip` (#10883) · 35ec2a45
  Lianmin Zheng authored Sep 25, 2025
  
  35ec2a45
24 Sep, 2025 3 commits
- chore: Initial support for input config files (#10534) · d7b20dd6
  kushanam authored Sep 24, 2025
```
Co-authored-by: root <root@umbriel-b200-017.ipp4a1.colossus.nvidia.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  d7b20dd6
- feat: add cache_salt support to request (#10718) · 71f24ef8
  Xinyuan Tong authored Sep 23, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  71f24ef8
- Add CI timeout guidelines (#10829) · b1f0fc1c
  Lianmin Zheng authored Sep 23, 2025
  
  b1f0fc1c
23 Sep, 2025 3 commits
- Fix latest main ci (#10799) · 23632d35
  Shangming Cai authored Sep 24, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  23632d35
- Fix hicache mooncake backend CI (#10792) · d21c3522
  Shangming Cai authored Sep 23, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  d21c3522
- [Feature] Add MLAProcess for DeepSeek MLA on NPU (#10130) · d27a6f70
  Even Zhou authored Sep 23, 2025
  
  d27a6f70
22 Sep, 2025 4 commits
- [Generative Score API] Added test_scores_api.py to github CICD to run per commit (#10755) · 2f555c4c
  Vedant Jhaveri authored Sep 22, 2025
```
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
Co-authored-by: Sundara Raman Ramachandran <sundar24295@gmail.com>
```
  2f555c4c
- Fix CI TestChunkedSGMV (#10737) · 2101d93b
  Lifu Huang authored Sep 22, 2025
  
  2101d93b
- Fix flaky logprobs test (#10728) · 70e4b218
  Shangming Cai authored Sep 22, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  70e4b218
- fix: disable gpt-oss b200 ut (#10716) · 2f18602f
  Yineng Zhang authored Sep 21, 2025
  
  2f18602f
21 Sep, 2025 2 commits
- Refactors radix cache for extra key support (#10317) · 12d6cf18
  Xinyuan Tong authored Sep 21, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  12d6cf18
- [3/4] Speed up CSGMV backend perf by 10% through dynamic chunking + kernel optimization (#10592) · 08ecd0aa
  Lifu Huang authored Sep 20, 2025
  
  08ecd0aa
20 Sep, 2025 1 commit
- fix: update run_suite (#10685) · ba94b829
  Yineng Zhang authored Sep 20, 2025
  
  ba94b829
19 Sep, 2025 1 commit
- [HiCacheStorage]support page_first_direct layout for generic set&get (#10522) · 7f399e4b
  huangtingwei authored Sep 19, 2025
  
  7f399e4b
18 Sep, 2025 3 commits
- [Feature] Speculative decoding support lookahead (#9873) · e7bc6003
  Zhihao Zhang authored Sep 19, 2025
```
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
```
  e7bc6003
- feat: Add FlexAttention Backend for Efficient Sparse Attention (#9947) · 9a5c42f9
  yuk.igalaxy authored Sep 19, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  9a5c42f9
- [RL] Add destroy process group api (#9979) · 93f75778
  penguin_wwy authored Sep 19, 2025
  
  93f75778
17 Sep, 2025 3 commits
- fix: update dsv3 fp4 ut (#10584) · 56405076
  Yineng Zhang authored Sep 17, 2025
  
  56405076
- [HiCache] Add tests for hicache storage mooncake backend (#10171) · 77098aea
  Teng Ma authored Sep 18, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  77098aea
- feat: add priority based scheduling with priority based request acceptance and preemption (#8746) · 14fdd527
  harrisonlimh authored Sep 16, 2025
  
  14fdd527
16 Sep, 2025 1 commit

Add Logprobs unit test with a loose threshold (#10230) · f1c692f6

Night authored Sep 16, 2025


Co-authored-by: Yusheng Su <yushengsu.thu@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Ryan <ryan@ryanmini.mynetworksettings.com>

f1c692f6

15 Sep, 2025 2 commits
- [2/2] Introduce Chunked-SGMV kernels and corresponding LoRA backend for... · 3f41b48c
  Lifu Huang authored Sep 15, 2025
```
[2/2] Introduce Chunked-SGMV kernels and corresponding LoRA backend for improved performance (#10286)
```
  3f41b48c
- [1/2] Speed up trtllm_mla attention backend (>10% e2e) (#10473) · 3b25dc12
  fzyzcjy authored Sep 16, 2025
  
  3b25dc12