Commits · 24f7cb1ece69d079dd2b1486b480f5169d8ff824 · change / sglang

"monkey_model/text_monkey/README.md" did not exist on "ab58e6f09408947868a973f891f20cb9249c3b94"

29 Sep, 2025 2 commits
- [speculative decoding] rename lookahead to ngram (#11010) · 24f7cb1e
  Zhihao Zhang authored Sep 29, 2025
```
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
```
  24f7cb1e
- [HiCacheStorage] mooncake store support page_first_direct layout (#10591) · e05555fa
  huangtingwei authored Sep 29, 2025
  
  e05555fa
28 Sep, 2025 1 commit
- fix: show failed models in nightly ci (#10986) · 2e763398
  Mick authored Sep 29, 2025
  
  2e763398
27 Sep, 2025 1 commit
- Use jsonschema to constrain required or specific tool choice (#10550) · 8cc27fdc
  Tejesh Anand authored Sep 27, 2025
  
  8cc27fdc
26 Sep, 2025 4 commits
- ci: refactor nightly test (#10495) · 777eb538
  Mick authored Sep 27, 2025
  
  777eb538
- ci: fix rate-limit of huggingface with hf auth login (#10947) · fff7fbab
  Mick authored Sep 27, 2025
  
  fff7fbab
- [PD-HiCache]: Support Async Offloading KVCache In Decode Side (#10192) · 7ec5b4e8
  hzh0425 authored Sep 26, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  7ec5b4e8
- Replace the Kimi-K2 generated tool call idx with history tool call count (#10612) · 0ac61146
  eraser00 authored Sep 26, 2025
```
Co-authored-by: eraser00 <eraser00@github.com>
```
  0ac61146
25 Sep, 2025 2 commits
- Rename customer label -> custom label (#10899) · f68dd998
  Lianmin Zheng authored Sep 25, 2025
```
Co-authored-by: Yingchun Lai <laiyingchun@apache.org>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  f68dd998
- [minor] Remove deprecated function `get_ip` (#10883) · 35ec2a45
  Lianmin Zheng authored Sep 25, 2025
  
  35ec2a45
24 Sep, 2025 3 commits
- chore: Initial support for input config files (#10534) · d7b20dd6
  kushanam authored Sep 24, 2025
```
Co-authored-by: root <root@umbriel-b200-017.ipp4a1.colossus.nvidia.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  d7b20dd6
- feat: add cache_salt support to request (#10718) · 71f24ef8
  Xinyuan Tong authored Sep 23, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  71f24ef8
- Add CI timeout guidelines (#10829) · b1f0fc1c
  Lianmin Zheng authored Sep 23, 2025
  
  b1f0fc1c
23 Sep, 2025 3 commits
- Fix latest main ci (#10799) · 23632d35
  Shangming Cai authored Sep 24, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  23632d35
- Fix hicache mooncake backend CI (#10792) · d21c3522
  Shangming Cai authored Sep 23, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  d21c3522
- [Feature] Add MLAProcess for DeepSeek MLA on NPU (#10130) · d27a6f70
  Even Zhou authored Sep 23, 2025
  
  d27a6f70
22 Sep, 2025 4 commits
- [Generative Score API] Added test_scores_api.py to github CICD to run per commit (#10755) · 2f555c4c
  Vedant Jhaveri authored Sep 22, 2025
```
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
Co-authored-by: Sundara Raman Ramachandran <sundar24295@gmail.com>
```
  2f555c4c
- Fix CI TestChunkedSGMV (#10737) · 2101d93b
  Lifu Huang authored Sep 22, 2025
  
  2101d93b
- Fix flaky logprobs test (#10728) · 70e4b218
  Shangming Cai authored Sep 22, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  70e4b218
- fix: disable gpt-oss b200 ut (#10716) · 2f18602f
  Yineng Zhang authored Sep 21, 2025
  
  2f18602f
21 Sep, 2025 2 commits
- Refactors radix cache for extra key support (#10317) · 12d6cf18
  Xinyuan Tong authored Sep 21, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  12d6cf18
- [3/4] Speed up CSGMV backend perf by 10% through dynamic chunking + kernel optimization (#10592) · 08ecd0aa
  Lifu Huang authored Sep 20, 2025
  
  08ecd0aa
20 Sep, 2025 1 commit
- fix: update run_suite (#10685) · ba94b829
  Yineng Zhang authored Sep 20, 2025
  
  ba94b829
19 Sep, 2025 1 commit
- [HiCacheStorage]support page_first_direct layout for generic set&get (#10522) · 7f399e4b
  huangtingwei authored Sep 19, 2025
  
  7f399e4b
18 Sep, 2025 3 commits
- [Feature] Speculative decoding support lookahead (#9873) · e7bc6003
  Zhihao Zhang authored Sep 19, 2025
```
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
```
  e7bc6003
- feat: Add FlexAttention Backend for Efficient Sparse Attention (#9947) · 9a5c42f9
  yuk.igalaxy authored Sep 19, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  9a5c42f9
- [RL] Add destroy process group api (#9979) · 93f75778
  penguin_wwy authored Sep 19, 2025
  
  93f75778
17 Sep, 2025 3 commits
- fix: update dsv3 fp4 ut (#10584) · 56405076
  Yineng Zhang authored Sep 17, 2025
  
  56405076
- [HiCache] Add tests for hicache storage mooncake backend (#10171) · 77098aea
  Teng Ma authored Sep 18, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  77098aea
- feat: add priority based scheduling with priority based request acceptance and preemption (#8746) · 14fdd527
  harrisonlimh authored Sep 16, 2025
  
  14fdd527
16 Sep, 2025 1 commit

Add Logprobs unit test with a loose threshold (#10230) · f1c692f6

Night authored Sep 16, 2025


Co-authored-by: Yusheng Su <yushengsu.thu@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Ryan <ryan@ryanmini.mynetworksettings.com>

f1c692f6

15 Sep, 2025 7 commits
- [2/2] Introduce Chunked-SGMV kernels and corresponding LoRA backend for... · 3f41b48c
  Lifu Huang authored Sep 15, 2025
```
[2/2] Introduce Chunked-SGMV kernels and corresponding LoRA backend for improved performance (#10286)
```
  3f41b48c
- [1/2] Speed up trtllm_mla attention backend (>10% e2e) (#10473) · 3b25dc12
  fzyzcjy authored Sep 16, 2025
  
  3b25dc12
- model: support solar (#8189) · a45d9a4e
  Praneth Paruchuri authored Sep 15, 2025
  
  a45d9a4e
- Run tests based on labels (#10456) · 50dc0c1e
  Lianmin Zheng authored Sep 15, 2025
  
  50dc0c1e
- [router]: Add Embedding routing logic (#10129) · f9ee6ae1
  Jintao Zhang authored Sep 15, 2025
```
Signed-off-by: Jintao Zhang <zhangjintao9020@gmail.com>
Co-authored-by: Waël Boukhobza <wawa_wael@live.fr>
```
  f9ee6ae1
- feat: add dsv3 fp4 cutlass moe etp ut (#10433) · dcee42c2
  Yineng Zhang authored Sep 14, 2025
  
  dcee42c2
- [Fix] MoE: fix w8a8_fp8 MoE and add tests to cover this code path (#10429) · 2f8ba6fe
  Cheng Wan authored Sep 14, 2025
  
  2f8ba6fe
14 Sep, 2025 1 commit

[Feature] Sglang Tracing: Fine-Grained Tracking for Request Latency - Part 1 (#9962) · 4c21b090

Feng Su authored Sep 15, 2025


Signed-off-by: Feng Su <sufeng@linux.alibaba.com>
Signed-off-by: Huaixin Chang <changhuaixin@linux.alibaba.com>
Signed-off-by: Peng Wang <rocking@linux.alibaba.com>

4c21b090

13 Sep, 2025 1 commit
- [Performance] Dynamic Batch Tokenizer (#9382) · 94d0f656
  Sundara Raman Ramachandran authored Sep 13, 2025
  
  94d0f656