Commits · 03d114496f9114cc11b1371cd344c7774e8b078e · change / sglang · GitLab

12 Aug, 2025 28 commits
- Fix typos in supported models documentation (#9119) · 03d11449
  Hangzhi authored Aug 12, 2025
  
  03d11449
- [Quantization] Supported w8a8 int8 quantized Gemma3 and Qwen-VL models (#8619) · 83123f48
  ichernob authored Aug 12, 2025
```
Co-authored-by: ronnie_zheng <zl19940307@163.com>
```
  83123f48
- [feat] Enable Ascend profiling on SGLang (#8610) · 48afa8f1
  ronnie_zheng authored Aug 13, 2025
```
Co-authored-by: liyou_b <2953090824@qq.com>
```
  48afa8f1
- [feat] add ascend readme and docker release (#8700) · 2ecbd8b8
  li chaoran authored Aug 13, 2025
```
Signed-off-by: mywaaagh_admin <pkwarcraft@gmail.com>
Signed-off-by: lichaoran <pkwarcraft@gmail.com>
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
```
  2ecbd8b8
- fix: update Dockerfile (#9125) · 305b27c1
  Yineng Zhang authored Aug 12, 2025
  
  305b27c1
- [router] update router documentation (#9121) · 1ce30dd1
  Simo Lin authored Aug 12, 2025
  
  1ce30dd1
- Fuse writing KV buffer into rope kernel (part 2: srt) (#9014) · c9ee7385
  Jiaqi Gu authored Aug 12, 2025
```
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
```
  c9ee7385
- fix(docker): update sgl_kernel version to 0.3.4 in Dockerfile.gb200 (#9118) · 1f9ec653
  ishandhanani authored Aug 12, 2025
  
  1f9ec653
- router: Fix user guide link README.md (#9122) · ad359d1c
  Chang Su authored Aug 12, 2025
  
  ad359d1c
- [5/n] DP Enhancement: Correct `num_token_non_padded` (#9107) · 5f5b3b24
  Cheng Wan authored Aug 12, 2025
  
  5f5b3b24
- Fix typo in REVIEWERS (#9113) · 4caca4f6
  Shangming Cai authored Aug 13, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  4caca4f6
- [Bugfix] Fix accuracy-test-1-gpu failure caused by `builtin_tools` (#9114) · f2a5de28
  Chang Su authored Aug 12, 2025
  
  f2a5de28
- Runtime check CUDA driver version to avoid unresolved green context symbols (#9021) · 445f9dca
  Liangsheng Yin authored Aug 12, 2025
  
  445f9dca
- chore: bump sgl-kernel v0.3.4 (#9103) · 3a9afe2a
  Yineng Zhang authored Aug 12, 2025
  
  3a9afe2a
- Fuse writing KV buffer into rope kernel (part 1: sgl-kernel) (#9077) · 9aea2555
  fzyzcjy authored Aug 12, 2025
  
  9aea2555
- update support new models doc (#9096) · fcc11e5e
  Yichao Cheng authored Aug 12, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  fcc11e5e
- Fuse two kernels of hidden states padding into quantization kernel (#9005) · 5190ba7f
  fzyzcjy authored Aug 12, 2025
```
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
```
  5190ba7f
- docs: fix broken links in README.md (#9075) · 5438886c
  Hsiang-Yu Tsou authored Aug 12, 2025
  
  5438886c
- bugfix: Fix the commentary msg extraction in GptOssDetector (#9097) · 9c83d74d
  Chang Su authored Aug 11, 2025
  
  9c83d74d
- [Fix] Fix dual chunk model default behavior (#9032) · b4ac2b9c
  DarkSharpness authored Aug 11, 2025
  
  b4ac2b9c
- Fix mismatch between padded_scales shape and reshape dimensions in modelopt quantization (#8766) · 83262dcb
  Jianwei Dong authored Aug 12, 2025
  
  83262dcb
- feat: add fused moe config for Qwen3-30B-A3B on B200 (#9087) · c46c75f8
  zixuanzhang226 authored Aug 11, 2025
  
  c46c75f8
- Optimization for AscendPagedTokenToKVPoolAllocator (#8293) · 2aaf22c4
  Makcum888e authored Aug 12, 2025
```
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: VDV1985 <vladdv85@mail.ru>
```
  2aaf22c4
- Fix broken CI TestRequestLengthValidation (#9095) · 29a610b4
  Lifu Huang authored Aug 11, 2025
  
  29a610b4
- Fix race condition in async lora unload (#9084) · 5ded39ca
  Lifu Huang authored Aug 11, 2025
  
  5ded39ca
- [CI] migrate router to BM.A10.4 runner (#8992) · 4093d460
  Keyang Ru authored Aug 11, 2025
```
Co-authored-by: key4ng <rukeyang@gamil.com>
```
  4093d460
- [router] Add Rust Binary Entrypoint for SGLang Router (#9089) · 9d68bdb2
  Simo Lin authored Aug 11, 2025
  
  9d68bdb2
- (gpt-oss, oai, chat): Remove Harmony Integration and Implement Native GPT-OSS... · a2184901
  Chang Su authored Aug 11, 2025
```
(gpt-oss, oai, chat): Remove Harmony Integration and Implement Native GPT-OSS Tool Call Support (#9043)
```
  a2184901
11 Aug, 2025 12 commits
- HiCache, add bench long context plus minor fixs (#9086) · 0eec4cb6
  Zhiqiang Xie authored Aug 11, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  0eec4cb6
- [fix] Set Radix tree root node hash to None - Nvidia Dynamo Integration (#9030) · ff1f6825
  Faradawn Yang authored Aug 11, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  ff1f6825
- HiCache Storage: generate hash when inserting new nodes (#9053) · 9f78f391
  Zhiqiang Xie authored Aug 11, 2025
  
  9f78f391
- TRTLLM-MLA FP8 path (#8638) · f508cd3c
  Faraz authored Aug 11, 2025
```
Signed-off-by: Faraz Khoubsirat <58580514+farazkh80@users.noreply.github.com>
```
  f508cd3c
- fuse allreduce and residual_rmsnorm (#8731) · 44e86480
  Xiaoyu Zhang authored Aug 12, 2025
  
  44e86480
- Update hyperparameter_tuning.md (#9083) · 8c07fabd
  Lianmin Zheng authored Aug 11, 2025
  
  8c07fabd
- fix: w4afp8 accuracy problem and rebase (#8752) · 90f44b74
  SijiaYang authored Aug 12, 2025
```
Signed-off-by: yangsijia.614 <yangsijia.614@bytedance.com>
Co-authored-by: Jinwu <ayrnb@users.noreply.github.com>
```
  90f44b74
- refactor(pd-router): extract common patterns to reduce code duplication (#9081) · 38907fe6
  Simo Lin authored Aug 11, 2025
  
  38907fe6
- Fix docs for clip max new tokens (#9082) · f9afa7dc
  Liangsheng Yin authored Aug 11, 2025
  
  f9afa7dc
- [PD]decode: add CLIP_MAX_NEW_TOKEN for pop_preallocated (#8866) · 0d9e89ec
  Jimmy authored Aug 12, 2025
  
  0d9e89ec
- Fix broken Kimi models HuggingFace link (#9080) · 3d64fda3
  Hangzhi authored Aug 11, 2025
  
  3d64fda3
- Fix chunked prefill size validation for disabled state (#8973) · 3bffe112
  633WHU authored Aug 12, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  3bffe112