Commits · c3a5fb3b287f71affa691f3c68386a0d28942b4d · change / sglang · GitLab

07 Aug, 2025 19 commits
- codeowner updates for modelopt related files (#8925) · c3a5fb3b
  Zhiyu authored Aug 07, 2025
  
  c3a5fb3b
- fix: use openai 1.99.1 (#8927) · 4bf6e5a6
  Yineng Zhang authored Aug 07, 2025
  
  4bf6e5a6
- Fix hopper launch gpt-oss model illegal memory (#8908) · 3ae33fcd
  Xiaoyu Zhang authored Aug 08, 2025
  
  3ae33fcd
- [router] upgrade router version to 0.1.9 (#8844) · 500b15c9
  Simo Lin authored Aug 07, 2025
  
  500b15c9
- [router] update pd router ci summary step with new threshold (#8916) · 16a4c66d
  Simo Lin authored Aug 07, 2025
  
  16a4c66d
- [router] re-enable pd router benchmark CI (#8912) · 89e6521c
  Simo Lin authored Aug 07, 2025
  
  89e6521c
- refactor(sgl-router): Replace `once_cell` with `LazyLock` in worker.rs and... · fd05b567
  Tien Nguyen authored Aug 07, 2025
```
refactor(sgl-router): Replace `once_cell` with `LazyLock` in worker.rs and remove once_cell dependency from Cargo.toml (#8698)
```
  fd05b567
- Fix sgl-kernel arch and missing package in CI (#8869) · 482c3db2
  fzyzcjy authored Aug 07, 2025
  
  482c3db2
- [Perf] Auto enable best flashinfer mxfp4 kernel in b200 (#8898) · 47824c14
  Xiaoyu Zhang authored Aug 07, 2025
  
  47824c14
- Disable gemma3 for SWA due to CUDA illegal memory access error (#8895) · c36a6693
  Xinyuan Tong authored Aug 07, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  c36a6693
- [CPU] Fix fallback allgather issue (#8041) · 62f8eb48
  blzheng authored Aug 07, 2025
  
  62f8eb48
- [Feat] QWen-1M context support[2/2]: Update block sparse attention backend (#5949) · b7cd7430
  PGFLMG authored Aug 07, 2025
  
  b7cd7430
- [router] fix req handling order, improve serialization, remove retry (#8888) · a69b6370
  Simo Lin authored Aug 06, 2025
  
  a69b6370
- [Feature][Multimodal] Implement LRU cache for multimodal embeddings (#8292) · 2d120f8b
  Zheng Wengang authored Aug 07, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  2d120f8b
- [AMD] Pull latest SGLang version for AMD CI (#8787) · 4f2e1490
  michael-amd authored Aug 06, 2025
  
  4f2e1490
- Enables force reasoning based on chat template for Qwen3-Thinking (#8369) · 3fa3c6cd
  Xinyuan Tong authored Aug 06, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Chang Su <csu272@usc.edu>
```
  3fa3c6cd
- Support GPU pinning for LoRA (#8697) · 6210e2c4
  Lifu Huang authored Aug 06, 2025
  
  6210e2c4
- feat: openai oss attention sink support with trtllm-gen backend #8825 (#8834) · 6ad6c8c9
  eigen authored Aug 06, 2025
```
Co-authored-by: averyhuang <averyh@nvidia.com>
```
  6ad6c8c9
- fix glm4 moe (#8883) · 5b6acc14
  Cheng Wan authored Aug 06, 2025
  
  5b6acc14
06 Aug, 2025 21 commits
- add flashinfer mxfp4 (#8847) · 4373df55
  Xiaoyu Zhang authored Aug 07, 2025
  
  4373df55
- Use reduce scatter for DP (#8539) · c0e84297
  Trevor Morris authored Aug 06, 2025
  
  c0e84297
- Support v1/responses and use harmony in serving_chat (#8837) · 92cc32d9
  Chang Su authored Aug 06, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  92cc32d9
- chore: use torch 2.8 stable (#8880) · cbbd685a
  Yineng Zhang authored Aug 06, 2025
  
  cbbd685a
- [CI] fix pip upgrade (#8881) · 78aad910
  Cheng Wan authored Aug 06, 2025
  
  78aad910
- [NVIDIA] Fix num_experts in modelopt_quant (#8811) · 288ae41f
  Shu Wang authored Aug 06, 2025
  
  288ae41f
- chore: update Dockerfile (#8872) · 01c99a99
  Mick authored Aug 07, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  01c99a99
- Support B200 in CI (#8861) · b114a810
  fzyzcjy authored Aug 06, 2025
  
  b114a810
- Optimize triton swa kernel by skipping computation (#8860) · 0475448e
  Ke Bao authored Aug 06, 2025
  
  0475448e
- Refine naming (#8868) · 399e7ec8
  Ke Bao authored Aug 06, 2025
  
  399e7ec8
- fix benchmark fp8 blockwise group gemm (#8815) · 1bd53168
  Yuan Luo authored Aug 06, 2025
  
  1bd53168
- fix: resolve ci issue (#8859) · aeac900c
  Yineng Zhang authored Aug 06, 2025
  
  aeac900c
- Add unit test for triton swa kernel (#8853) · 4fc5f2f9
  Ke Bao authored Aug 06, 2025
  
  4fc5f2f9
- Support mxfp4 for GPT-OSS (#8843) · 168033d5
  Ying Sheng authored Aug 06, 2025
```
Co-authored-by: Co-author fzyzcjy <ch271828n@outlook.com>
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
Co-authored-by: zhuofan1123 <zhuofanl@nvidia.com>
Co-authored-by: liz-badada <jinyanc@nvidia.com>
Co-authored-by: xutizhou <xutingz@nvidia.com>
Co-authored-by: linhu-nv <linhu@nvidia.com>
```
  168033d5
- [2/3] Optimize Slime Update Weights: Avoid GPU-to-CPU Device Sync when update... · cbbb7383
  Stefan He authored Aug 05, 2025
```
[2/3]  Optimize Slime Update Weights: Avoid GPU-to-CPU Device Sync when update expert weights (#8753)
```
  cbbb7383
- [1/3] Optimize Slime Update Weights: Remove QWen3MOE Load Weight Overhead (#8751) · 89588179
  Stefan He authored Aug 05, 2025
  
  89588179
- [router] PD Router Simplification and Reorganization (#8838) · 8c7bb39d
  Simo Lin authored Aug 05, 2025
  
  8c7bb39d
- [Feature] improve TBO: two chunk overlap (#8144) · ca47e24f
  HouseWest authored Aug 06, 2025
  
  ca47e24f
- Support bailing moe (#8680) · d26ca84f
  Praneth Paruchuri authored Aug 06, 2025
  
  d26ca84f
- Turn off hybrid cache by default (#8839) · 8128e08d
  Ke Bao authored Aug 06, 2025
  
  8128e08d
- [router] complete router oai spec (#8828) · 5d62b56f
  Simo Lin authored Aug 05, 2025
  
  5d62b56f