Commits · 6345069f6c0e2fd4850385e0bb5f441f73424233 · change / sglang · GitLab

10 Aug, 2025 6 commits
- Improve LoRA Perf by Deprecating FlashInfer and Eliminating Redundant Tensor Ops (#8940) · f8a173bb
  Lifu Huang authored Aug 10, 2025
  
  f8a173bb
- Optimize: Cache CUDA device to reduce redundant calls during tensor l… (#8996) · 6b847a9a
  JiLi authored Aug 10, 2025
  
  6b847a9a
- [Fix] Fix flashinfer cpu <-> gpu synchronization (#8340) · 7ba5ad57
  DarkSharpness authored Aug 09, 2025
  
  7ba5ad57
- [Fix] Fix hicache backend (#8991) · 19bc77f0
  DarkSharpness authored Aug 09, 2025
  
  19bc77f0
- fix page first per layer pf2lf kernel (#8915) · 86497d99
  huangtingwei authored Aug 10, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  86497d99
- [hicache] Optimization for DMA copy (#8245) · 5c31b35d
  cctry authored Aug 09, 2025
  
  5c31b35d
09 Aug, 2025 27 commits
- Fix CI (#9013) · ef48d554
  Lianmin Zheng authored Aug 09, 2025
  
  ef48d554
- fix flashinfer allreduce fusion import bug (#9007) · a886564a
  Xiaoyu Zhang authored Aug 10, 2025
  
  a886564a
- Fix CI (#9012) · 9a44b643
  Lianmin Zheng authored Aug 09, 2025
  
  9a44b643
- fix: fix obsolete qwen-audio processor arg (#9003) · 41d71ca4
  Mick authored Aug 10, 2025
  
  41d71ca4
- [perf] add kimi-k2 b200 fused moe config (#9010) · 20cfc5a2
  JieXin Liang authored Aug 10, 2025
  
  20cfc5a2
- Enable TBO on ROCm (#8329) · 323bc2f5
  Chaitanya Sri Krishna Lolla authored Aug 09, 2025
  
  323bc2f5
- [Feature] Optimize DeepSeek's DeepEP on Ascend NPU (#8355) · 137e75da
  Even Zhou authored Aug 09, 2025
```
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: Hexq0210 <hexq0809521@gmail.com>
```
  137e75da
- [bugfix] Fix missing args in bench one batch (#8877) · 52e1f52f
  Trevor Morris authored Aug 09, 2025
  
  52e1f52f
- [DP] fix: engine crash when decode batch is padded (#8995) · 50188092
  Cheng Wan authored Aug 09, 2025
  
  50188092
- chore: upgrade sgl-kernel 0.3.3 (#8998) · 326a901d
  Yineng Zhang authored Aug 09, 2025
  
  326a901d
- HiCache Storage tp fix (#8878) · 6e0b6468
  Zhiqiang Xie authored Aug 09, 2025
  
  6e0b6468
- Tiny Llama4 type error in constructor (#6752) · 4a9f3eef
  Brayden Zhong authored Aug 09, 2025
  
  4a9f3eef
- feature(hicache): Support hf3fs-hicache reusing kvcache across different instances (#8673) · 1b7afad0
  hzh0425 authored Aug 09, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  1b7afad0
- Support glm4.1v and glm4.5v (#8798) · f29aba8c
  Binyao Jiang authored Aug 09, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
Co-authored-by: Chang Su <csu272@usc.edu>
```
  f29aba8c
- feat: update flashinfer ar oneshot params (#8687) · faa25df1
  eigen authored Aug 09, 2025
  
  faa25df1
- Fix qwen2 audio not working bug (#8600) · 7b81f956
  Binyao Jiang authored Aug 09, 2025
  
  7b81f956
- Fix redundant kernel in sink dtype conversion (#8966) · d3e67deb
  fzyzcjy authored Aug 09, 2025
  
  d3e67deb
- Add CI for gpt-oss model on hopper (#8851) · 442534aa
  fzyzcjy authored Aug 09, 2025
  
  442534aa
- chore(deps): update minimum python to 3.10 (#8984) · de8b8b6e
  ishandhanani authored Aug 09, 2025
  
  de8b8b6e
- optimize: reduce shulffle and quantization overhead in cutlass_moe sm90 (#8962) · 3f2e315f
  tql.99 authored Aug 09, 2025
```
Co-authored-by: 戚余航 <qiyuhang@bytedance.com>
```
  3f2e315f
- Fix incorrect default get_hidden_dim logic (#8987) · 6e215118
  Lifu Huang authored Aug 09, 2025
  
  6e215118
- [hotfix] use the original implementation in 8785 (#8994) · a47baff1
  Cheng Wan authored Aug 08, 2025
  
  a47baff1
- Revert "[bug fix] Ensure local token and global token buffers are pointing to... · fd7e15b7
  Cheng Wan authored Aug 08, 2025
```
Revert "[bug fix] Ensure local token and global token buffers are pointing to different storage " (#8993)
```
  fd7e15b7
- [Fix] Fix wrong backend chosen in hybrid backend (#8989) · fc42ff7b
  DarkSharpness authored Aug 08, 2025
  
  fc42ff7b
- Clean up server_args.py to have a dedicated function for model specific adjustments (#8983) · 706bd69c
  Lianmin Zheng authored Aug 08, 2025
  
  706bd69c
- Add unit test for flashinfer fp4 moe (#8330) · a60f88b5
  Trevor Morris authored Aug 08, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  a60f88b5
- [1/2][resubmit] sgl-kernel: Fuse routed scaling factor into moe_fused_gate (select_experts) (#8770) · 591c232f
  Trevor Morris authored Aug 08, 2025
  
  591c232f
08 Aug, 2025 7 commits
- Minor Optimizations in Schedule Batch (#8724) · f352b793
  Lianmin Zheng authored Aug 08, 2025
```
Co-authored-by: Suruchi Shah <surshah@linkedin.com>
```
  f352b793
- Create cancel-all-pr-test-runs (#8986) · 67a7d1f6
  Lianmin Zheng authored Aug 08, 2025
  
  67a7d1f6
- [bug fix] Ensure local token and global token buffers are pointing to different storage (#8785) · 92cbef59
  Elfie Guo authored Aug 08, 2025
  
  92cbef59
- Update qwen3_coder_detector.py for streaming (#8371) · b3359dc9
  maocheng23 authored Aug 08, 2025
  
  b3359dc9
- chore(gb200): update to CUDA 12.9 and improve build process (#8772) · 4e7f0252
  ishandhanani authored Aug 08, 2025
  
  4e7f0252
- Fix kimi k2 function call format (#8968) · 91e2f902
  Lianmin Zheng authored Aug 08, 2025
  
  91e2f902
- refine aiter_backend for mtp (#7279) · 53f7874a
  valarLip authored Aug 09, 2025
```
Co-authored-by: HAI <hixiao@gmail.com>
```
  53f7874a