Commits · ce9cf353274d4fd7865ec6a1063afba96de63f64 · change / sglang

"benchmarks/utils.py" did not exist on "0a401b95b7f298b3d029576e1d65d99f06ed1228"

10 Aug, 2025 10 commits
- [router] update pyo3 version to 0.25.1 (#9022) · ce9cf353
  Simo Lin authored Aug 10, 2025
  
  ce9cf353
- Improve LoRA Perf by Deprecating FlashInfer and Eliminating Redundant Tensor Ops (#8940) · f8a173bb
  Lifu Huang authored Aug 10, 2025
  
  f8a173bb
- Optimize: Cache CUDA device to reduce redundant calls during tensor l… (#8996) · 6b847a9a
  JiLi authored Aug 10, 2025
  
  6b847a9a
- [router] upgrade kube version to latest (#9018) · 473400e4
  Simo Lin authored Aug 09, 2025
  
  473400e4
- [router] upgrade rand to latest version (#9017) · dd665f96
  Simo Lin authored Aug 09, 2025
  
  dd665f96
- [router] upgrade to latest sgl kernel for router ci (#9019) · 3817a37d
  Simo Lin authored Aug 09, 2025
  
  3817a37d
- [Fix] Fix flashinfer cpu <-> gpu synchronization (#8340) · 7ba5ad57
  DarkSharpness authored Aug 09, 2025
  
  7ba5ad57
- [Fix] Fix hicache backend (#8991) · 19bc77f0
  DarkSharpness authored Aug 09, 2025
  
  19bc77f0
- fix page first per layer pf2lf kernel (#8915) · 86497d99
  huangtingwei authored Aug 10, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  86497d99
- [hicache] Optimization for DMA copy (#8245) · 5c31b35d
  cctry authored Aug 09, 2025
  
  5c31b35d
09 Aug, 2025 30 commits
- Fix CI (#9013) · ef48d554
  Lianmin Zheng authored Aug 09, 2025
  
  ef48d554
- fix flashinfer allreduce fusion import bug (#9007) · a886564a
  Xiaoyu Zhang authored Aug 10, 2025
  
  a886564a
- Fix CI (#9012) · 9a44b643
  Lianmin Zheng authored Aug 09, 2025
  
  9a44b643
- fix: fix obsolete qwen-audio processor arg (#9003) · 41d71ca4
  Mick authored Aug 10, 2025
  
  41d71ca4
- [perf] add kimi-k2 b200 fused moe config (#9010) · 20cfc5a2
  JieXin Liang authored Aug 10, 2025
  
  20cfc5a2
- fix nvshmem cu126 (#9001) · 48b8b4c1
  Yineng Zhang authored Aug 09, 2025
  
  48b8b4c1
- Enable TBO on ROCm (#8329) · 323bc2f5
  Chaitanya Sri Krishna Lolla authored Aug 09, 2025
  
  323bc2f5
- [Feature] Optimize DeepSeek's DeepEP on Ascend NPU (#8355) · 137e75da
  Even Zhou authored Aug 09, 2025
```
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: Hexq0210 <hexq0809521@gmail.com>
```
  137e75da
- [bugfix] Fix missing args in bench one batch (#8877) · 52e1f52f
  Trevor Morris authored Aug 09, 2025
  
  52e1f52f
- [DP] fix: engine crash when decode batch is padded (#8995) · 50188092
  Cheng Wan authored Aug 09, 2025
  
  50188092
- chore: upgrade sgl-kernel 0.3.3 (#8998) · 326a901d
  Yineng Zhang authored Aug 09, 2025
  
  326a901d
- HiCache Storage tp fix (#8878) · 6e0b6468
  Zhiqiang Xie authored Aug 09, 2025
  
  6e0b6468
- Tiny Llama4 type error in constructor (#6752) · 4a9f3eef
  Brayden Zhong authored Aug 09, 2025
  
  4a9f3eef
- feature(hicache): Support hf3fs-hicache reusing kvcache across different instances (#8673) · 1b7afad0
  hzh0425 authored Aug 09, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  1b7afad0
- Support glm4.1v and glm4.5v (#8798) · f29aba8c
  Binyao Jiang authored Aug 09, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
Co-authored-by: Chang Su <csu272@usc.edu>
```
  f29aba8c
- feat: update flashinfer ar oneshot params (#8687) · faa25df1
  eigen authored Aug 09, 2025
  
  faa25df1
- Fix qwen2 audio not working bug (#8600) · 7b81f956
  Binyao Jiang authored Aug 09, 2025
  
  7b81f956
- Fix redundant kernel in sink dtype conversion (#8966) · d3e67deb
  fzyzcjy authored Aug 09, 2025
  
  d3e67deb
- Add CI for gpt-oss model on hopper (#8851) · 442534aa
  fzyzcjy authored Aug 09, 2025
  
  442534aa
- chore(deps): update minimum python to 3.10 (#8984) · de8b8b6e
  ishandhanani authored Aug 09, 2025
  
  de8b8b6e
- optimize: reduce shulffle and quantization overhead in cutlass_moe sm90 (#8962) · 3f2e315f
  tql.99 authored Aug 09, 2025
```
Co-authored-by: 戚余航 <qiyuhang@bytedance.com>
```
  3f2e315f
- Fix incorrect default get_hidden_dim logic (#8987) · 6e215118
  Lifu Huang authored Aug 09, 2025
  
  6e215118
- [hotfix] use the original implementation in 8785 (#8994) · a47baff1
  Cheng Wan authored Aug 08, 2025
  
  a47baff1
- Revert "[bug fix] Ensure local token and global token buffers are pointing to... · fd7e15b7
  Cheng Wan authored Aug 08, 2025
```
Revert "[bug fix] Ensure local token and global token buffers are pointing to different storage " (#8993)
```
  fd7e15b7
- [Fix] Fix wrong backend chosen in hybrid backend (#8989) · fc42ff7b
  DarkSharpness authored Aug 08, 2025
  
  fc42ff7b
- Molly/ci gnr server (#8667) · 7c0db868
  DiweiSun authored Aug 09, 2025
  
  7c0db868
- Clean up server_args.py to have a dedicated function for model specific adjustments (#8983) · 706bd69c
  Lianmin Zheng authored Aug 08, 2025
  
  706bd69c
- [AMD] Update SGLang image fallback logic for AMD CI (#8980) · 23f2afb2
  michael-amd authored Aug 08, 2025
  
  23f2afb2
- Add unit test for flashinfer fp4 moe (#8330) · a60f88b5
  Trevor Morris authored Aug 08, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  a60f88b5
- [1/2][resubmit] sgl-kernel: Fuse routed scaling factor into moe_fused_gate (select_experts) (#8770) · 591c232f
  Trevor Morris authored Aug 08, 2025
  
  591c232f