Commits · b7170cc8206248c9670a0062d9af38c3a59fea4e · change / sglang · GitLab

31 Jul, 2025 30 commits
- [bugfix] Fix flashinfer cutlass EP moe after MoE refactor (#8630) · b7170cc8
  Trevor Morris authored Jul 31, 2025
  
  b7170cc8
- [bug] remove pdlb from minilb since its no longer available (#8634) · 5c14515f
  Simo Lin authored Jul 31, 2025
  
  5c14515f
- SGLang HiCache NIXL Connector (#8488) · 2cd2e27f
  Vishwanath Venkatesan authored Jul 31, 2025
```
Signed-off-by: Vishwanath Venkatesan <vvenkatesan@nvidia.com>
Co-authored-by: Moein Khazraee <moein@nvidia.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  2cd2e27f
- misc: Remove debug print to logger.info (#8633) · 743638bc
  Chang Su authored Jul 31, 2025
  
  743638bc
- Fix typos in py_test/test_launch_server.py (#6227) · 061c8959
  Michael Yao authored Aug 01, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  061c8959
- [Optimization][Perf] Disable the GC during CUDA graph capture to speed up by up to 3x (#8577) · 4acf6902
  Brayden Zhong authored Jul 31, 2025
  
  4acf6902
- [router] update router pypi version (#8628) · aee0ef52
  Simo Lin authored Jul 31, 2025
  
  aee0ef52
- [ci] fix genai-bench execution cmd (#8629) · ae807774
  Simo Lin authored Jul 31, 2025
  
  ae807774
- Update step3v default config (#8626) · 8fbcfd07
  Ke Bao authored Aug 01, 2025
  
  8fbcfd07
- Fix hf3fs_fuse import error (#8623) · 3c307dc0
  Ke Bao authored Jul 31, 2025
  
  3c307dc0
- [bugifx] QWen-1M context support[2/3] using current cuda stream in the DCA's... · 5d15fb8c
  Tao He authored Jul 31, 2025
```
[bugifx] QWen-1M context support[2/3] using current cuda stream in the DCA's kernel for bugfix. (#8611)
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
Co-authored-by: sa-buc <linzhu.ht@w32d09270.cloud.sqa.na131>
```
  5d15fb8c
- [PD] Use batch transfer for rdma transport and add notes for mnnvl usage (#8595) · 016fd251
  Shangming Cai authored Jul 31, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  016fd251
- chore: bump v0.4.10 (#8608) · 02328864
  Yineng Zhang authored Jul 31, 2025
  
  02328864
- [Feature] Hybrid EP and TP (#8590) · 7a1f7fc5
  Cheng Wan authored Jul 31, 2025
  
  7a1f7fc5
- model: support Step3V (#8583) · 51c38163
  Chang Su authored Jul 31, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: nnnobody-code <nnnobody@foxmail.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Qiaolin-Yu <qy254@cornell.edu>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
```
  51c38163
- fix: fork should not run pypi router (#8604) · 09f1a247
  yihong authored Jul 31, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  09f1a247
- [4/N] MoE Refactor: Unified Triton Kernel for FusedMoE and EPMoE (#8515) · 32fa1e9c
  Cheng Wan authored Jul 31, 2025
  
  32fa1e9c
- add SVG logo (#8603) · e7dc163f
  Liangsheng Yin authored Jul 31, 2025
  
  e7dc163f
- update sgl-kernel for EP: python part (#8550) · e179e0b7
  Cheng Wan authored Jul 31, 2025
  
  e179e0b7
- Support l3 cache (mooncake store) for hiradix cache (#7211) · d9049592
  huangtingwei authored Jul 31, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: AniZpZ <zhuangsen.zp@antgroup.com>
Co-authored-by: zuoyuan <zhangzuo21@mails.tsinghua.edu.cn>
Co-authored-by: @wangyueneng.wyn <wangyueneng.wyn@antgroup.com>
Co-authored-by: JinYan Su <jinyansu792@gmail.com>
```
  d9049592
- fix incorrect increase of hit count (#8533) · 26c8a310
  huangtingwei authored Jul 31, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  26c8a310
- [bugfix] Fix 2 minor bugs in the hicache storage layer (#8404) · 5963e505
  yi wang authored Jul 31, 2025
  
  5963e505
- chore: bump sgl-kernel v0.2.8 (#8599) · 43118f5f
  Yineng Zhang authored Jul 30, 2025
  
  43118f5f
- update sgl-kernel for EP: kernel part (#8514) · a5f5ab40
  Cheng Wan authored Jul 30, 2025
```
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
```
  a5f5ab40
- Bug: Fix google gemma3n-mm audio input not working bug (#8365) · 59aab76f
  Binyao Jiang authored Jul 30, 2025
  
  59aab76f
- Add GKE's default CUDA runtime lib location to PATH and LD_LIBRARY_PATH. (#8544) · 659bfd10
  Charles Chen authored Jul 30, 2025
  
  659bfd10
- Bump transfomers to 4.54.1 to fix Gemma cache issue. (#8541) · 67e53b16
  Lifu Huang authored Jul 30, 2025
  
  67e53b16
- [Fix]Fix index oob in get_group_gemm_starts kernel. (#8564) · 9b9e8253
  Qi Yuhang authored Jul 31, 2025
  
  9b9e8253
- [router] migrate router from actix to axum (#8479) · 66a398f4
  Simo Lin authored Jul 30, 2025
  
  66a398f4
- Add hf3fs support for hicache storage (based on #7704) (#7280) · 29980334
  pansicheng authored Jul 31, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  29980334
30 Jul, 2025 9 commits
- Revert "Fix the input tools format and history tool_calls in OpenAI API (#6556)" (#8584) · a79a5d70
  Chang Su authored Jul 30, 2025
  
  a79a5d70
- [Model] Add support for Arcee Foundational Model (#8154) · ec5f9442
  Adarsh Shirawalmath authored Jul 30, 2025
  
  ec5f9442
- [Hot-Fix] moe_aligned_block_size CI failed in AMD (#8461) · 3bdcdd13
  Yuan Luo authored Jul 31, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: JieXin Liang <Alcanderian@users.noreply.github.com>
```
  3bdcdd13
- [feature] [sgl-router] Add a dp-aware routing strategy (#6869) · a730ce81
  Rui Chen authored Jul 30, 2025
  
  a730ce81
- Update CODEOWNERS (#8562) · 55ecdc0a
  Shangming Cai authored Jul 30, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  55ecdc0a
- Update cutlass_moe.py (#8545) · e3f08c77
  Elfie Guo authored Jul 29, 2025
  
  e3f08c77
- [router] allow longer time out for router e2e (#8560) · a9fd8033
  Simo Lin authored Jul 29, 2025
  
  a9fd8033
- feature(pd-hicache): Prefill instances support reusing the RemoteStorage Cache via HiCache. (#8516) · 2fbb754e
  hzh0425 authored Jul 30, 2025
```
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  2fbb754e
- feat(hicache): support file backend reading directory config form env. (#8498) · a85ebf50
  hzh0425 authored Jul 30, 2025
  
  a85ebf50
29 Jul, 2025 1 commit
- Support EPLB in FusedMoE (#8448) · 9effeb5b
  Cheng Wan authored Jul 29, 2025
  
  9effeb5b