Commits · 6c88f6c8d9086083e69bd8fbb604c2967d38d395 · change / sglang

"server/text_generation_server/models/rw.py" did not exist on "bf7f1d54345f9e6e091d4b756e8b8381fe767d89"

01 Aug, 2025 16 commits
- [5/N] MoE Refactor: Update MoE parallelism arguments (#8658) · 6c88f6c8
  Cheng Wan authored Aug 01, 2025
  
  6c88f6c8
- Bug: apply final_hidden_states*=self.routed_scaling_factor at MoE lay… (#8511) · c8d3a402
  Binyao Jiang authored Aug 01, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  c8d3a402
- Fix chat template handling for OpenAI serving (#8635) · 7e831efe
  Xinyuan Tong authored Jul 31, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  7e831efe
- Add hf3fs_utils.cpp to package-data (#8653) · 20b5563e
  pansicheng authored Aug 01, 2025
  
  20b5563e
- chore: bump v0.4.10.post1 (#8652) · 33f0de33
  Ke Bao authored Aug 01, 2025
  
  33f0de33
- Update batch size limitation of dsv3_router_gemm kernel to 16 (#8051) · e7e5a305
  Baizhou Zhang authored Jul 31, 2025
  
  e7e5a305
- Interface change for kvcache io to support page first layout (#8318) · dd7ca006
  Zhiqiang Xie authored Jul 31, 2025
  
  dd7ca006
- HiCache, fixing hash value indexing (#8636) · 9305ea6c
  Zhiqiang Xie authored Jul 31, 2025
  
  9305ea6c
- [NVIDIA] Enable Flashinfer MoE blockscale fp8 backend for TP MoE (#8450) · aa4c66b5
  Kaixi Hou authored Jul 31, 2025
```
Co-authored-by: kushanam <42385577+kushanam@users.noreply.github.com>
```
  aa4c66b5
- [router] upgrade router version to 0.1.8 (#8645) · 39decec1
  Simo Lin authored Jul 31, 2025
  
  39decec1
- [router] add basic usage doc (#8640) · f6f46f46
  Simo Lin authored Jul 31, 2025
  
  f6f46f46
- [bugfix] fix router python parser for pd urls (#8644) · 2886e23d
  Simo Lin authored Jul 31, 2025
  
  2886e23d
- [Bugfix] fix w8a8_int8 load issue (#8308) · 99795d61
  Even Zhou authored Aug 01, 2025
```
Co-authored-by: ronnie_zheng <zl19940307@163.com>
```
  99795d61
- chore: speedup NPU CI by cache (#8270) · fe5086fd
  li chaoran authored Aug 01, 2025
```
Signed-off-by: mywaaagh_admin <pkwarcraft@gmail.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
```
  fe5086fd
- Feature/modelscope model download (#8083) · 04913430
  yrk111222 authored Aug 01, 2025
```
Co-authored-by: ronnie_zheng <zl19940307@163.com>
```
  04913430
- Revert "Fix nan value generated after custom all reduce (#8532)" (#8642) · 0ad098b4
  Yineng Zhang authored Jul 31, 2025
  
  0ad098b4
31 Jul, 2025 24 commits
- Fix nan value generated after custom all reduce (#8532) · 4a6e7a66
  kk authored Aug 01, 2025
  
  4a6e7a66
- TRTLLM Gen MLA Decode Kernel Integration (same as #7938) (#8632) · 4b04998d
  Faraz authored Jul 31, 2025
```
Signed-off-by: Faraz Khoubsirat <58580514+farazkh80@users.noreply.github.com>
```
  4b04998d
- Conditionally import HiCacheHF3FS (#8598) · 3dde8619
  pansicheng authored Aug 01, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  3dde8619
- [bugfix] Fix flashinfer cutlass EP moe after MoE refactor (#8630) · b7170cc8
  Trevor Morris authored Jul 31, 2025
  
  b7170cc8
- [bug] remove pdlb from minilb since its no longer available (#8634) · 5c14515f
  Simo Lin authored Jul 31, 2025
  
  5c14515f
- SGLang HiCache NIXL Connector (#8488) · 2cd2e27f
  Vishwanath Venkatesan authored Jul 31, 2025
```
Signed-off-by: Vishwanath Venkatesan <vvenkatesan@nvidia.com>
Co-authored-by: Moein Khazraee <moein@nvidia.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  2cd2e27f
- misc: Remove debug print to logger.info (#8633) · 743638bc
  Chang Su authored Jul 31, 2025
  
  743638bc
- Fix typos in py_test/test_launch_server.py (#6227) · 061c8959
  Michael Yao authored Aug 01, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  061c8959
- [Optimization][Perf] Disable the GC during CUDA graph capture to speed up by up to 3x (#8577) · 4acf6902
  Brayden Zhong authored Jul 31, 2025
  
  4acf6902
- [router] update router pypi version (#8628) · aee0ef52
  Simo Lin authored Jul 31, 2025
  
  aee0ef52
- [ci] fix genai-bench execution cmd (#8629) · ae807774
  Simo Lin authored Jul 31, 2025
  
  ae807774
- Update step3v default config (#8626) · 8fbcfd07
  Ke Bao authored Aug 01, 2025
  
  8fbcfd07
- Fix hf3fs_fuse import error (#8623) · 3c307dc0
  Ke Bao authored Jul 31, 2025
  
  3c307dc0
- [bugifx] QWen-1M context support[2/3] using current cuda stream in the DCA's... · 5d15fb8c
  Tao He authored Jul 31, 2025
```
[bugifx] QWen-1M context support[2/3] using current cuda stream in the DCA's kernel for bugfix. (#8611)
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
Co-authored-by: sa-buc <linzhu.ht@w32d09270.cloud.sqa.na131>
```
  5d15fb8c
- [PD] Use batch transfer for rdma transport and add notes for mnnvl usage (#8595) · 016fd251
  Shangming Cai authored Jul 31, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  016fd251
- chore: bump v0.4.10 (#8608) · 02328864
  Yineng Zhang authored Jul 31, 2025
  
  02328864
- [Feature] Hybrid EP and TP (#8590) · 7a1f7fc5
  Cheng Wan authored Jul 31, 2025
  
  7a1f7fc5
- model: support Step3V (#8583) · 51c38163
  Chang Su authored Jul 31, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: nnnobody-code <nnnobody@foxmail.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Qiaolin-Yu <qy254@cornell.edu>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
```
  51c38163
- fix: fork should not run pypi router (#8604) · 09f1a247
  yihong authored Jul 31, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  09f1a247
- [4/N] MoE Refactor: Unified Triton Kernel for FusedMoE and EPMoE (#8515) · 32fa1e9c
  Cheng Wan authored Jul 31, 2025
  
  32fa1e9c
- add SVG logo (#8603) · e7dc163f
  Liangsheng Yin authored Jul 31, 2025
  
  e7dc163f
- update sgl-kernel for EP: python part (#8550) · e179e0b7
  Cheng Wan authored Jul 31, 2025
  
  e179e0b7
- Support l3 cache (mooncake store) for hiradix cache (#7211) · d9049592
  huangtingwei authored Jul 31, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: AniZpZ <zhuangsen.zp@antgroup.com>
Co-authored-by: zuoyuan <zhangzuo21@mails.tsinghua.edu.cn>
Co-authored-by: @wangyueneng.wyn <wangyueneng.wyn@antgroup.com>
Co-authored-by: JinYan Su <jinyansu792@gmail.com>
```
  d9049592
- fix incorrect increase of hit count (#8533) · 26c8a310
  huangtingwei authored Jul 31, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  26c8a310