Commits · 812e82f35e09633299203f273de11fb4f4e36018 · change / sglang · GitLab

12 Apr, 2025 17 commits
- fix: solve cu118 issue for cutlass mla (#5331) · 812e82f3
  Yineng Zhang authored Apr 12, 2025
  
  812e82f3
- [Feat] Add sparse attn to sgl-kernel (#5327) · 4879e50c
  PGFLMG authored Apr 13, 2025
  
  4879e50c
- Support server based rollout in Verlengine (#4848) · bc92107b
  tianlian yi authored Apr 13, 2025
```
Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Jinn <47354855+jhinpan@users.noreply.github.com>
```
  bc92107b
- refine fused_moe tuning docs (#5294) · 3e4794aa
  Xiaoyu Zhang authored Apr 13, 2025
  
  3e4794aa
- Delete python/sglang/srt/layers/moe/fused_moe_triton/configs/E=257,N=… (#5321) · 690ec205
  Xiaoyu Zhang authored Apr 13, 2025
  
  690ec205
- Fix: docs/backend/structured_outputs.ipynb (#4884) · 2074a2e6
  thyecust authored Apr 12, 2025
  
  2074a2e6
- feat: use fa3 mla by default on hopper (#5210) · 57de7c6b
  Yineng Zhang authored Apr 12, 2025
```
Co-authored-by: yundai424 <yundai424@gmail.com>
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
```
  57de7c6b
- chore: bump sgl-kernel v0.0.8.post2 (#5317) · 115ae2e7
  Yineng Zhang authored Apr 11, 2025
  
  115ae2e7
- Fix fa3 window size setup (#5316) · aea98512
  Qingquan Song authored Apr 11, 2025
  
  aea98512
- Add flash_attn_varlen_func to sgl-kernel (#5315) · e4155e96
  Baizhou Zhang authored Apr 11, 2025
  
  e4155e96
- Fix w8a8_int8 model shared experts fusion load weights error (#5120) · 1b1b47a9
  lambert0312 authored Apr 12, 2025
  
  1b1b47a9
- update variable naming and comments for rocm (#5299) · 3c9740d2
  Zhaoyi Li authored Apr 12, 2025
  
  3c9740d2
- misc: cleanup 3rdparty (#5311) · 2eb55770
  Yineng Zhang authored Apr 11, 2025
  
  2eb55770
- Blackwell Cutlass MLA kernel (#5142) · f65b8d5c
  Trevor Morris authored Apr 11, 2025
  
  f65b8d5c
- Adjust ci test threshold (#5271) · 5ad05719
  Ke Bao authored Apr 12, 2025
  
  5ad05719
- [VLM] Adopt fast image processor by default (#5065) · 34ef6c81
  Mick authored Apr 12, 2025
  
  34ef6c81
- fix: use deepgemm only on hopper (#5310) · 61172091
  Yineng Zhang authored Apr 11, 2025
  
  61172091
11 Apr, 2025 23 commits
- fix: update flash attn (#5308) · 4f288113
  Yineng Zhang authored Apr 11, 2025
  
  4f288113
- fix: remove cublas_grouped_gemm (#5307) · 136b8e6a
  Yineng Zhang authored Apr 11, 2025
  
  136b8e6a
- misc: update blackwell Dockerfile (#5306) · 034c5256
  Yineng Zhang authored Apr 11, 2025
  
  034c5256
- fix: use fa3 unit test on hopper only (#5304) · c1dd773c
  Yineng Zhang authored Apr 11, 2025
  
  c1dd773c
- feat: add blackwell workflow (#5303) · 6f859379
  Yineng Zhang authored Apr 11, 2025
  
  6f859379
- feat: add blackwell Dockerfile (#5302) · f774a0d2
  Yineng Zhang authored Apr 11, 2025
  
  f774a0d2
- remove moe_align_block_size torch.zeros in small batch/expert mode (#5298) · 60bcbf2a
  Xiaoyu Zhang authored Apr 12, 2025
  
  60bcbf2a
- [Docs] Remove the older supported docs section (#5301) · a0a9f6d6
  Adarsh Shirawalmath authored Apr 12, 2025
  
  a0a9f6d6
- fix: update update_wheel_index for cu128 (#5300) · 80aa8ca8
  Yineng Zhang authored Apr 11, 2025
  
  80aa8ca8
- [Docs] Supported Model Docs - Major restructuring (#5290) · 4aa6bab0
  Adarsh Shirawalmath authored Apr 11, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  4aa6bab0
- [PD] fix: skip warmup request in disaggregation mode to prevent crash on timeout (#5292) · c35dcfdb
  Yusong Gao authored Apr 11, 2025
  
  c35dcfdb
- chore: bump sgl-kernel v0.0.8.post1 (#5289) · c163bf4f
  Yineng Zhang authored Apr 11, 2025
  
  c163bf4f
- chore: relax the torch version restriction for sgl-kernel compilation (#5288) · 55986343
  Yineng Zhang authored Apr 11, 2025
  
  55986343
- feat: add cu128 identifier for sgl-kernel (#5287) · b75275b6
  Yineng Zhang authored Apr 11, 2025
  
  b75275b6
- fix: enable fp4 compilation on cu128 (#5286) · 7074e9ca
  Yineng Zhang authored Apr 11, 2025
  
  7074e9ca
- Fix a 404 link in send_request.ipynb (#5280) · fc14cca0
  Michael Yao authored Apr 11, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  fc14cca0
- fix: examples for token_in_token_out_vlm (#5193) · e7beff8a
  XinyuanTong authored Apr 11, 2025
  
  e7beff8a
- doc: nested loop code for offline engine (#5244) · 4d2e3051
  mlmz authored Apr 11, 2025
  
  4d2e3051
- [fix] fix mrope positions not picked up (#5265) · e53a0b3d
  Mick authored Apr 11, 2025
  
  e53a0b3d
- Support `--enable-llama4-multimodal` (#5254) · 038bc5d5
  Cheng Wan authored Apr 11, 2025
  
  038bc5d5
- Optimize GPU memory usage in FlashAttentionBackend's strided indexing (#5262) · aee62d74
  Chang Su authored Apr 11, 2025
```
Co-authored-by: ch-wan <cwan39@gatech.edu>
```
  aee62d74
- Optimize attention in llama4 (#5127) · cd7e32e2
  fzyzcjy authored Apr 11, 2025
  
  cd7e32e2
- ROCm/AITER CK_MoE: update 2-stage kernels & support both Activations (#5228) · 88799448
  HAI authored Apr 10, 2025
  
  88799448