Commits · 1b1b47a9491a24d95e07f8440c879fb281c30688 · zhaoyu6 / sglang

"official/benchmark/bert_benchmark.py" did not exist on "3c5330d8130ec7e03e5df28b199ab0357b559301"

12 Apr, 2025 7 commits
- Fix w8a8_int8 model shared experts fusion load weights error (#5120) · 1b1b47a9
  lambert0312 authored Apr 12, 2025
  
  1b1b47a9
- update variable naming and comments for rocm (#5299) · 3c9740d2
  Zhaoyi Li authored Apr 12, 2025
  
  3c9740d2
- misc: cleanup 3rdparty (#5311) · 2eb55770
  Yineng Zhang authored Apr 11, 2025
  
  2eb55770
- Blackwell Cutlass MLA kernel (#5142) · f65b8d5c
  Trevor Morris authored Apr 11, 2025
  
  f65b8d5c
- Adjust ci test threshold (#5271) · 5ad05719
  Ke Bao authored Apr 12, 2025
  
  5ad05719
- [VLM] Adopt fast image processor by default (#5065) · 34ef6c81
  Mick authored Apr 12, 2025
  
  34ef6c81
- fix: use deepgemm only on hopper (#5310) · 61172091
  Yineng Zhang authored Apr 11, 2025
  
  61172091
11 Apr, 2025 24 commits
- fix: update flash attn (#5308) · 4f288113
  Yineng Zhang authored Apr 11, 2025
  
  4f288113
- fix: remove cublas_grouped_gemm (#5307) · 136b8e6a
  Yineng Zhang authored Apr 11, 2025
  
  136b8e6a
- misc: update blackwell Dockerfile (#5306) · 034c5256
  Yineng Zhang authored Apr 11, 2025
  
  034c5256
- fix: use fa3 unit test on hopper only (#5304) · c1dd773c
  Yineng Zhang authored Apr 11, 2025
  
  c1dd773c
- feat: add blackwell workflow (#5303) · 6f859379
  Yineng Zhang authored Apr 11, 2025
  
  6f859379
- feat: add blackwell Dockerfile (#5302) · f774a0d2
  Yineng Zhang authored Apr 11, 2025
  
  f774a0d2
- remove moe_align_block_size torch.zeros in small batch/expert mode (#5298) · 60bcbf2a
  Xiaoyu Zhang authored Apr 12, 2025
  
  60bcbf2a
- [Docs] Remove the older supported docs section (#5301) · a0a9f6d6
  Adarsh Shirawalmath authored Apr 12, 2025
  
  a0a9f6d6
- fix: update update_wheel_index for cu128 (#5300) · 80aa8ca8
  Yineng Zhang authored Apr 11, 2025
  
  80aa8ca8
- [Docs] Supported Model Docs - Major restructuring (#5290) · 4aa6bab0
  Adarsh Shirawalmath authored Apr 11, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  4aa6bab0
- [PD] fix: skip warmup request in disaggregation mode to prevent crash on timeout (#5292) · c35dcfdb
  Yusong Gao authored Apr 11, 2025
  
  c35dcfdb
- chore: bump sgl-kernel v0.0.8.post1 (#5289) · c163bf4f
  Yineng Zhang authored Apr 11, 2025
  
  c163bf4f
- chore: relax the torch version restriction for sgl-kernel compilation (#5288) · 55986343
  Yineng Zhang authored Apr 11, 2025
  
  55986343
- feat: add cu128 identifier for sgl-kernel (#5287) · b75275b6
  Yineng Zhang authored Apr 11, 2025
  
  b75275b6
- fix: enable fp4 compilation on cu128 (#5286) · 7074e9ca
  Yineng Zhang authored Apr 11, 2025
  
  7074e9ca
- Fix a 404 link in send_request.ipynb (#5280) · fc14cca0
  Michael Yao authored Apr 11, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  fc14cca0
- fix: examples for token_in_token_out_vlm (#5193) · e7beff8a
  XinyuanTong authored Apr 11, 2025
  
  e7beff8a
- doc: nested loop code for offline engine (#5244) · 4d2e3051
  mlmz authored Apr 11, 2025
  
  4d2e3051
- [fix] fix mrope positions not picked up (#5265) · e53a0b3d
  Mick authored Apr 11, 2025
  
  e53a0b3d
- Support `--enable-llama4-multimodal` (#5254) · 038bc5d5
  Cheng Wan authored Apr 11, 2025
  
  038bc5d5
- Optimize GPU memory usage in FlashAttentionBackend's strided indexing (#5262) · aee62d74
  Chang Su authored Apr 11, 2025
```
Co-authored-by: ch-wan <cwan39@gatech.edu>
```
  aee62d74
- Optimize attention in llama4 (#5127) · cd7e32e2
  fzyzcjy authored Apr 11, 2025
  
  cd7e32e2
- ROCm/AITER CK_MoE: update 2-stage kernels & support both Activations (#5228) · 88799448
  HAI authored Apr 10, 2025
  
  88799448
- Fix torch.compile cacheing (#5259) · a879811c
  Richard Zou authored Apr 10, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  a879811c
10 Apr, 2025 9 commits
- Update Makefile / build script to avoid installing incompatible torch dependency (#5245) · a222945d
  Elfie Guo authored Apr 10, 2025
  
  a222945d
- [Misc] Clean sgl-kernel test (#5216) · ed01b451
  PGFLMG authored Apr 11, 2025
  
  ed01b451
- ROCm sgl-kernel: compatible to later torch (#5167) · d050df36
  HAI authored Apr 10, 2025
  
  d050df36
- Fix deepseek-v3 with torch.compile in PyTorch 2.6. (#5213) · 76f44c2a
  Richard Zou authored Apr 10, 2025
  
  76f44c2a
- Update deps for mllama4 (#5215) · 1078396f
  Ke Bao authored Apr 11, 2025
  
  1078396f
- [PD] Add get_contiguous_buf_infos interface for MLATokenToKVPool (#5204) · 7e4f72dd
  Teng Ma authored Apr 10, 2025
  
  7e4f72dd
- [PD] Support KV transfer with mooncake (#4880) · 4c31ae9f
  Teng Ma authored Apr 10, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
Co-authored-by: Shangming Cai <caishangming@linux.alibaba.com>
Co-authored-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
Co-authored-by: shangmingc <csmthu@gmail.com>
```
  4c31ae9f
- reduce moe_align_block_size_kernel small batch mode overhead (#5086) · f730362e
  Xiaoyu Zhang authored Apr 10, 2025
  
  f730362e
- Fix DeepSeek error when using DeepEP mode (#5190) · e3c4bd31
  fzyzcjy authored Apr 10, 2025
  
  e3c4bd31