Commits · 8e09b370777cd65e8769d5ec7921edb5219f3118 · change / sglang · GitLab

18 Apr, 2025 1 commit
- Sgl kernel fused_moe_gate support n_shared_experts (#5440) · 8e09b370
  Xiaoyu Zhang authored Apr 18, 2025
  
  8e09b370
17 Apr, 2025 3 commits
- [Feat] Update sgl-kernel flashinfer to latest main version (#5500) · c08a717c
  PGFLMG authored Apr 18, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  c08a717c
- Fix a link in sgl-kernel/README.md (#5493) · 22c2a79d
  Michael Yao authored Apr 17, 2025
  
  22c2a79d
- Add test for flash_attn_varlen_func kernel (#5484) · 81c89111
  Baizhou Zhang authored Apr 17, 2025
  
  81c89111
16 Apr, 2025 1 commit
- Update cutlass dependency. (#5447) · 85ec0440
  Elfie Guo authored Apr 15, 2025
  
  85ec0440
15 Apr, 2025 9 commits
- BLackwell cutlass mla: Add check for bad page size/block num combinations (#5431) · e8f62b20
  Trevor Morris authored Apr 15, 2025
  
  e8f62b20
- fix: solve release issue (#5434) · 88defc4d
  Yineng Zhang authored Apr 15, 2025
  
  88defc4d
- chore: bump sgl-kernel v0.0.9.post1 (#5430) · 6f509d55
  Yineng Zhang authored Apr 15, 2025
  
  6f509d55
- bugfix: fix merge_state_v2 cuda graph (#5419) · 12ef7e3b
  DefTruth authored Apr 16, 2025
  
  12ef7e3b
- [minor] cleanup cmakelists.txt (#5420) · 838fa0f2
  Lianmin Zheng authored Apr 15, 2025
  
  838fa0f2
- chore: bump sgl-kernel 0.0.9 (#5400) · e940dc4f
  Yineng Zhang authored Apr 14, 2025
  
  e940dc4f
- kernel: support slightly faster merge_state_v2 cuda kernel (#5381) · 388e15c0
  DefTruth authored Apr 15, 2025
  
  388e15c0
- chore: upgrade DeepGEMM (#5395) · 6c41fcf0
  Yineng Zhang authored Apr 14, 2025
  
  6c41fcf0
- minor clean up of sgl-kernel/CMakeLists.txt (#5393) · dae79444
  Lianmin Zheng authored Apr 14, 2025
  
  dae79444
13 Apr, 2025 1 commit
- feat: adapt merge_state (#5337) · b62e7e99
  Yineng Zhang authored Apr 12, 2025
  
  b62e7e99
12 Apr, 2025 8 commits
- chore: bump sgl-kernel v0.0.8.post3 (#5332) · b371f7cd
  Yineng Zhang authored Apr 12, 2025
  
  b371f7cd
- fix: solve cu118 issue for cutlass mla (#5331) · 812e82f3
  Yineng Zhang authored Apr 12, 2025
  
  812e82f3
- [Feat] Add sparse attn to sgl-kernel (#5327) · 4879e50c
  PGFLMG authored Apr 13, 2025
  
  4879e50c
- chore: bump sgl-kernel v0.0.8.post2 (#5317) · 115ae2e7
  Yineng Zhang authored Apr 11, 2025
  
  115ae2e7
- Add flash_attn_varlen_func to sgl-kernel (#5315) · e4155e96
  Baizhou Zhang authored Apr 11, 2025
  
  e4155e96
- update variable naming and comments for rocm (#5299) · 3c9740d2
  Zhaoyi Li authored Apr 12, 2025
  
  3c9740d2
- misc: cleanup 3rdparty (#5311) · 2eb55770
  Yineng Zhang authored Apr 11, 2025
  
  2eb55770
- Blackwell Cutlass MLA kernel (#5142) · f65b8d5c
  Trevor Morris authored Apr 11, 2025
  
  f65b8d5c
11 Apr, 2025 7 commits
- fix: update flash attn (#5308) · 4f288113
  Yineng Zhang authored Apr 11, 2025
  
  4f288113
- fix: remove cublas_grouped_gemm (#5307) · 136b8e6a
  Yineng Zhang authored Apr 11, 2025
  
  136b8e6a
- fix: use fa3 unit test on hopper only (#5304) · c1dd773c
  Yineng Zhang authored Apr 11, 2025
  
  c1dd773c
- chore: bump sgl-kernel v0.0.8.post1 (#5289) · c163bf4f
  Yineng Zhang authored Apr 11, 2025
  
  c163bf4f
- chore: relax the torch version restriction for sgl-kernel compilation (#5288) · 55986343
  Yineng Zhang authored Apr 11, 2025
  
  55986343
- feat: add cu128 identifier for sgl-kernel (#5287) · b75275b6
  Yineng Zhang authored Apr 11, 2025
  
  b75275b6
- fix: enable fp4 compilation on cu128 (#5286) · 7074e9ca
  Yineng Zhang authored Apr 11, 2025
  
  7074e9ca
10 Apr, 2025 5 commits
- Update Makefile / build script to avoid installing incompatible torch dependency (#5245) · a222945d
  Elfie Guo authored Apr 10, 2025
  
  a222945d
- [Misc] Clean sgl-kernel test (#5216) · ed01b451
  PGFLMG authored Apr 11, 2025
  
  ed01b451
- ROCm sgl-kernel: compatible to later torch (#5167) · d050df36
  HAI authored Apr 10, 2025
  
  d050df36
- Fix deepseek-v3 with torch.compile in PyTorch 2.6. (#5213) · 76f44c2a
  Richard Zou authored Apr 10, 2025
  
  76f44c2a
- reduce moe_align_block_size_kernel small batch mode overhead (#5086) · f730362e
  Xiaoyu Zhang authored Apr 10, 2025
  
  f730362e
09 Apr, 2025 3 commits
- sgl-kernel use cutlass latest version for fp8 blockwise gemm (#5207) · ebf495f0
  Yi Zhang authored Apr 10, 2025
  
  ebf495f0
- [Misc] clean up vllm in sgl-kernel test (#5189) · d2e507df
  yinfan98 authored Apr 09, 2025
  
  d2e507df
- FP4 weight loading and inference (2/2) (#3972) · 11d760d5
  Trevor Morris authored Apr 08, 2025
  
  11d760d5
08 Apr, 2025 2 commits
- Add optimized native kernels in sgl-kernel (#5150) · a73c4df4
  Ma Mingfei authored Apr 09, 2025
```
Co-authored-by: Chunyuan WU <chunyuan.wu@intel.com>
Co-authored-by: YanbingJiang <yanbing.jiang@intel.com>
Co-authored-by: blzheng <beilei.zheng@intel.com>
```
  a73c4df4
- [Misc] Use pytest.mark.skipif in sgl-kernel test (#5137) · 9798e72b
  yinfan98 authored Apr 08, 2025
  
  9798e72b