Commits · b371f7cd3626cd1ef8fa0b61b5d34b3fa6c4d47e · change / sglang · GitLab

12 Apr, 2025 8 commits
- chore: bump sgl-kernel v0.0.8.post3 (#5332) · b371f7cd
  Yineng Zhang authored Apr 12, 2025
  
  b371f7cd
- fix: solve cu118 issue for cutlass mla (#5331) · 812e82f3
  Yineng Zhang authored Apr 12, 2025
  
  812e82f3
- [Feat] Add sparse attn to sgl-kernel (#5327) · 4879e50c
  PGFLMG authored Apr 13, 2025
  
  4879e50c
- chore: bump sgl-kernel v0.0.8.post2 (#5317) · 115ae2e7
  Yineng Zhang authored Apr 11, 2025
  
  115ae2e7
- Add flash_attn_varlen_func to sgl-kernel (#5315) · e4155e96
  Baizhou Zhang authored Apr 11, 2025
  
  e4155e96
- update variable naming and comments for rocm (#5299) · 3c9740d2
  Zhaoyi Li authored Apr 12, 2025
  
  3c9740d2
- misc: cleanup 3rdparty (#5311) · 2eb55770
  Yineng Zhang authored Apr 11, 2025
  
  2eb55770
- Blackwell Cutlass MLA kernel (#5142) · f65b8d5c
  Trevor Morris authored Apr 11, 2025
  
  f65b8d5c
11 Apr, 2025 7 commits
- fix: update flash attn (#5308) · 4f288113
  Yineng Zhang authored Apr 11, 2025
  
  4f288113
- fix: remove cublas_grouped_gemm (#5307) · 136b8e6a
  Yineng Zhang authored Apr 11, 2025
  
  136b8e6a
- fix: use fa3 unit test on hopper only (#5304) · c1dd773c
  Yineng Zhang authored Apr 11, 2025
  
  c1dd773c
- chore: bump sgl-kernel v0.0.8.post1 (#5289) · c163bf4f
  Yineng Zhang authored Apr 11, 2025
  
  c163bf4f
- chore: relax the torch version restriction for sgl-kernel compilation (#5288) · 55986343
  Yineng Zhang authored Apr 11, 2025
  
  55986343
- feat: add cu128 identifier for sgl-kernel (#5287) · b75275b6
  Yineng Zhang authored Apr 11, 2025
  
  b75275b6
- fix: enable fp4 compilation on cu128 (#5286) · 7074e9ca
  Yineng Zhang authored Apr 11, 2025
  
  7074e9ca
10 Apr, 2025 5 commits
- Update Makefile / build script to avoid installing incompatible torch dependency (#5245) · a222945d
  Elfie Guo authored Apr 10, 2025
  
  a222945d
- [Misc] Clean sgl-kernel test (#5216) · ed01b451
  PGFLMG authored Apr 11, 2025
  
  ed01b451
- ROCm sgl-kernel: compatible to later torch (#5167) · d050df36
  HAI authored Apr 10, 2025
  
  d050df36
- Fix deepseek-v3 with torch.compile in PyTorch 2.6. (#5213) · 76f44c2a
  Richard Zou authored Apr 10, 2025
  
  76f44c2a
- reduce moe_align_block_size_kernel small batch mode overhead (#5086) · f730362e
  Xiaoyu Zhang authored Apr 10, 2025
  
  f730362e
09 Apr, 2025 3 commits
- sgl-kernel use cutlass latest version for fp8 blockwise gemm (#5207) · ebf495f0
  Yi Zhang authored Apr 10, 2025
  
  ebf495f0
- [Misc] clean up vllm in sgl-kernel test (#5189) · d2e507df
  yinfan98 authored Apr 09, 2025
  
  d2e507df
- FP4 weight loading and inference (2/2) (#3972) · 11d760d5
  Trevor Morris authored Apr 08, 2025
  
  11d760d5
08 Apr, 2025 2 commits
- Add optimized native kernels in sgl-kernel (#5150) · a73c4df4
  Ma Mingfei authored Apr 09, 2025
```
Co-authored-by: Chunyuan WU <chunyuan.wu@intel.com>
Co-authored-by: YanbingJiang <yanbing.jiang@intel.com>
Co-authored-by: blzheng <beilei.zheng@intel.com>
```
  a73c4df4
- [Misc] Use pytest.mark.skipif in sgl-kernel test (#5137) · 9798e72b
  yinfan98 authored Apr 08, 2025
  
  9798e72b
05 Apr, 2025 2 commits
- bump sgl-kernel 0.0.8 (#5089) · 496dde84
  Yineng Zhang authored Apr 05, 2025
  
  496dde84
- sgl-kernel transfer custom allreduce from trt kernel to vllm kernel (#5079) · bcbbf519
  Yi Zhang authored Apr 06, 2025
  
  bcbbf519
04 Apr, 2025 2 commits
- support sgl-kernel on blackwell (#5074) · 3f287b85
  Yineng Zhang authored Apr 04, 2025
  
  3f287b85
- Add DeepSeek V3/R1 shared experts fusion (#4918) · 924ca7c9
  Xiaoyu Zhang authored Apr 04, 2025
  
  924ca7c9
03 Apr, 2025 6 commits
- bump sgl-kernel v0.0.7 (#5046) · d7954b76
  Yineng Zhang authored Apr 03, 2025
  
  d7954b76
- [Fix] fix fa3 build at cu118 (#5036) · b8b6008f
  yinfan98 authored Apr 04, 2025
  
  b8b6008f
- fix deepgemm as well (#5030) · 9d0b36c4
  Zhiqiang Xie authored Apr 03, 2025
  
  9d0b36c4
- [Build] Support build sgl-kernel with ccache (#5020) · 7d8c0ce7
  Yuhong Guo authored Apr 03, 2025
  
  7d8c0ce7
- update cutlass tag (#5011) · a2aea59b
  Zhiqiang Xie authored Apr 02, 2025
  
  a2aea59b
- [sgl-kernel] per token group quant support COLUMN MAJOR (#4817) · 2c8fd993
  Xiaoyu Zhang authored Apr 03, 2025
  
  2c8fd993
31 Mar, 2025 3 commits
- [Build] Fix cuda12.8 build error in nvfp4_scaled_mm_kernels.cu (#4953) · ee47a6c1
  Yuhong Guo authored Apr 01, 2025
  
  ee47a6c1
- bump sgl-kernel v0.0.6 (#4950) · 6384d317
  Yineng Zhang authored Mar 31, 2025
  
  6384d317
- [Fix] revert clean m.def for cudagraph (#4944) · c7457191
  yinfan98 authored Mar 31, 2025
  
  c7457191
30 Mar, 2025 2 commits
- cleanup sgl-kernel (#4933) · 4814ecaf
  Yineng Zhang authored Mar 30, 2025
  
  4814ecaf
- [feat] add fa3 in sgl-kernel (#4902) · 37c66ec8
  yinfan98 authored Mar 31, 2025
```
Co-authored-by: Sleepcoo <Sleepcoo@gmail.com>
```
  37c66ec8