Commits · 136b8e6afbc557fe5890aee490e7579d1be4a614 · change / sglang

"vscode:/vscode.git/clone" did not exist on "fa7e2c3049fd0ec38502f5a847dc624a96363b34"

11 Apr, 2025 6 commits
- fix: remove cublas_grouped_gemm (#5307) · 136b8e6a
  Yineng Zhang authored Apr 11, 2025
  
  136b8e6a
- fix: use fa3 unit test on hopper only (#5304) · c1dd773c
  Yineng Zhang authored Apr 11, 2025
  
  c1dd773c
- chore: bump sgl-kernel v0.0.8.post1 (#5289) · c163bf4f
  Yineng Zhang authored Apr 11, 2025
  
  c163bf4f
- chore: relax the torch version restriction for sgl-kernel compilation (#5288) · 55986343
  Yineng Zhang authored Apr 11, 2025
  
  55986343
- feat: add cu128 identifier for sgl-kernel (#5287) · b75275b6
  Yineng Zhang authored Apr 11, 2025
  
  b75275b6
- fix: enable fp4 compilation on cu128 (#5286) · 7074e9ca
  Yineng Zhang authored Apr 11, 2025
  
  7074e9ca
10 Apr, 2025 5 commits
- Update Makefile / build script to avoid installing incompatible torch dependency (#5245) · a222945d
  Elfie Guo authored Apr 10, 2025
  
  a222945d
- [Misc] Clean sgl-kernel test (#5216) · ed01b451
  PGFLMG authored Apr 11, 2025
  
  ed01b451
- ROCm sgl-kernel: compatible to later torch (#5167) · d050df36
  HAI authored Apr 10, 2025
  
  d050df36
- Fix deepseek-v3 with torch.compile in PyTorch 2.6. (#5213) · 76f44c2a
  Richard Zou authored Apr 10, 2025
  
  76f44c2a
- reduce moe_align_block_size_kernel small batch mode overhead (#5086) · f730362e
  Xiaoyu Zhang authored Apr 10, 2025
  
  f730362e
09 Apr, 2025 3 commits
- sgl-kernel use cutlass latest version for fp8 blockwise gemm (#5207) · ebf495f0
  Yi Zhang authored Apr 10, 2025
  
  ebf495f0
- [Misc] clean up vllm in sgl-kernel test (#5189) · d2e507df
  yinfan98 authored Apr 09, 2025
  
  d2e507df
- FP4 weight loading and inference (2/2) (#3972) · 11d760d5
  Trevor Morris authored Apr 08, 2025
  
  11d760d5
08 Apr, 2025 2 commits
- Add optimized native kernels in sgl-kernel (#5150) · a73c4df4
  Ma Mingfei authored Apr 09, 2025
```
Co-authored-by: Chunyuan WU <chunyuan.wu@intel.com>
Co-authored-by: YanbingJiang <yanbing.jiang@intel.com>
Co-authored-by: blzheng <beilei.zheng@intel.com>
```
  a73c4df4
- [Misc] Use pytest.mark.skipif in sgl-kernel test (#5137) · 9798e72b
  yinfan98 authored Apr 08, 2025
  
  9798e72b
05 Apr, 2025 2 commits
- bump sgl-kernel 0.0.8 (#5089) · 496dde84
  Yineng Zhang authored Apr 05, 2025
  
  496dde84
- sgl-kernel transfer custom allreduce from trt kernel to vllm kernel (#5079) · bcbbf519
  Yi Zhang authored Apr 06, 2025
  
  bcbbf519
04 Apr, 2025 2 commits
- support sgl-kernel on blackwell (#5074) · 3f287b85
  Yineng Zhang authored Apr 04, 2025
  
  3f287b85
- Add DeepSeek V3/R1 shared experts fusion (#4918) · 924ca7c9
  Xiaoyu Zhang authored Apr 04, 2025
  
  924ca7c9
03 Apr, 2025 6 commits
- bump sgl-kernel v0.0.7 (#5046) · d7954b76
  Yineng Zhang authored Apr 03, 2025
  
  d7954b76
- [Fix] fix fa3 build at cu118 (#5036) · b8b6008f
  yinfan98 authored Apr 04, 2025
  
  b8b6008f
- fix deepgemm as well (#5030) · 9d0b36c4
  Zhiqiang Xie authored Apr 03, 2025
  
  9d0b36c4
- [Build] Support build sgl-kernel with ccache (#5020) · 7d8c0ce7
  Yuhong Guo authored Apr 03, 2025
  
  7d8c0ce7
- update cutlass tag (#5011) · a2aea59b
  Zhiqiang Xie authored Apr 02, 2025
  
  a2aea59b
- [sgl-kernel] per token group quant support COLUMN MAJOR (#4817) · 2c8fd993
  Xiaoyu Zhang authored Apr 03, 2025
  
  2c8fd993
31 Mar, 2025 3 commits
- [Build] Fix cuda12.8 build error in nvfp4_scaled_mm_kernels.cu (#4953) · ee47a6c1
  Yuhong Guo authored Apr 01, 2025
  
  ee47a6c1
- bump sgl-kernel v0.0.6 (#4950) · 6384d317
  Yineng Zhang authored Mar 31, 2025
  
  6384d317
- [Fix] revert clean m.def for cudagraph (#4944) · c7457191
  yinfan98 authored Mar 31, 2025
  
  c7457191
30 Mar, 2025 6 commits
- cleanup sgl-kernel (#4933) · 4814ecaf
  Yineng Zhang authored Mar 30, 2025
  
  4814ecaf
- [feat] add fa3 in sgl-kernel (#4902) · 37c66ec8
  yinfan98 authored Mar 31, 2025
```
Co-authored-by: Sleepcoo <Sleepcoo@gmail.com>
```
  37c66ec8
- fix bmm fp8 (#4926) · 195a09f5
  Yineng Zhang authored Mar 30, 2025
  
  195a09f5
- [Feature] use pytest for sgl-kernel (#4896) · 9fccda31
  Adarsh Shirawalmath authored Mar 30, 2025
  
  9fccda31
- fix allreduce test (#4909) · 5ec5eaf7
  Yi Zhang authored Mar 30, 2025
  
  5ec5eaf7
- [Misc] Clean m.def and add Development Tips (#4890) · 0d7fe866
  yinfan98 authored Mar 30, 2025
  
  0d7fe866
29 Mar, 2025 5 commits
- remove setup for sgl-kernel (#4899) · 54b9a2de
  Yineng Zhang authored Mar 29, 2025
  
  54b9a2de
- quick fix: add default for new kernel (#4898) · 8e7b3154
  yinfan98 authored Mar 30, 2025
  
  8e7b3154
- Add deepseek style fused moe group gate selection kernel (#4530) · 45dcfc2e
  Qingquan Song authored Mar 29, 2025
  
  45dcfc2e
- Delete test_deep_gemm.py (#4891) · ddf8981d
  yinfan98 authored Mar 30, 2025
  
  ddf8981d
- [Docs] Update DeepGEMM at README.md (#4886) · 05625b97
  yinfan98 authored Mar 30, 2025
  
  05625b97