Commits · 40d9b8acce88ae8abd4e48a6f5c09f409e7b41c8 · change / sglang · GitLab

23 Apr, 2025 4 commits
- chore: bump sgl-kernel 0.1.0 (#5688) · 7d0edf3c
  Yineng Zhang authored Apr 23, 2025
  
  7d0edf3c
- fix: only compile ApplyTokenBitmaskInplace cu124+ (#5686) · ce4ecba4
  Yineng Zhang authored Apr 23, 2025
  
  ce4ecba4
- fix sgl-kernel unit tests (#5666) · 15fabcc0
  Yineng Zhang authored Apr 23, 2025
  
  15fabcc0
- [1/2] Add FP8 Blockscale MoE CUTLASS kernel for Blackwell (#5281) · e62c4955
  Elfie Guo authored Apr 22, 2025
  
  e62c4955
20 Apr, 2025 1 commit
- Fix sampler nan check when calling top_k_top_p_sampling_from_probs (#5546) · 20f1c8e3
  Yubo Wang authored Apr 19, 2025
  
  20f1c8e3
18 Apr, 2025 2 commits
- chore: bump sgl-kernel 0.0.9.post2 (#5518) · f28d8299
  Yineng Zhang authored Apr 17, 2025
  
  f28d8299
- Sgl kernel fused_moe_gate support n_shared_experts (#5440) · 8e09b370
  Xiaoyu Zhang authored Apr 18, 2025
  
  8e09b370
17 Apr, 2025 3 commits
- [Feat] Update sgl-kernel flashinfer to latest main version (#5500) · c08a717c
  PGFLMG authored Apr 18, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  c08a717c
- Fix a link in sgl-kernel/README.md (#5493) · 22c2a79d
  Michael Yao authored Apr 17, 2025
  
  22c2a79d
- Add test for flash_attn_varlen_func kernel (#5484) · 81c89111
  Baizhou Zhang authored Apr 17, 2025
  
  81c89111
16 Apr, 2025 1 commit
- Update cutlass dependency. (#5447) · 85ec0440
  Elfie Guo authored Apr 15, 2025
  
  85ec0440
15 Apr, 2025 9 commits
- BLackwell cutlass mla: Add check for bad page size/block num combinations (#5431) · e8f62b20
  Trevor Morris authored Apr 15, 2025
  
  e8f62b20
- fix: solve release issue (#5434) · 88defc4d
  Yineng Zhang authored Apr 15, 2025
  
  88defc4d
- chore: bump sgl-kernel v0.0.9.post1 (#5430) · 6f509d55
  Yineng Zhang authored Apr 15, 2025
  
  6f509d55
- bugfix: fix merge_state_v2 cuda graph (#5419) · 12ef7e3b
  DefTruth authored Apr 16, 2025
  
  12ef7e3b
- [minor] cleanup cmakelists.txt (#5420) · 838fa0f2
  Lianmin Zheng authored Apr 15, 2025
  
  838fa0f2
- chore: bump sgl-kernel 0.0.9 (#5400) · e940dc4f
  Yineng Zhang authored Apr 14, 2025
  
  e940dc4f
- kernel: support slightly faster merge_state_v2 cuda kernel (#5381) · 388e15c0
  DefTruth authored Apr 15, 2025
  
  388e15c0
- chore: upgrade DeepGEMM (#5395) · 6c41fcf0
  Yineng Zhang authored Apr 14, 2025
  
  6c41fcf0
- minor clean up of sgl-kernel/CMakeLists.txt (#5393) · dae79444
  Lianmin Zheng authored Apr 14, 2025
  
  dae79444
13 Apr, 2025 1 commit
- feat: adapt merge_state (#5337) · b62e7e99
  Yineng Zhang authored Apr 12, 2025
  
  b62e7e99
12 Apr, 2025 8 commits
- chore: bump sgl-kernel v0.0.8.post3 (#5332) · b371f7cd
  Yineng Zhang authored Apr 12, 2025
  
  b371f7cd
- fix: solve cu118 issue for cutlass mla (#5331) · 812e82f3
  Yineng Zhang authored Apr 12, 2025
  
  812e82f3
- [Feat] Add sparse attn to sgl-kernel (#5327) · 4879e50c
  PGFLMG authored Apr 13, 2025
  
  4879e50c
- chore: bump sgl-kernel v0.0.8.post2 (#5317) · 115ae2e7
  Yineng Zhang authored Apr 11, 2025
  
  115ae2e7
- Add flash_attn_varlen_func to sgl-kernel (#5315) · e4155e96
  Baizhou Zhang authored Apr 11, 2025
  
  e4155e96
- update variable naming and comments for rocm (#5299) · 3c9740d2
  Zhaoyi Li authored Apr 12, 2025
  
  3c9740d2
- misc: cleanup 3rdparty (#5311) · 2eb55770
  Yineng Zhang authored Apr 11, 2025
  
  2eb55770
- Blackwell Cutlass MLA kernel (#5142) · f65b8d5c
  Trevor Morris authored Apr 11, 2025
  
  f65b8d5c
11 Apr, 2025 7 commits
- fix: update flash attn (#5308) · 4f288113
  Yineng Zhang authored Apr 11, 2025
  
  4f288113
- fix: remove cublas_grouped_gemm (#5307) · 136b8e6a
  Yineng Zhang authored Apr 11, 2025
  
  136b8e6a
- fix: use fa3 unit test on hopper only (#5304) · c1dd773c
  Yineng Zhang authored Apr 11, 2025
  
  c1dd773c
- chore: bump sgl-kernel v0.0.8.post1 (#5289) · c163bf4f
  Yineng Zhang authored Apr 11, 2025
  
  c163bf4f
- chore: relax the torch version restriction for sgl-kernel compilation (#5288) · 55986343
  Yineng Zhang authored Apr 11, 2025
  
  55986343
- feat: add cu128 identifier for sgl-kernel (#5287) · b75275b6
  Yineng Zhang authored Apr 11, 2025
  
  b75275b6
- fix: enable fp4 compilation on cu128 (#5286) · 7074e9ca
  Yineng Zhang authored Apr 11, 2025
  
  7074e9ca
10 Apr, 2025 4 commits
- Update Makefile / build script to avoid installing incompatible torch dependency (#5245) · a222945d
  Elfie Guo authored Apr 10, 2025
  
  a222945d
- [Misc] Clean sgl-kernel test (#5216) · ed01b451
  PGFLMG authored Apr 11, 2025
  
  ed01b451
- ROCm sgl-kernel: compatible to later torch (#5167) · d050df36
  HAI authored Apr 10, 2025
  
  d050df36
- Fix deepseek-v3 with torch.compile in PyTorch 2.6. (#5213) · 76f44c2a
  Richard Zou authored Apr 10, 2025
  
  76f44c2a