Commits · bb418ced802c6dbb6b0ae0d65218327129148769 · change / sglang

11 Feb, 2025 1 commit
- optimize per token group quant fp8 (#3490) · bb418ced
  Xiaoyu Zhang authored Feb 11, 2025
  
  bb418ced
28 Jan, 2025 1 commit
- clean up useless file (#3192) · 81262c7b
  Xiaoyu Zhang authored Jan 28, 2025
  
  81262c7b
26 Jan, 2025 1 commit
- support w8a8 fp8 kernel with CUTLASS (#3047) · 82392da8
  HandH1998 authored Jan 26, 2025
```
Co-authored-by: yych0745 <1398089567@qq.com>
```
  82392da8
24 Jan, 2025 1 commit
- Add shapes for int8 gemm benchmark (#3093) · 7bad7e75
  Ke Bao authored Jan 24, 2025
  
  7bad7e75
23 Jan, 2025 1 commit
- support lightning_attention_decode in sgl-kernel for MiniMax-Text-01 (#3030) · ac2dc35d
  Xiaoyu Zhang authored Jan 23, 2025
  
  ac2dc35d
15 Jan, 2025 1 commit
- minor: rename bench for sgl kernel (#2909) · b7f3fec1
  Yineng Zhang authored Jan 16, 2025
  
  b7f3fec1
13 Jan, 2025 1 commit
- Sampling penalties memory interface (#2870) · d08c77c4
  Xiaoyu Zhang authored Jan 13, 2025
  
  d08c77c4
06 Jan, 2025 1 commit
- Support cutlass Int8 gemm (#2752) · 0f3eb1d2
  Ke Bao authored Jan 06, 2025
  
  0f3eb1d2