Commits · c2f212d672ccaf8a1e5ef09099e981d943600b14 · change / sglang

18 Jan, 2025 1 commit
- optimize MiniMax-Text-01 lightning_attn_decode triton (#2966) · c2f212d6
  Xiaoyu Zhang authored Jan 18, 2025
  
  c2f212d6
16 Jan, 2025 2 commits
- [kernel] MiniMax-Text-01 decode lightning_attn with triton (#2920) · 78e974b2
  Xiaoyu Zhang authored Jan 17, 2025
  
  78e974b2
- [kernel] MiniMax-Text-01 prefill lightning_attn with triton (#2911) · ab317936
  Xiaoyu Zhang authored Jan 16, 2025
  
  ab317936
13 Jan, 2025 2 commits
- Sampling penalties memory interface (#2870) · d08c77c4
  Xiaoyu Zhang authored Jan 13, 2025
  
  d08c77c4
- Add int8 quant kernel (#2848) · 85b2e057
  Ke Bao authored Jan 13, 2025
  
  85b2e057
07 Jan, 2025 2 commits
- Misc fix for min_p_sampling, --cuda-graph-bs (#2761) · bdc1acf6
  Lianmin Zheng authored Jan 07, 2025
  
  bdc1acf6
- add benchmark_moe_align_blocks (#2767) · 380930a9
  Xiaoyu Zhang authored Jan 07, 2025
  
  380930a9
29 Dec, 2024 1 commit
- Update Triton configs for block fp8 kernels (#2641) · afa0341e
  HandH1998 authored Dec 29, 2024
  
  afa0341e
28 Dec, 2024 1 commit
- add configs for block fp8 related kernels (#2628) · 7863e436
  Yineng Zhang authored Dec 28, 2024
```
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  7863e436
26 Dec, 2024 1 commit
- h100 tuning fused_moe_triton for qwen2 moe (#2560) · 9a23c484
  Xiaoyu Zhang authored Dec 26, 2024
  
  9a23c484
23 Dec, 2024 1 commit
- Reorg moe code (#2563) · e835a500
  Ke Bao authored Dec 24, 2024
  
  e835a500
22 Dec, 2024 1 commit
- [kernel optimize] benchmark write_req_to_token_pool_triton and optimize kernel (#2509) · 7d672d27
  Xiaoyu Zhang authored Dec 22, 2024
  
  7d672d27
17 Dec, 2024 1 commit
- benchmark decoding attention kernel with cudnn (#2467) · e2102669
  bjmsong authored Dec 17, 2024
```
Co-authored-by: root <bjmsong@126.com>
```
  e2102669
15 Dec, 2024 1 commit
- [Benchmark] add a benchmark for hf/vllm/sglang rmsnorm (#2486) · a0592c05
  Xiaoyu Zhang authored Dec 15, 2024
  
  a0592c05
11 Dec, 2024 1 commit
- decoding attention kernel benchmark (#2425) · f6772394
  bjmsong authored Dec 11, 2024
```
Co-authored-by: root <bjmsong@126.com>
```
  f6772394
09 Dec, 2024 1 commit
- Add a unittest for fused_moe (#2416) · 3844feb9
  Xiaoyu Zhang authored Dec 09, 2024
  
  3844feb9
03 Dec, 2024 1 commit
- Improve torch compile for fused moe (#2327) · 07ec07ad
  Lianmin Zheng authored Dec 03, 2024
  
  07ec07ad
02 Dec, 2024 1 commit
- Add more fused moe benchmark utilities (#2314) · 33deca81
  Lianmin Zheng authored Dec 02, 2024
  
  33deca81
29 Nov, 2024 1 commit
- [benchmark] Add fused_moe_triton benchmark and tuning tools (#2225) · 262e370f
  Xiaoyu Zhang authored Nov 30, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: HAI <hixiao@gmail.com>
```
  262e370f