Commits · c49c1d9226ad0a380aa854f60ea7daf5db191477 · zhaoyu6 / sglang

13 Jun, 2025 2 commits
- Tiny add sanity checks for DeepGEMM inputs (#7157) · 0f1dfa1e
  fzyzcjy authored Jun 14, 2025
  
  0f1dfa1e
- Minor speed up block_quant_dequant (#6814) · e3ec6bf4
  fzyzcjy authored Jun 14, 2025
  
  e3ec6bf4
06 Jun, 2025 2 commits
- [Feature] Support Flashinfer fmha on Blackwell (#6930) · 5f91c825
  Jianan Ji authored Jun 06, 2025
  
  5f91c825
- AITER backend extension and workload optimizations (#6838) · b819381f
  HAI authored Jun 05, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
```
  b819381f
05 Jun, 2025 1 commit
- Use deepgemm instead of triton for fused_qkv_a_proj_with_mqa (#6890) · 35b65cf0
  fzyzcjy authored Jun 06, 2025
  
  35b65cf0
02 Jun, 2025 1 commit
- Remove contiguous before Flashinfer groupwise fp8 gemm (#6804) · 6a47b730
  Baizhou Zhang authored Jun 01, 2025
  
  6a47b730
29 May, 2025 1 commit
- refactor apply_w8a8_block_fp8_linear in fp (#6545) · 485a023b
  ChangyiYang authored May 29, 2025
  
  485a023b
28 May, 2025 1 commit
- [Feature] Support Flashinfer fp8 blockwise GEMM kernel on Blackwell (#6479) · 791b3bfa
  Baizhou Zhang authored May 28, 2025
  
  791b3bfa
16 May, 2025 1 commit
- [2/2] Add python wrapper for CUTLASS FP8 Blockscale MoE Kernel. (#5694) · 6fc93575
  Elfie Guo authored May 16, 2025
  
  6fc93575
12 May, 2025 2 commits
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd
- fix some typos (#6209) · d738ab52
  applesaucethebun authored May 12, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  d738ab52
08 May, 2025 2 commits
- [perf] dsv3 bmm fallback to bf16 (#5662) · 5e023301
  JieXin Liang authored May 09, 2025
  
  5e023301
- [refactor] slightly tidy fp8 module (#5993) · b70957fc
  JieXin Liang authored May 08, 2025
  
  b70957fc
28 Apr, 2025 1 commit
- ROCm: update AITER (#5816) · d364b9b0
  HAI authored Apr 28, 2025
  
  d364b9b0
21 Apr, 2025 1 commit
- [feature] enable pre compile jit deep_gemm (#5580) · c2942907
  JieXin Liang authored Apr 22, 2025
  
  c2942907
19 Apr, 2025 1 commit
- restruct compressed_tensors_w8a8_fp8 (#5475) · bf86c5e9
  Xiaoyu Zhang authored Apr 19, 2025
  
  bf86c5e9
18 Apr, 2025 2 commits
- fix util import (#5542) · 08b518d5
  Yineng Zhang authored Apr 18, 2025
  
  08b518d5
- use sglang_per_token_group_quant_fp8 from sgl-kernel instead of trion kernel (#5473) · b2a189dd
  strgrb authored Apr 18, 2025
```
Co-authored-by: Zhang Kaihong <zhangkaihong.zkh@alibaba-inc.com>
```
  b2a189dd
16 Apr, 2025 1 commit
- Clean up imports (#5467) · 177320a5
  Lianmin Zheng authored Apr 16, 2025
  
  177320a5
14 Apr, 2025 1 commit
- [perf] experimental enhance fp8 per-tensor quant (#5370) · bdde2375
  JieXin Liang authored Apr 15, 2025
  
  bdde2375
09 Apr, 2025 2 commits

Support Llama4 fp8 inference (#5194) · 40652482

HandH1998 authored Apr 09, 2025


Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: zhyncs <me@zhyncs.com>

40652482

Fix ci test "test_eval_fp8_accuracy" failed (#5185) · 92823069
kk authored Apr 09, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
```
92823069

08 Apr, 2025 2 commits
- Fix torch compile errors (#5158) · 88d6fd9a
  kk authored Apr 08, 2025
  
  88d6fd9a
- Fix run time error in ROCm platform (#5147) · 5a144a8a
  kk authored Apr 08, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: root <root@dell300x-pla-t10-17.pla.dcgpu>
```
  5a144a8a
02 Apr, 2025 1 commit
- sgl scaled_fp8_quant support output padding (#4861) · e9c6ce46
  Xiaoyu Zhang authored Apr 02, 2025
  
  e9c6ce46
26 Mar, 2025 1 commit
- Support compressed tensors fp8w8a8 (#4743) · 04e3ff69
  Xiaoyu Zhang authored Mar 27, 2025
  
  04e3ff69
21 Mar, 2025 1 commit
- fix SUPPORT_CUTLASS_BLOCK_FP8 flag (#4640) · 7b5fc719
  Cheng Wan authored Mar 21, 2025
  
  7b5fc719
19 Mar, 2025 1 commit
- Create col-major and tma-aligned x_scale for deep_gemm.gemm_fp8_fp8_bf16_nt (#4515) · f9c53cbb
  strgrb authored Mar 19, 2025
```
Co-authored-by: Zhang Kaihong <zhangkaihong.zkh@alibaba-inc.com>
```
  f9c53cbb
18 Mar, 2025 1 commit
- [Hotfix] solve fp8 w8a8 ci test fail (#4531) · dd865bef
  Xiaoyu Zhang authored Mar 18, 2025
  
  dd865bef
17 Mar, 2025 1 commit
- sglang quant module remove vllm dependency (#4507) · 9b81f9bd
  Xiaoyu Zhang authored Mar 18, 2025
  
  9b81f9bd
12 Mar, 2025 1 commit
- unify is_cuda and is_hip (#4321) · d1da58e2
  Yineng Zhang authored Mar 11, 2025
  
  d1da58e2
10 Mar, 2025 2 commits
- Amd test fp8 (#4261) · 2ac189ed
  HandH1998 authored Mar 11, 2025
  
  2ac189ed
- Clean up fp8 support (#4230) · e8a69e4d
  Lianmin Zheng authored Mar 09, 2025
  
  e8a69e4d
09 Mar, 2025 1 commit
- Apply sgl w8a8 fp8 kernel (#3148) · 0dd6cda2
  HandH1998 authored Mar 09, 2025
  
  0dd6cda2
05 Mar, 2025 1 commit
- ROCM: AITER BLOCK GEMM (#4075) · 5be8f1ed
  yigex authored Mar 05, 2025
  
  5be8f1ed
20 Feb, 2025 1 commit
- add control for cutlass fp8 blockwise gemm (#3727) · 1eb8eade
  yizhang2077 authored Feb 20, 2025
  
  1eb8eade
12 Feb, 2025 1 commit
- integrate blockwise fp8 kernel (#3529) · 98eecbda
  yizhang2077 authored Feb 13, 2025
  
  98eecbda
13 Jan, 2025 1 commit
- Fix linear.py and improve weight loading (#2851) · 72c77763
  Lianmin Zheng authored Jan 13, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  72c77763
29 Dec, 2024 1 commit
- AMD: set weights and scaling numbers properly for block FP8 (#2637) · 30828e71
  HAI authored Dec 29, 2024
  
  30828e71
25 Dec, 2024 1 commit
- Refactor MoE (#2575) · 53aed988
  HandH1998 authored Dec 26, 2024
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  53aed988