Commits · 4db463b1ad6edcd6b8cd500be377f65ff8e3b419 · change / sglang

18 Apr, 2025 1 commit
- use sglang_per_token_group_quant_fp8 from sgl-kernel instead of trion kernel (#5473) · b2a189dd
  strgrb authored Apr 18, 2025
```
Co-authored-by: Zhang Kaihong <zhangkaihong.zkh@alibaba-inc.com>
```
  b2a189dd
16 Apr, 2025 1 commit
- Clean up imports (#5467) · 177320a5
  Lianmin Zheng authored Apr 16, 2025
  
  177320a5
14 Apr, 2025 1 commit
- [perf] experimental enhance fp8 per-tensor quant (#5370) · bdde2375
  JieXin Liang authored Apr 15, 2025
  
  bdde2375
09 Apr, 2025 2 commits

Support Llama4 fp8 inference (#5194) · 40652482

HandH1998 authored Apr 09, 2025


Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: zhyncs <me@zhyncs.com>

40652482

Fix ci test "test_eval_fp8_accuracy" failed (#5185) · 92823069
kk authored Apr 09, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
```
92823069

08 Apr, 2025 2 commits
- Fix torch compile errors (#5158) · 88d6fd9a
  kk authored Apr 08, 2025
  
  88d6fd9a
- Fix run time error in ROCm platform (#5147) · 5a144a8a
  kk authored Apr 08, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: root <root@dell300x-pla-t10-17.pla.dcgpu>
```
  5a144a8a
02 Apr, 2025 1 commit
- sgl scaled_fp8_quant support output padding (#4861) · e9c6ce46
  Xiaoyu Zhang authored Apr 02, 2025
  
  e9c6ce46
26 Mar, 2025 1 commit
- Support compressed tensors fp8w8a8 (#4743) · 04e3ff69
  Xiaoyu Zhang authored Mar 27, 2025
  
  04e3ff69
21 Mar, 2025 1 commit
- fix SUPPORT_CUTLASS_BLOCK_FP8 flag (#4640) · 7b5fc719
  Cheng Wan authored Mar 21, 2025
  
  7b5fc719
19 Mar, 2025 1 commit
- Create col-major and tma-aligned x_scale for deep_gemm.gemm_fp8_fp8_bf16_nt (#4515) · f9c53cbb
  strgrb authored Mar 19, 2025
```
Co-authored-by: Zhang Kaihong <zhangkaihong.zkh@alibaba-inc.com>
```
  f9c53cbb
18 Mar, 2025 1 commit
- [Hotfix] solve fp8 w8a8 ci test fail (#4531) · dd865bef
  Xiaoyu Zhang authored Mar 18, 2025
  
  dd865bef
17 Mar, 2025 1 commit
- sglang quant module remove vllm dependency (#4507) · 9b81f9bd
  Xiaoyu Zhang authored Mar 18, 2025
  
  9b81f9bd
12 Mar, 2025 1 commit
- unify is_cuda and is_hip (#4321) · d1da58e2
  Yineng Zhang authored Mar 11, 2025
  
  d1da58e2
10 Mar, 2025 2 commits
- Amd test fp8 (#4261) · 2ac189ed
  HandH1998 authored Mar 11, 2025
  
  2ac189ed
- Clean up fp8 support (#4230) · e8a69e4d
  Lianmin Zheng authored Mar 09, 2025
  
  e8a69e4d
09 Mar, 2025 1 commit
- Apply sgl w8a8 fp8 kernel (#3148) · 0dd6cda2
  HandH1998 authored Mar 09, 2025
  
  0dd6cda2
05 Mar, 2025 1 commit
- ROCM: AITER BLOCK GEMM (#4075) · 5be8f1ed
  yigex authored Mar 05, 2025
  
  5be8f1ed
20 Feb, 2025 1 commit
- add control for cutlass fp8 blockwise gemm (#3727) · 1eb8eade
  yizhang2077 authored Feb 20, 2025
  
  1eb8eade
12 Feb, 2025 1 commit
- integrate blockwise fp8 kernel (#3529) · 98eecbda
  yizhang2077 authored Feb 13, 2025
  
  98eecbda
13 Jan, 2025 1 commit
- Fix linear.py and improve weight loading (#2851) · 72c77763
  Lianmin Zheng authored Jan 13, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  72c77763
29 Dec, 2024 1 commit
- AMD: set weights and scaling numbers properly for block FP8 (#2637) · 30828e71
  HAI authored Dec 29, 2024
  
  30828e71
25 Dec, 2024 1 commit
- Refactor MoE (#2575) · 53aed988
  HandH1998 authored Dec 26, 2024
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  53aed988
04 Dec, 2024 1 commit
- Adding SGLang FP8 Utils (#2348) · b2986d7a
  HAI authored Dec 04, 2024
  
  b2986d7a