Commits · 62f99e08b364aee76b146109228ba05a0bed9bc1 · change / sglang

05 Aug, 2025 1 commit
- Add initial support for gpt-oss (#8824) · c1d2061f
  Ying Sheng authored Aug 05, 2025
  
  c1d2061f
14 Jul, 2025 1 commit
- [Dockerfile] Multi-arch support for ROCm (#7902) · a562c8a3
  mqhc2020 authored Jul 14, 2025
```
Co-authored-by: Lin, Soga <soga.lin@amd.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
```
  a562c8a3
27 Jun, 2025 1 commit
- Move multimodal processors into a separate folder (#7581) · ce3a3e87
  Lianmin Zheng authored Jun 27, 2025
  
  ce3a3e87
25 Jun, 2025 1 commit
- enable aiter fp8 blockscale quant (#7520) · 4c6675c4
  valarLip authored Jun 25, 2025
  
  4c6675c4
16 Jun, 2025 1 commit
- [fix] fix DeepGEMM blackwell input quant & ut & fix style and log (#7247) · 5ca07eed
  JieXin Liang authored Jun 17, 2025
  
  5ca07eed
14 Jun, 2025 2 commits
- Support new DeepGEMM (#7172) · 93cec433
  fzyzcjy authored Jun 14, 2025
  
  93cec433
- Refactor DeepGEMM integration (#7150) · b4c41f72
  fzyzcjy authored Jun 14, 2025
  
  b4c41f72
13 Jun, 2025 3 commits
- Re-quantize DeepSeek model weights to support DeepGEMM new input format (#7156) · 5b1afa78
  fzyzcjy authored Jun 14, 2025
  
  5b1afa78
- Tiny add sanity checks for DeepGEMM inputs (#7157) · 0f1dfa1e
  fzyzcjy authored Jun 14, 2025
  
  0f1dfa1e
- Minor speed up block_quant_dequant (#6814) · e3ec6bf4
  fzyzcjy authored Jun 14, 2025
  
  e3ec6bf4
06 Jun, 2025 2 commits
- [Feature] Support Flashinfer fmha on Blackwell (#6930) · 5f91c825
  Jianan Ji authored Jun 06, 2025
  
  5f91c825
- AITER backend extension and workload optimizations (#6838) · b819381f
  HAI authored Jun 05, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
```
  b819381f
05 Jun, 2025 1 commit
- Use deepgemm instead of triton for fused_qkv_a_proj_with_mqa (#6890) · 35b65cf0
  fzyzcjy authored Jun 06, 2025
  
  35b65cf0
02 Jun, 2025 1 commit
- Remove contiguous before Flashinfer groupwise fp8 gemm (#6804) · 6a47b730
  Baizhou Zhang authored Jun 01, 2025
  
  6a47b730
29 May, 2025 1 commit
- refactor apply_w8a8_block_fp8_linear in fp (#6545) · 485a023b
  ChangyiYang authored May 29, 2025
  
  485a023b
28 May, 2025 1 commit
- [Feature] Support Flashinfer fp8 blockwise GEMM kernel on Blackwell (#6479) · 791b3bfa
  Baizhou Zhang authored May 28, 2025
  
  791b3bfa
16 May, 2025 1 commit
- [2/2] Add python wrapper for CUTLASS FP8 Blockscale MoE Kernel. (#5694) · 6fc93575
  Elfie Guo authored May 16, 2025
  
  6fc93575
12 May, 2025 2 commits
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd
- fix some typos (#6209) · d738ab52
  applesaucethebun authored May 12, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  d738ab52
08 May, 2025 2 commits
- [perf] dsv3 bmm fallback to bf16 (#5662) · 5e023301
  JieXin Liang authored May 09, 2025
  
  5e023301
- [refactor] slightly tidy fp8 module (#5993) · b70957fc
  JieXin Liang authored May 08, 2025
  
  b70957fc
28 Apr, 2025 1 commit
- ROCm: update AITER (#5816) · d364b9b0
  HAI authored Apr 28, 2025
  
  d364b9b0
21 Apr, 2025 1 commit
- [feature] enable pre compile jit deep_gemm (#5580) · c2942907
  JieXin Liang authored Apr 22, 2025
  
  c2942907
19 Apr, 2025 1 commit
- restruct compressed_tensors_w8a8_fp8 (#5475) · bf86c5e9
  Xiaoyu Zhang authored Apr 19, 2025
  
  bf86c5e9
18 Apr, 2025 2 commits
- fix util import (#5542) · 08b518d5
  Yineng Zhang authored Apr 18, 2025
  
  08b518d5
- use sglang_per_token_group_quant_fp8 from sgl-kernel instead of trion kernel (#5473) · b2a189dd
  strgrb authored Apr 18, 2025
```
Co-authored-by: Zhang Kaihong <zhangkaihong.zkh@alibaba-inc.com>
```
  b2a189dd
16 Apr, 2025 1 commit
- Clean up imports (#5467) · 177320a5
  Lianmin Zheng authored Apr 16, 2025
  
  177320a5
14 Apr, 2025 1 commit
- [perf] experimental enhance fp8 per-tensor quant (#5370) · bdde2375
  JieXin Liang authored Apr 15, 2025
  
  bdde2375
09 Apr, 2025 2 commits

Support Llama4 fp8 inference (#5194) · 40652482

HandH1998 authored Apr 09, 2025


Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: zhyncs <me@zhyncs.com>

40652482

Fix ci test "test_eval_fp8_accuracy" failed (#5185) · 92823069
kk authored Apr 09, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
```
92823069

08 Apr, 2025 2 commits
- Fix torch compile errors (#5158) · 88d6fd9a
  kk authored Apr 08, 2025
  
  88d6fd9a
- Fix run time error in ROCm platform (#5147) · 5a144a8a
  kk authored Apr 08, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: root <root@dell300x-pla-t10-17.pla.dcgpu>
```
  5a144a8a
02 Apr, 2025 1 commit
- sgl scaled_fp8_quant support output padding (#4861) · e9c6ce46
  Xiaoyu Zhang authored Apr 02, 2025
  
  e9c6ce46
26 Mar, 2025 1 commit
- Support compressed tensors fp8w8a8 (#4743) · 04e3ff69
  Xiaoyu Zhang authored Mar 27, 2025
  
  04e3ff69
21 Mar, 2025 1 commit
- fix SUPPORT_CUTLASS_BLOCK_FP8 flag (#4640) · 7b5fc719
  Cheng Wan authored Mar 21, 2025
  
  7b5fc719
19 Mar, 2025 1 commit
- Create col-major and tma-aligned x_scale for deep_gemm.gemm_fp8_fp8_bf16_nt (#4515) · f9c53cbb
  strgrb authored Mar 19, 2025
```
Co-authored-by: Zhang Kaihong <zhangkaihong.zkh@alibaba-inc.com>
```
  f9c53cbb
18 Mar, 2025 1 commit
- [Hotfix] solve fp8 w8a8 ci test fail (#4531) · dd865bef
  Xiaoyu Zhang authored Mar 18, 2025
  
  dd865bef
17 Mar, 2025 1 commit
- sglang quant module remove vllm dependency (#4507) · 9b81f9bd
  Xiaoyu Zhang authored Mar 18, 2025
  
  9b81f9bd
12 Mar, 2025 1 commit
- unify is_cuda and is_hip (#4321) · d1da58e2
  Yineng Zhang authored Mar 11, 2025
  
  d1da58e2
10 Mar, 2025 1 commit
- Amd test fp8 (#4261) · 2ac189ed
  HandH1998 authored Mar 11, 2025
  
  2ac189ed