Commits · fc1558e3549249827fe84255f8c46915835007d8 · gaoqiong / composable_kernel_ROCM

18 Feb, 2025 25 commits
- update int4 moe with latest input changes. · fc1558e3
  mtgu0705 authored Feb 18, 2025
  
  fc1558e3
- fix swizzle = false · 9ff2394e
  coderfeli authored Feb 18, 2025
  
  9ff2394e
- opt gemm2 to 2x2 wave · a61084f4
  coderfeli authored Feb 18, 2025
  
  a61084f4
- commit missing files · 854cd8b4
  mtgu0705 authored Feb 18, 2025
  
  854cd8b4
- Split the blockwise pipeline for fp8xint4. · 182e7480
  mtgu0705 authored Feb 18, 2025
  
  182e7480
- fixed merge issue. fp8xint4 and fp8xint4_bpreshuffle function pass. · 966f9051
  mtgu0705 authored Feb 18, 2025
  
  966f9051
- Added b preshuffle pipeline v3 support. · 49bac8ce
  mtgu0705 authored Feb 17, 2025
  
  49bac8ce
- Added moe_pk_i4_gemm2, function pass. · a0432459
  mtgu0705 authored Feb 15, 2025
  
  a0432459
- test expert = 8 and function pass. · a09f038c
  mtgu0705 authored Feb 15, 2025
  
  a09f038c
- fix bug in moe_gemm1.cpp, now function pass. · be79b63b
  mtgu0705 authored Feb 15, 2025
  
  be79b63b
- Initial int4 moe, compile pass, function not check. · 1b0b7810
  mtgu0705 authored Feb 14, 2025
  
  1b0b7810
- modified the tile size to 256, 128x128x128. · e420767e
  mtgu0705 authored Feb 13, 2025
  
  e420767e
- fix bug, function now passes. · fba3d780
  mtgu0705 authored Feb 13, 2025
  
  fba3d780
- move b thread dequant copy to blockwise. · c0ef46ff
  mtgu0705 authored Feb 13, 2025
  
  c0ef46ff
- fix bug, function pass. · a316dff9
  mtgu0705 authored Feb 13, 2025
  
  a316dff9
- init b preshuffle dequant in VGPR. · bee790ec
  mtgu0705 authored Feb 12, 2025
  
  bee790ec
- fix. · ed89a238
  mtgu0705 authored Feb 12, 2025
  
  ed89a238
- fp8xint4 bpreshuffle function pass · 9a3f75ee
  mtgu0705 authored Feb 12, 2025
  
  9a3f75ee
- General fix. · ba5a6a24
  mtgu0705 authored Feb 11, 2025
  
  ba5a6a24
- Added gemm_fp8xint4_Bpreshuffle files, function not checked yet · e0391df7
  mtgu0705 authored Feb 11, 2025
  
  e0391df7
- Init Gemm_fp8xint4 Bpreshuffle · 2559ef64
  mtgu0705 authored Feb 10, 2025
  
  2559ef64
- Add Gemm fp8xint4 example and kernel, function pass. · 8df8a179
  mtgu0705 authored Feb 10, 2025
  
  8df8a179
- hotfix moegemm2 nswizzle · 45d1c52e
  coderfeli authored Feb 18, 2025
  
  45d1c52e
- fix nswizzle=0 · bca3f14c
  coderfeli authored Feb 18, 2025
  
  bca3f14c
- merge 2 moegemm pipe together · e78fbf87
  coderfeli authored Feb 18, 2025
  
  e78fbf87
17 Feb, 2025 8 commits
- chage ktile · 1687fc98
  coderfeli authored Feb 17, 2025
  
  1687fc98
- 2x2 ok · 4404984a
  coderfeli authored Feb 17, 2025
  
  4404984a
- merge haocong branch · f64b1375
  coderfeli authored Feb 17, 2025
  
  f64b1375
- impl sorting count eid · 88412f9e
  coderfeli authored Feb 17, 2025
  
  88412f9e
- revert gemm2 swizz · 4b91d1ce
  coderfeli authored Feb 17, 2025
  
  4b91d1ce
- impl gemm2 swizzle · fcc2c867
  coderfeli authored Feb 17, 2025
  
  fcc2c867
- rm err print · aecd6a38
  coderfeli authored Feb 17, 2025
  
  aecd6a38
- impl e swizzel · 96047cab
  coderfeli authored Feb 17, 2025
  
  96047cab
15 Feb, 2025 4 commits
- fix perf calc · 56cc306d
  coderfeli authored Feb 15, 2025
  
  56cc306d
- merge develop · 7572a691
  coderfeli authored Feb 15, 2025
  
  7572a691
- fix gemm2 scale, gemm2 ok now · 7796fc73
  coderfeli authored Feb 15, 2025
  
  7796fc73
- fix moe gemm2 · 61e3c238
  coderfeli authored Feb 15, 2025
  
  61e3c238
14 Feb, 2025 3 commits
- hotfix:gemm1 use real tokens and gemm2 ok · db53dba4
  coderfeli authored Feb 14, 2025
  
  db53dba4
- fix topk id · 58db931e
  coderfeli authored Feb 14, 2025
  
  58db931e
- merge max_token_id and fix err · 84b27d75
  coderfeli authored Feb 14, 2025
  
  84b27d75