Skip to content

GitLab

"vscode:/vscode.git/clone" did not exist on "feea11e2bb2bc5f42ceca64255900e3917d87f98"
Switch branch/tag
  1. 07 Dec, 2024 1 commit
  3. 06 Dec, 2024 2 commits
  5. 05 Dec, 2024 2 commits
  7. 04 Dec, 2024 5 commits
  9. 30 Nov, 2024 1 commit
    • mtgu0705's avatar
      Merge the int4 kernel and profiling in one commit for RTP. · 40054f53
      mtgu0705 authored 
      Add int4+scale based on Zhang, Jing pk_i4. Compile pass, function pass.
Modify the kernel to 128x128x128, and use mfma_32x32x4
Move the weight permute from host to device

Modified the scale init method.

Modified the init method, the function is failed, need to debug.

Added init method

Support group=128 for Llam2-7B-int4

Move the weight permute from host to device

Add ckProfiler for GEMM b scale (int4)

Add reference function.

Add pipeline v4 (2 LDS pingpong)

Add more int4-Gemm kernel profiling instances.

Modify the in4-Gemm kernel instances

Move the pk_i4 permute in kernel
      40054f53
  11. 27 Oct, 2024 1 commit
  13. 24 Oct, 2024 2 commits
  15. 23 Oct, 2024 7 commits
  17. 22 Oct, 2024 5 commits
  19. 21 Oct, 2024 3 commits
  21. 20 Oct, 2024 3 commits
  23. 18 Oct, 2024 2 commits
  25. 16 Oct, 2024 1 commit
  27. 15 Oct, 2024 3 commits
  29. 14 Oct, 2024 1 commit
  31. 13 Oct, 2024 1 commit