Skip to content

GitLab

Switch branch/tag
  1. 13 Dec, 2024 2 commits
  3. 11 Dec, 2024 1 commit
  5. 10 Dec, 2024 1 commit
  7. 07 Dec, 2024 1 commit
  9. 06 Dec, 2024 2 commits
  11. 05 Dec, 2024 2 commits
  13. 04 Dec, 2024 5 commits
  15. 30 Nov, 2024 1 commit
    • mtgu0705's avatar
      Merge the int4 kernel and profiling in one commit for RTP. · 40054f53
      mtgu0705 authored 
      Add int4+scale based on Zhang, Jing pk_i4. Compile pass, function pass.
Modify the kernel to 128x128x128, and use mfma_32x32x4
Move the weight permute from host to device

Modified the scale init method.

Modified the init method, the function is failed, need to debug.

Added init method

Support group=128 for Llam2-7B-int4

Move the weight permute from host to device

Add ckProfiler for GEMM b scale (int4)

Add reference function.

Add pipeline v4 (2 LDS pingpong)

Add more int4-Gemm kernel profiling instances.

Modify the in4-Gemm kernel instances

Move the pk_i4 permute in kernel
      40054f53
  17. 27 Oct, 2024 1 commit
  19. 24 Oct, 2024 2 commits
  21. 23 Oct, 2024 7 commits
  23. 22 Oct, 2024 5 commits
  25. 21 Oct, 2024 3 commits
  27. 20 Oct, 2024 3 commits
  29. 18 Oct, 2024 2 commits
  31. 16 Oct, 2024 1 commit
  33. 15 Oct, 2024 1 commit