Skip to content

GitLab

"docs/source/vscode:/vscode.git/clone" did not exist on "9090bf02e74334a8020b454814e0d00fa780fd79"
Switch branch/tag
  1. 11 Dec, 2024 1 commit
  3. 10 Dec, 2024 1 commit
  5. 07 Dec, 2024 1 commit
  7. 06 Dec, 2024 2 commits
  9. 05 Dec, 2024 2 commits
  11. 04 Dec, 2024 5 commits
  13. 30 Nov, 2024 1 commit
    • mtgu0705's avatar
      Merge the int4 kernel and profiling in one commit for RTP. · 40054f53
      mtgu0705 authored 
      Add int4+scale based on Zhang, Jing pk_i4. Compile pass, function pass.
Modify the kernel to 128x128x128, and use mfma_32x32x4
Move the weight permute from host to device

Modified the scale init method.

Modified the init method, the function is failed, need to debug.

Added init method

Support group=128 for Llam2-7B-int4

Move the weight permute from host to device

Add ckProfiler for GEMM b scale (int4)

Add reference function.

Add pipeline v4 (2 LDS pingpong)

Add more int4-Gemm kernel profiling instances.

Modify the in4-Gemm kernel instances

Move the pk_i4 permute in kernel
      40054f53
  15. 27 Oct, 2024 1 commit
  17. 24 Oct, 2024 2 commits
  19. 23 Oct, 2024 7 commits
  21. 22 Oct, 2024 5 commits
  23. 21 Oct, 2024 3 commits
  25. 20 Oct, 2024 3 commits
  27. 18 Oct, 2024 2 commits
  29. 16 Oct, 2024 1 commit
  31. 15 Oct, 2024 3 commits