"megatron/training/vscode:/vscode.git/clone" did not exist on "2c63b5cd2eeaf66c3a45e7c65da41d16fb8838ca"
  • Rostyslav Geyyer's avatar
    Add pipeline v1/v2 selector, add more instances (#381) · 1a0b0e7b
    Rostyslav Geyyer authored
    
    
    * Add gridwise gemm pipeline v1/v2 selector
    
    * Pipeline selector working, test-wise add pipeline options to one instance
    
    * Add gemm instances
    
    * Add debug info to DeviceGemmXdl
    
    * Add debug info to DeviceGemmXdl_CShuffle
    
    * Add debug info to DeviceGemmXdl_CShuffle and instances to gemm_add_add_fastgelu
    
    * Minor fix
    
    * Add debug info to DeviceBatchedGemmXdl and instances to batched_gemm
    
    * set up inter-wave configuration
    
    * use defualt loop scheduling for supported gemm ops
    
    for blanket-applying interwave scheduling for all supported gemm ops, define macro CK_EXPERIMENTAL_DEFAULT_TO_INTER_WAVE_SCHEDULING=1. this should be discouraged though as it is not covered by CI
    
    * Add enum PipelineVersion
    
    * Update instances
    
    * Format
    
    * Fix the merge conflict
    
    * Add flags to disable added instances
    
    * Test disable flag check
    
    * Disable flag check
    
    * Enable the instances
    Co-authored-by: default avatarAnthony Chang <ac.chang@outlook.com>
    1a0b0e7b
ck.hpp 7.02 KB