• Lei Wang's avatar
    [Language] Introduce `T.ptr` and `T.Tensor` (#276) · 8ad53855
    Lei Wang authored
    * [Refactor] Improve flash attention example and layout comparison logic
    
    - Removed unnecessary annotation for `lse_local_split` in the flash attention example to streamline the code.
    - Updated the handling of `lse_local_split` to utilize parallel processing for better performance.
    - Refactored kernel compilation and profiling logic to enhance clarity and maintainability in the flash attention example.
    - Added a condition in `FragmentNode::IsEqual` to handle broadcast cases, improving the robustness of layout comparisons.
    
    * lint fix
    
    * [Enhancement] Add support for shared memory scope in Fill operation
    
    - Introduced handling for `shared.dyn` and `shared` memory scopes in the Fill operation.
    - Implemented parallel operation and layout inference for improved performance in shared memory scenarios.
    - Updated thread loop partitioning and vectorization logic to accommodate new memory scope handling.
    
    * [Refactor] Remove deprecated decorator and enhance Cython kernel handling
    
    - Removed the deprecated decorator from the main module and added a new implementation in the utils module for better organization.
    - Introduced a pointer map in the Cython kernel adapter to manage pointer arguments, improving runtime shape resolution.
    - Updated the Cython kernel wrapper to utilize the new pointer map for handling kernel arguments.
    - Enhanced error checking in the tensor utility functions to ensure static shapes are enforced.
    - Added a new proxy module for buffer and tensor handling, streamlining the interface for TIR programs.
    
    * [Feature] Add matrix multiplication test and kernel implementation
    
    - Introduced a new test file `test_tilelang_language_ptr.py` that implements a matrix multiplication function using TileLang's primitives.
    - The `matmul_test` function defines a kernel for performing tile-level GEMM operations with customizable block sizes and data types.
    - Added a `run_matmul` function to compile and execute the kernel, along with a test function to validate the implementation.
    - Updated the `proxy.py` file to enhance type handling for buffer and tensor proxies, ensuring compatibility with TIR programs.
    - Minor formatting improvements in `deprecated.py` for better readability.
    
    * lint fix
    8ad53855
deprecated.py 807 Bytes