• Rostyslav Geyyer's avatar
    FP8 enablement - add a pseudorandom number generator, add conversion methods (#708) · f0c620c4
    Rostyslav Geyyer authored
    * Add basic fp8 definitions and prn-generator
    
    * Format
    
    * Add fp8<->fp32 type_convert
    
    * Format
    
    * Split type_convert and cast_to/from_f8
    
    * Format
    
    * Minor fix
    
    * Minor fix
    
    * Move fp8 utils to a separate header
    
    * Add elementwise ops
    
    * Add fp8_convert_sr
    
    * Format
    
    * Add element op
    
    * Eliminate magic numbers
    
    * Split f8_convert_sr in host and device
    
    * Format
    
    * Add some constexpr
    
    * Add a datatype test
    
    * Format
    
    * Another format
    
    * Add fp8<->fp16 tests
    
    * Update type_converts
    
    * Format
    
    * Add fp16 casting functions
    
    * Format
    
    * Use seed as a runtime arg
    
    * Use element location for PRNG
    
    * Format
    
    * Add fp8<->fp16 to PassThrough element op
    
    * Clean up
    
    * Merge host and device implementations
    
    * Add comments on rounding modes
    
    * Remove leftover code
    
    * Put type_converts into a separate header
    
    * Put random number gen to a separate header
    
    * Rearrange f8_utils' namespaces
    
    * Refactor type_convert.hpp
    
    * Move f8_t definition
    f0c620c4
random_gen.hpp 1.9 KB