• Nicolas Hug's avatar
    Add Quantized version of RoIAlign (#3624) · ad9cc62a
    Nicolas Hug authored
    * WIP
    
    * clang
    
    * docs
    
    * extracted out common utils
    
    * Use better quantization function and pass tensors as parameters
    
    * proper dequantization
    
    * Some tests
    
    * Dequantization optimization, seems to gain a few ms
    
    * clang-format
    
    * again
    
    * more correct test. Had to remove optimization although it almost works
    
    * Also test aligned=True
    
    * remove useless part
    
    * more docs and comments
    
    * Put back optimization with more robust test
    
    * Added check for index upper bound
    
    * avoid possible overflow
    
    * Move common function into common.h
    
    * oops
    
    * scale=1,zero_point=0 makes more sense
    
    * Force batch size of 1 to prevent any indexingbug
    
    * format
    
    * format again
    
    * updated docstring
    
    * put back description comment for pre_calc_bilinear_interpolate
    
    * revert most changes to docstring as it's taken care of in another PR
    ad9cc62a
roi_align_kernel.cpp 11.7 KB