"test/vscode:/vscode.git/clone" did not exist on "5c0179576ee8b527d17687eaefd044edd768f193"
  • shivadbhavsar's avatar
    fix issues with compiling lstm ops in fp16 mode (#1450) · 352c2465
    shivadbhavsar authored
    Currently, quantizing a program with rnn layers to fp16 results in segmentation faults due to a "convert" operation being applied to an "undefined" instruction.
    
    The following changes are implemented to fix this issue:
    
    Added is_undefined method to the instruction class that returns true if all inputs to the instruction are from an undefined op.
    Updated rewrite_rnn pass to use the new is_undefined method rather than checking ins->name()
    Updated the dead_code_elimination pass to also use this new method rather than only checking the instruction name
    352c2465
instruction.cpp 13.9 KB