• Kane's avatar
    Mlu590 deployment (#453) · fcc2a411
    Kane authored
    Feature:
        1. added mlu590 bfloat16, single-gpu and multi-gpus inference.
        2. added mlu590 int8 inference.
    fcc2a411
utils.py 16.7 KB