• Kane's avatar
    Mlu590 deployment (#453) · fcc2a411
    Kane authored
    Feature:
        1. added mlu590 bfloat16, single-gpu and multi-gpus inference.
        2. added mlu590 int8 inference.
    fcc2a411
profiler.py 4.2 KB