• Kane's avatar
    Mlu590 deployment (#453) · fcc2a411
    Kane authored
    Feature:
        1. added mlu590 bfloat16, single-gpu and multi-gpus inference.
        2. added mlu590 int8 inference.
    fcc2a411
default_runner.py 17.2 KB