• xiaobin's avatar
    fit for baichuan models (#981) · 4cce8430
    xiaobin authored
    
    
    As more and more people begin to use Baichuan's open-source models, the
    influence of Baichuan models is growing, especially in China. Many
    community members are interested in adding support for Baichuan models
    to TGI. Meanwhile, Baichuan is a very open company, and in the future,
    it plans to open-source more and more models, taking all this into
    consideration, we would like to add support for the Baichuan model to
    TGI. To do this, we need to make some changes, which we hope can be
    merged into the main branch of TGI. In the future, we would be happy to
    help maintain support for Baichuan models in TGI. We sincerely hope that
    our pull request can be accepted. Thank you.
    
    By the way, the changes of this time mainly for supporting Baichuan-7B.
    
    ---------
    Co-authored-by: default avatarxiaoyuze <xiaoyuze@baichuan.com>
    Co-authored-by: default avatarNicolas Patry <patry.nicolas@protonmail.com>
    4cce8430
weights.py 13.1 KB