examples/language/grok-1/inference_tp.py · 848a574c269b20d771cdd9cb2fa84561016180c3 · OpenDAS / ColossalAI

[example] add grok-1 inference (#5485) · 848a574c

Hongxin Liu authored Mar 21, 2024

* [misc] add submodule

* remove submodule

* [example] support grok-1 tp inference

* [example] add grok-1 inference script

* [example] refactor code

* [example] add grok-1 readme

* [exmaple] add test ci

* [exmaple] update readme

848a574c

inference_tp.py 1.71 KB

Replace inference_tp.py