examples/inference/run_llama_inference.py · 1cd7efc5202763b8baefda9228a70a967783482a · OpenDAS / ColossalAI

Hongxin Liu authored Nov 21, 2023

* [setup] refactor infer setup

* [hotfix] fix infenrece behavior on 1 1 gpu

* [exmaple] refactor inference examples

1cd7efc5

run_llama_inference.py 3.89 KB