applications/Colossal-LLaMA-2/prepare_pretrain_dataset.py · 148469348a8b2ead6ec6ea2641fbb2d71ddf32e5 · OpenDAS / ColossalAI

[Colossal-Llama-2] Add finetuning Colossal-Llama-2 example (#4878) · b3971044

Yuanchen authored Dec 07, 2023



* Add finetuning Colossal-Llama-2 example

* Add finetuning Colossal-Llama-2 example 2

* Add finetuning Colossal-Llama-2 example and support NEFTuning

* Add inference example and refine neftune

* Modify readme file

* update the imports

---------
Co-authored-by: Xu Yuanchen <yuanchen.xu00@gmail.com>
Co-authored-by: Camille Zhong <44392324+Camille7777@users.noreply.github.com>

b3971044

prepare_pretrain_dataset.py 6.09 KB

Replace prepare_pretrain_dataset.py