Commits · 148469348a8b2ead6ec6ea2641fbb2d71ddf32e5 · OpenDAS / ColossalAI

"tests/test_tensor/model/test_gpt2.py" did not exist on "ae7c33810574ef1c47538418bfd6bc07fa6d9c6b"

07 Dec, 2023 1 commit

[Colossal-Llama-2] Add finetuning Colossal-Llama-2 example (#4878) · b3971044

Yuanchen authored Dec 07, 2023



* Add finetuning Colossal-Llama-2 example

* Add finetuning Colossal-Llama-2 example 2

* Add finetuning Colossal-Llama-2 example and support NEFTuning

* Add inference example and refine neftune

* Modify readme file

* update the imports

---------
Co-authored-by: Xu Yuanchen <yuanchen.xu00@gmail.com>
Co-authored-by: Camille Zhong <44392324+Camille7777@users.noreply.github.com>

b3971044

17 Oct, 2023 1 commit
- [format] applied code formatting on changed files in pull request 4908 (#4918) · a41cf88e
  github-actions[bot] authored Oct 17, 2023
```
Co-authored-by: github-actions <github-actions@github.com>
```
  a41cf88e
16 Oct, 2023 1 commit

Update flash_attention_patch.py · 7768afba

Zian(Andy) Zheng authored Oct 13, 2023

To be compatible with the new change in the Transformers library, where a new argument 'padding_mask' was added to forward function of attention layer.
https://github.com/huggingface/transformers/pull/25598

7768afba

24 Sep, 2023 1 commit
- initial commit: add colossal llama 2 (#4784) · 74aa7d96
  Tong Li authored Sep 24, 2023
  
  74aa7d96