README.md

# Overview

This is a simple example of how to finetune TinyLlama1.1B using either lora or qlora:

LoRa:

```
accelerate launch -m axolotl.cli.train examples/tiny-llama/lora.yml
```

qLoRa:

```
accelerate launch -m axolotl.cli.train examples/tiny-llama/qlora.yml
```

Both take about 10 minutes to complete on a 4090.