Commit c75fa9cc authored by chenzk's avatar chenzk
Browse files

v1.0.5

parent 554bef6c
......@@ -73,6 +73,7 @@ pip install whl/bitsandbytes-0.42.0+das.opt1.dtk2504-py3-none-any.whl
|── tatsu-lab/alpaca
└── skrishna/gsm8k_only_answer
```
`axolotl-ai-co/evolkit-logprobs-pipeline-75k-v2-sample`下的完整目录为:`axolotl-ai-co/evolkit-logprobs-pipeline-75k-v2-sample/data/train.parquet`
HF下载地址为[axolotl-ai-co/evolkit-logprobs-pipeline-75k-v2-sample](https://huggingface.co/datasets/axolotl-ai-co/evolkit-logprobs-pipeline-75k-v2-sample),后几个示例数据集较小,项目中已内置。
## 训练
......@@ -89,6 +90,7 @@ export HF_ENDPOINT=https://hf-mirror.com # 解决报错:MaxRetryError("HTTPSCo
## Distil
axolotl train examples/qwen3/qlora-fsdp-kd_qwen3-4b.yaml # 示例数据为作者利用第三方库distilabel离线推理获取logits数据
# 若报错OSError: [Errno 28] No space left on device则设置本地缓存目录:export HF_HOME=./cache
## SFT
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment