update README

84fe5a1c · yangzhong · f59c7272 · 84fe5a1c
Commit 84fe5a1c authored Oct 30, 2025 by yangzhong
Hide whitespace changes
Inline Side-by-side

Showing with 2 additions and 0 deletions

README.md README.md +2 -0

No files found.
--- a/README.md
+++ b/README.md
@@ -38,6 +38,8 @@ python tools/preprocess_data.py \
  --workers 16 \
  --append-eod
 ```
+输出openwebtext-llama-7b_text_document.bin  openwebtext-llama-7b_text_document.idx
+.bin文件31G

 ### 下载tokenizer文件