omnisql

4f4ba442 · mashun1 · 4f4ba442 · 4f4ba442 · 4f4ba442 · 4f4ba442
Commit 4f4ba442 authored Apr 16, 2025 by mashun1
12 changed files
--- a/train_and_evaluate/infer.py
+++ b/train_and_evaluate/infer.py
--- a/train_and_evaluate/merge_lora_adapter.py
+++ b/train_and_evaluate/merge_lora_adapter.py
--- a/train_and_evaluate/monkey_patch_packing.py
+++ b/train_and_evaluate/monkey_patch_packing.py
--- a/train_and_evaluate/nltk_downloader.py
+++ b/train_and_evaluate/nltk_downloader.py
+import nltk
+nltk.download('punkt')
\ No newline at end of file
--- a/train_and_evaluate/process_dataset.py
+++ b/train_and_evaluate/process_dataset.py
--- a/train_and_evaluate/process_dataset.sh
+++ b/train_and_evaluate/process_dataset.sh
--- a/train_and_evaluate/train.py
+++ b/train_and_evaluate/train.py
--- a/train_and_evaluate/train_omnisql_14b.sh
+++ b/train_and_evaluate/train_omnisql_14b.sh
--- a/train_and_evaluate/train_omnisql_32b.sh
+++ b/train_and_evaluate/train_omnisql_32b.sh
--- a/train_and_evaluate/train_omnisql_7b.sh
+++ b/train_and_evaluate/train_omnisql_7b.sh
--- a/train_and_evaluate/utils/load_sft_dataset.py
+++ b/train_and_evaluate/utils/load_sft_dataset.py
--- a/train_and_evaluate/utils/lr_scheduler.py
+++ b/train_and_evaluate/utils/lr_scheduler.py