".github/vscode:/vscode.git/clone" did not exist on "27c61936fc42be2c01c8201df274142470eb56af"
Commit ce343750 authored by Yen-Ting Lin's avatar Yen-Ting Lin
Browse files

Update .gitignore and harness_eval.slurm, and modify _generate_configs.py

parent a69ad956
......@@ -24,4 +24,5 @@ examples/wandb
evals/
harness_eval_main_log.txt
None/
logs/
\ No newline at end of file
logs/
eval_results/
\ No newline at end of file
......@@ -59,7 +59,6 @@ lm_eval \
--batch_size 8 \
--output_path eval_results \
--write_out \
--log_samples \
--verbosity DEBUG \
--wandb_args project=lm-eval-harness-integration,job_type=eval,name=$model \
--hf_hub_log_args hub_results_org=yentinglin,hub_repo_name=lm-eval-results,push_results_to_hub=True,public_repo=False \
......
......@@ -10,7 +10,7 @@ from tqdm import tqdm
categories = {
"law": [
"default": [
"default",
],
}
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment