Skip to content

GitLab

Commit ce343750 authored by Yen-Ting Lin's avatar Yen-Ting Lin
Browse files

Update .gitignore and harness_eval.slurm, and modify _generate_configs.py

parent a69ad956
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 3 deletions
.gitignore
View file @ ce343750
...@@ -24,4 +24,5 @@ examples/wandb ...@@ -24,4 +24,5 @@ examples/wandb
evals/ evals/
harness_eval_main_log.txt harness_eval_main_log.txt
None/ None/
logs/ logs/
\ No newline at end of file eval_results/
\ No newline at end of file
harness_eval.slurm
View file @ ce343750
...@@ -59,7 +59,6 @@ lm_eval \ ...@@ -59,7 +59,6 @@ lm_eval \
--batch_size 8 \ --batch_size 8 \
--output_path eval_results \ --output_path eval_results \
--write_out \ --write_out \
--log_samples \
--verbosity DEBUG \ --verbosity DEBUG \
--wandb_args project=lm-eval-harness-integration,job_type=eval,name=$model \ --wandb_args project=lm-eval-harness-integration,job_type=eval,name=$model \
--hf_hub_log_args hub_results_org=yentinglin,hub_repo_name=lm-eval-results,push_results_to_hub=True,public_repo=False \ --hf_hub_log_args hub_results_org=yentinglin,hub_repo_name=lm-eval-results,push_results_to_hub=True,public_repo=False \
......
lm_eval/tasks/umtceval/default/_generate_configs.py
View file @ ce343750
...@@ -10,7 +10,7 @@ from tqdm import tqdm ...@@ -10,7 +10,7 @@ from tqdm import tqdm
categories = { categories = {
"law": [ "default": [
"default", "default",
], ],
} }
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment