changed nameing

73c04968 · lintangsutawika · 748a9898 · 73c04968
Commit 73c04968 authored Jul 20, 2023 by lintangsutawika
Hide whitespace changes
Inline Side-by-side

Showing with 3 additions and 2 deletions

lm_eval/tasks/__init__.py lm_eval/tasks/__init__.py +3 -2

No files found.
--- a/lm_eval/tasks/__init__.py
+++ b/lm_eval/tasks/__init__.py
@@ -55,8 +55,9 @@ def check_prompt_config(config):
                        "task": "_".join(
                            [
                                get_task_name_from_config(config),
-                                "promptsource",
-                                str(idx).zfill(2),
+                                prompt_variation,
+                                # "promptsource",
+                                # str(idx).zfill(2),
                            ]
                        )
                    },