Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Megatron-LM
Commits
7736db1b
Commit
7736db1b
authored
Dec 09, 2021
by
zihanl
Browse files
update commands.sh
parent
5f433016
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
6 additions
and
1 deletion
+6
-1
tasks/knwl_dialo/scripts/prompt_knwl_gen.sh
tasks/knwl_dialo/scripts/prompt_knwl_gen.sh
+4
-1
tasks/knwl_dialo/scripts/prompt_resp_gen.sh
tasks/knwl_dialo/scripts/prompt_resp_gen.sh
+2
-0
No files found.
tasks/knwl_dialo/scripts/prompt_knwl_gen.sh
View file @
7736db1b
...
...
@@ -15,7 +15,8 @@ DISTRIBUTED_ARGS="--nproc_per_node $WORLD_SIZE \
CHECKPOINT_PATH
=
<PATH_OF_LANGUAGE_MODEL>
(
e.g., /357m
)
VOCAB_PATH
=
<PATH_OF_VOCAB_FILE>
(
e.g., /gpt2-vocab.json
)
MERGE_PATH
=
<PATH_OF_MERGE_FILE>
(
e.g., /gpt2-merges.txt
)
INPUT_PATH
=
<PATH_OF_PROCESSED_TEST_DATA_FILE>
(
e.g., /testseen_processed.txt
)
INPUT_PATH
=
<PATH_OF_PROCESSED_TEST_DATA_FILE>
\
(
e.g., /testseen_processed.txt
)
PROMPT_PATH
=
<PATH_OF_KNOWLEDGE_GENERATION_PROMPTS>
\
(
e.g., /testseen_knowledge_prompts.json
)
OUTPUT_PATH
=
<PATH_OF_OUTPUT_GENERATION_FILE>
\
...
...
@@ -40,3 +41,5 @@ python -m torch.distributed.launch $DISTRIBUTED_ARGS ./tasks/main.py \
--prompt-type
knowledge
\
--num-prompt-examples
10
\
--task
KNWL-DIALO-PROMPT
# NOTE: If you use api for the model generation, please use the "--api-prompt" flag (setting this value as True).
tasks/knwl_dialo/scripts/prompt_resp_gen.sh
View file @
7736db1b
...
...
@@ -41,3 +41,5 @@ python -m torch.distributed.launch $DISTRIBUTED_ARGS ./tasks/main.py \
--prompt-type
response
\
--num-prompt-examples
20
\
--task
KNWL-DIALO-PROMPT
# NOTE: If you use api for the model generation, please use the "--api-prompt" flag (setting this value as True).
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment