Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
nni
Commits
e109667d
Commit
e109667d
authored
Sep 20, 2018
by
xuehui
Browse files
update readme
parent
6bf71677
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
9 deletions
+6
-9
examples/trials/ga_squad/README.md
examples/trials/ga_squad/README.md
+6
-9
No files found.
examples/trials/ga_squad/README.md
View file @
e109667d
# Automaticlly model architecture search for Reading Comprehension
# Automaticlly Model Architecture Search for Reading Comprehensio
SQuAD is a competition holded by Stanford. Giving you queries and passages, you need to select answer from passage.
This example shows us how to use Genetic Algorithm to find good model architectures for Reading Comprehension task.
This example shows us how to use Genetic Algorithm to find good model architectures for Reading Comprehension task.
## Search Space
Since attention and recurrent neural network (RNN) module have been proven effective in Reading Comprehension.
Since attention and recurrent neural network (RNN) module have been proven effective in Reading Comprehension.
We conclude the search space as follow:
We conclude the search space as follow:
1.
IDENTITY (Effectively means keep training).
1.
IDENTITY (Effectively means keep training).
...
@@ -15,15 +13,14 @@ We conclude the search space as follow:
...
@@ -15,15 +13,14 @@ We conclude the search space as follow:
6.
ADD-SKIP (Identity between random layers).
6.
ADD-SKIP (Identity between random layers).
7.
REMOVE-SKIP (Removes random skip).
7.
REMOVE-SKIP (Removes random skip).


## Ner version
Also we have another version which time cost is less and performance is better. We will release soon.
Also we have another version which time cost is less and performance is better. We will release soon.
# How to run this example?
# Download data
## Use downloading script to download data
## Use downloading script
Execute the following command to download needed files
Execute the following command to download needed files
using the downloading script:
using the downloading script:
...
@@ -49,7 +46,7 @@ wget http://nlp.stanford.edu/data/glove.840B.300d.zip
...
@@ -49,7 +46,7 @@ wget http://nlp.stanford.edu/data/glove.840B.300d.zip
unzip glove.840B.300d.zip
unzip glove.840B.300d.zip
```
```
#
How to
submit this job
# submit this job
```
```
nnictl create --config ~/nni/examples/trials/ga_squad/config.yaml
nnictl create --config ~/nni/examples/trials/ga_squad/config.yaml
```
```
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment