Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
nni
Commits
6bf71677
Commit
6bf71677
authored
Sep 20, 2018
by
xuehui
Browse files
update readme in ga_squad
parent
ad32f7cb
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
55 additions
and
0 deletions
+55
-0
examples/trials/ga_squad/README.md
examples/trials/ga_squad/README.md
+55
-0
examples/trials/ga_squad/ga_squad.png
examples/trials/ga_squad/ga_squad.png
+0
-0
No files found.
examples/trials/ga_squad/
readme
.md
→
examples/trials/ga_squad/
README
.md
View file @
6bf71677
# Automaticlly model architecture search for Reading Comprehension
SQuAD is a competition holded by Stanford. Giving you queries and passages, you need to select answer from passage.
This example shows us how to use Genetic Algorithm to find good model architectures for Reading Comprehension task.
Since attention and recurrent neural network (RNN) module have been proven effective in Reading Comprehension.
We conclude the search space as follow:
1.
IDENTITY (Effectively means keep training).
2.
INSERT-RNN-LAYER (Inserts a LSTM. Comparing the performance of GRU and LSTM in our experiment, we decided to use LSTM here.)
3.
REMOVE-RNN-LAYER
4.
INSERT-ATTENTION-LAYER(Inserts a attention layer.)
5.
REMOVE-ATTENTION-LAYER
6.
ADD-SKIP (Identity between random layers).
7.
REMOVE-SKIP (Removes random skip).

Also we have another version which time cost is less and performance is better. We will release soon.
# Download data
## Use downloading script
...
...
@@ -27,7 +50,6 @@ unzip glove.840B.300d.zip
```
# How to submit this job
1.
run "$NNI_ROOT_DIR/auto_run.py" as "$NNI_ROOT_DIR/README-AUTO.md" said.
2.
use the dockerImage openpai.azurecr.io/nni_v0.0.1, which means it use a tensorflow cpu-version.
3.
this model don't need search_space.json.
\ No newline at end of file
```
nnictl create --config ~/nni/examples/trials/ga_squad/config.yaml
```
examples/trials/ga_squad/ga_squad.png
0 → 100644
View file @
6bf71677
29.6 KB
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment