Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
56c84863
"git@developer.sourcefind.cn:chenpangpang/transformers.git" did not exist on "1eeb206bef3cccd21a6e910b4ad08f4d0c3037f2"
Commit
56c84863
authored
Nov 18, 2019
by
Stefan Schweter
Browse files
camembert: add support for CamemBERT in run_ner example
parent
0b3d45eb
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
1 deletion
+3
-1
examples/run_ner.py
examples/run_ner.py
+3
-1
No files found.
examples/run_ner.py
View file @
56c84863
...
@@ -37,6 +37,7 @@ from transformers import AdamW, get_linear_schedule_with_warmup
...
@@ -37,6 +37,7 @@ from transformers import AdamW, get_linear_schedule_with_warmup
from
transformers
import
WEIGHTS_NAME
,
BertConfig
,
BertForTokenClassification
,
BertTokenizer
from
transformers
import
WEIGHTS_NAME
,
BertConfig
,
BertForTokenClassification
,
BertTokenizer
from
transformers
import
RobertaConfig
,
RobertaForTokenClassification
,
RobertaTokenizer
from
transformers
import
RobertaConfig
,
RobertaForTokenClassification
,
RobertaTokenizer
from
transformers
import
DistilBertConfig
,
DistilBertForTokenClassification
,
DistilBertTokenizer
from
transformers
import
DistilBertConfig
,
DistilBertForTokenClassification
,
DistilBertTokenizer
from
transformers
import
CamembertConfig
,
CamembertForTokenClassification
,
CamembertTokenizer
logger
=
logging
.
getLogger
(
__name__
)
logger
=
logging
.
getLogger
(
__name__
)
...
@@ -47,7 +48,8 @@ ALL_MODELS = sum(
...
@@ -47,7 +48,8 @@ ALL_MODELS = sum(
MODEL_CLASSES
=
{
MODEL_CLASSES
=
{
"bert"
:
(
BertConfig
,
BertForTokenClassification
,
BertTokenizer
),
"bert"
:
(
BertConfig
,
BertForTokenClassification
,
BertTokenizer
),
"roberta"
:
(
RobertaConfig
,
RobertaForTokenClassification
,
RobertaTokenizer
),
"roberta"
:
(
RobertaConfig
,
RobertaForTokenClassification
,
RobertaTokenizer
),
"distilbert"
:
(
DistilBertConfig
,
DistilBertForTokenClassification
,
DistilBertTokenizer
)
"distilbert"
:
(
DistilBertConfig
,
DistilBertForTokenClassification
,
DistilBertTokenizer
),
"camembert"
:
(
CamembertConfig
,
CamembertForTokenClassification
,
CamembertTokenizer
),
}
}
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment