Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
b5eb283a
"...resnet50_tensorflow.git" did not exist on "44fa1d377c81371a85256db57563d3e2016c7730"
Commit
b5eb283a
authored
Aug 28, 2019
by
thomwolf
Browse files
update credits
parent
f753d4e3
Changes
4
Hide whitespace changes
Inline
Side-by-side
Showing
4 changed files
with
13 additions
and
12 deletions
+13
-12
examples/distillation/dataset.py
examples/distillation/dataset.py
+3
-3
examples/distillation/distiller.py
examples/distillation/distiller.py
+3
-3
examples/distillation/utils.py
examples/distillation/utils.py
+3
-3
pytorch_transformers/modeling_distilbert.py
pytorch_transformers/modeling_distilbert.py
+4
-3
No files found.
examples/distillation/dataset.py
View file @
b5eb283a
# coding=utf-8
# coding=utf-8
# Copyright 2019-present, the HuggingFace Inc. team.
# Copyright 2019-present, the HuggingFace Inc. team
and Facebook, Inc
.
#
#
# Licensed under the Apache License, Version 2.0 (the "License");
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
...
@@ -12,8 +12,8 @@
...
@@ -12,8 +12,8 @@
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# See the License for the specific language governing permissions and
# limitations under the License.
# limitations under the License.
"""
"""
Dataloaders to train DistilBERT
Dataloaders to train DistilBERT.
adapted in part from Facebook, Inc XLM model (https://github.com/facebookresearch/XLM)
"""
"""
from
typing
import
List
from
typing
import
List
import
math
import
math
...
...
examples/distillation/distiller.py
View file @
b5eb283a
# coding=utf-8
# coding=utf-8
# Copyright 2019-present, the HuggingFace Inc. team.
# Copyright 2019-present, the HuggingFace Inc. team
and Facebook, Inc
.
#
#
# Licensed under the Apache License, Version 2.0 (the "License");
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
...
@@ -12,8 +12,8 @@
...
@@ -12,8 +12,8 @@
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# See the License for the specific language governing permissions and
# limitations under the License.
# limitations under the License.
"""
"""
The distiller to distil DistilBERT
The distiller to distil DistilBERT.
adapted in part from Facebook, Inc XLM model (https://github.com/facebookresearch/XLM)
"""
"""
import
os
import
os
import
math
import
math
...
...
examples/distillation/utils.py
View file @
b5eb283a
# coding=utf-8
# coding=utf-8
# Copyright 2019-present, the HuggingFace Inc. team.
# Copyright 2019-present, the HuggingFace Inc. team
and Facebook, Inc
.
#
#
# Licensed under the Apache License, Version 2.0 (the "License");
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
...
@@ -12,8 +12,8 @@
...
@@ -12,8 +12,8 @@
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# See the License for the specific language governing permissions and
# limitations under the License.
# limitations under the License.
"""
"""
Utils to train DistilBERT
Utils to train DistilBERT.
adapted in part from Facebook, Inc XLM model (https://github.com/facebookresearch/XLM)
"""
"""
import
git
import
git
import
json
import
json
...
...
pytorch_transformers/modeling_distilbert.py
View file @
b5eb283a
# coding=utf-8
# coding=utf-8
# Copyright 2019-present, the HuggingFace Inc. team and Facebook, Inc.
# Copyright 2019-present, the HuggingFace Inc. team
, The Google AI Language Team
and Facebook, Inc.
#
#
# Licensed under the Apache License, Version 2.0 (the "License");
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
...
@@ -12,8 +12,9 @@
...
@@ -12,8 +12,9 @@
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# See the License for the specific language governing permissions and
# limitations under the License.
# limitations under the License.
"""
""" PyTorch DistilBERT model
PyTorch DistilBERT model.
adapted in part from Facebook, Inc XLM model (https://github.com/facebookresearch/XLM)
and in part from HuggingFace PyTorch version of Google AI Bert model (https://github.com/google-research/bert)
"""
"""
from
__future__
import
absolute_import
,
division
,
print_function
,
unicode_literals
from
__future__
import
absolute_import
,
division
,
print_function
,
unicode_literals
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment