Unverified Commit f9c16b02 authored by Christopher Akiki's avatar Christopher Akiki Committed by GitHub
Browse files

Replace "Masked" with "Causal" in TF CLM example (#14014)

parent 31872282
...@@ -14,13 +14,13 @@ ...@@ -14,13 +14,13 @@
# See the License for the specific language governing permissions and # See the License for the specific language governing permissions and
# limitations under the License. # limitations under the License.
""" """
Fine-tuning the library models for masked language modeling (BERT, ALBERT, RoBERTa...) Fine-tuning the library models for causal language modeling (GPT-2, GPT-Neo...)
on a text file or a dataset without using HuggingFace Trainer. on a text file or a dataset without using HuggingFace Trainer.
Here is the full list of checkpoints on the hub that can be fine-tuned by this script: Here is the full list of checkpoints on the hub that can be fine-tuned by this script:
https://huggingface.co/models?filter=masked-lm https://huggingface.co/models?filter=causal-lm
""" """
# You can also adapt this script on your own mlm task. Pointers for this are left as comments. # You can also adapt this script on your own clm task. Pointers for this are left as comments.
# region Imports # region Imports
import logging import logging
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment