Skip to content

GitLab

Unverified Commit 331d8d29 authored by Kevin Canwen Xu's avatar Kevin Canwen Xu Committed by GitHub
Browse files

Upload DistilBART artwork (#5394)

parent 09e84149
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 0 deletions
examples/seq2seq/README.md
View file @ 331d8d29
## Sequence to Sequence
This directory contains examples for finetuning and evaluating transformers on summarization and translation tasks. This directory contains examples for finetuning and evaluating transformers on summarization and translation tasks.
Summarization support is more mature than translation support. Summarization support is more mature than translation support.
Please tag @sshleifer with any issues/unexpected behaviors, or send a PR! Please tag @sshleifer with any issues/unexpected behaviors, or send a PR!
...@@ -168,6 +170,7 @@ python run_eval.py sshleifer/distilbart-cnn-12-6 $DATA_DIR/val.source dbart_val_ ...@@ -168,6 +170,7 @@ python run_eval.py sshleifer/distilbart-cnn-12-6 $DATA_DIR/val.source dbart_val_
### DistilBART ### DistilBART
![DBART](https://huggingface.co/front/thumbnails/distilbart_large.png)
For the CNN/DailyMail dataset, (relatively longer, more extractive summaries), we found a simple technique that works: For the CNN/DailyMail dataset, (relatively longer, more extractive summaries), we found a simple technique that works:
you just copy alternating layers from `bart-large-cnn` and finetune more on the same data. you just copy alternating layers from `bart-large-cnn` and finetune more on the same data.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment