Unverified Commit fcb0f743 authored by Stas Bekman's avatar Stas Bekman Committed by GitHub
Browse files

[research_projects] deal with security alerts (#15594)

* [research_projects] deal with security alerts

* add a note of the original PL ver and warning
parent f15c99fa
......@@ -10,6 +10,9 @@ Blog link: https://eng.uber.com/pplm
Please check out the repo under uber-research for more information: https://github.com/uber-research/PPLM
# Note
⚠️ This project should be run with pytorch-lightning==1.0.4 which has a potential security vulnerability
## Setup
......@@ -51,4 +54,3 @@ python run_pplm.py -D sentiment --class_label 2 --cond_text "My dog died" --leng
1. Increase `--stepsize` to intensify topic control, and decrease its value to soften the control. `--stepsize 0` recovers the original uncontrolled GPT-2 model.
2. Use `--class_label 3` for negative, and `--class_label 2` for positive
......@@ -5,7 +5,7 @@ psutil
sacrebleu
rouge-score
tensorflow_datasets
pytorch-lightning==1.0.4
pytorch-lightning
matplotlib
git-python==1.0.3
faiss-cpu
......
......@@ -15,6 +15,9 @@ This code can be modified to experiment with other research on retrival augmente
To start training, use the bash script (finetune_rag_ray_end2end.sh) in this folder. This script also includes descriptions on each command-line argument used.
# Note
⚠️ This project should be run with pytorch-lightning==1.3.1 which has a potential security vulnerability
# Testing
......
......@@ -2,6 +2,6 @@ faiss-cpu >= 1.7.0
datasets >= 1.6.2
psutil >= 5.7.0
torch >= 1.4.0
pytorch-lightning == 1.3.1
pytorch-lightning
nvidia-ml-py3 == 7.352.0
ray >= 1.3.0
......@@ -11,6 +11,10 @@ Such contextualized inputs are passed to the generator.
Read more about RAG at https://arxiv.org/abs/2005.11401.
# Note
⚠️ This project should be run with pytorch-lightning==1.3.1 which has a potential security vulnerability
# Finetuning
Our finetuning logic is based on scripts from [`examples/seq2seq`](https://github.com/huggingface/transformers/tree/master/examples/seq2seq). We accept training data in the same format as specified there - we expect a directory consisting of 6 text files:
......
......@@ -3,5 +3,5 @@ datasets >= 1.0.1
psutil >= 5.7.0
torch >= 1.4.0
transformers
pytorch-lightning==1.3.1
pytorch-lightning
GitPython
......@@ -13,6 +13,10 @@ Author: Sam Shleifer (https://github.com/sshleifer)
- `FSMTForConditionalGeneration`
- `T5ForConditionalGeneration`
# Note
⚠️ This project should be run with pytorch-lightning==1.0.4 which has a potential security vulnerability
## Datasets
#### XSUM
......
......@@ -4,7 +4,7 @@ psutil
sacrebleu
rouge-score
tensorflow_datasets
pytorch-lightning==1.0.4
pytorch-lightning
matplotlib
git-python==1.0.3
faiss-cpu
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment