Unverified Commit fcb0f743 authored by Stas Bekman's avatar Stas Bekman Committed by GitHub
Browse files

[research_projects] deal with security alerts (#15594)

* [research_projects] deal with security alerts

* add a note of the original PL ver and warning
parent f15c99fa
...@@ -10,6 +10,9 @@ Blog link: https://eng.uber.com/pplm ...@@ -10,6 +10,9 @@ Blog link: https://eng.uber.com/pplm
Please check out the repo under uber-research for more information: https://github.com/uber-research/PPLM Please check out the repo under uber-research for more information: https://github.com/uber-research/PPLM
# Note
⚠️ This project should be run with pytorch-lightning==1.0.4 which has a potential security vulnerability
## Setup ## Setup
...@@ -51,4 +54,3 @@ python run_pplm.py -D sentiment --class_label 2 --cond_text "My dog died" --leng ...@@ -51,4 +54,3 @@ python run_pplm.py -D sentiment --class_label 2 --cond_text "My dog died" --leng
1. Increase `--stepsize` to intensify topic control, and decrease its value to soften the control. `--stepsize 0` recovers the original uncontrolled GPT-2 model. 1. Increase `--stepsize` to intensify topic control, and decrease its value to soften the control. `--stepsize 0` recovers the original uncontrolled GPT-2 model.
2. Use `--class_label 3` for negative, and `--class_label 2` for positive 2. Use `--class_label 3` for negative, and `--class_label 2` for positive
...@@ -5,7 +5,7 @@ psutil ...@@ -5,7 +5,7 @@ psutil
sacrebleu sacrebleu
rouge-score rouge-score
tensorflow_datasets tensorflow_datasets
pytorch-lightning==1.0.4 pytorch-lightning
matplotlib matplotlib
git-python==1.0.3 git-python==1.0.3
faiss-cpu faiss-cpu
......
...@@ -15,6 +15,9 @@ This code can be modified to experiment with other research on retrival augmente ...@@ -15,6 +15,9 @@ This code can be modified to experiment with other research on retrival augmente
To start training, use the bash script (finetune_rag_ray_end2end.sh) in this folder. This script also includes descriptions on each command-line argument used. To start training, use the bash script (finetune_rag_ray_end2end.sh) in this folder. This script also includes descriptions on each command-line argument used.
# Note
⚠️ This project should be run with pytorch-lightning==1.3.1 which has a potential security vulnerability
# Testing # Testing
......
...@@ -2,6 +2,6 @@ faiss-cpu >= 1.7.0 ...@@ -2,6 +2,6 @@ faiss-cpu >= 1.7.0
datasets >= 1.6.2 datasets >= 1.6.2
psutil >= 5.7.0 psutil >= 5.7.0
torch >= 1.4.0 torch >= 1.4.0
pytorch-lightning == 1.3.1 pytorch-lightning
nvidia-ml-py3 == 7.352.0 nvidia-ml-py3 == 7.352.0
ray >= 1.3.0 ray >= 1.3.0
...@@ -11,6 +11,10 @@ Such contextualized inputs are passed to the generator. ...@@ -11,6 +11,10 @@ Such contextualized inputs are passed to the generator.
Read more about RAG at https://arxiv.org/abs/2005.11401. Read more about RAG at https://arxiv.org/abs/2005.11401.
# Note
⚠️ This project should be run with pytorch-lightning==1.3.1 which has a potential security vulnerability
# Finetuning # Finetuning
Our finetuning logic is based on scripts from [`examples/seq2seq`](https://github.com/huggingface/transformers/tree/master/examples/seq2seq). We accept training data in the same format as specified there - we expect a directory consisting of 6 text files: Our finetuning logic is based on scripts from [`examples/seq2seq`](https://github.com/huggingface/transformers/tree/master/examples/seq2seq). We accept training data in the same format as specified there - we expect a directory consisting of 6 text files:
......
...@@ -3,5 +3,5 @@ datasets >= 1.0.1 ...@@ -3,5 +3,5 @@ datasets >= 1.0.1
psutil >= 5.7.0 psutil >= 5.7.0
torch >= 1.4.0 torch >= 1.4.0
transformers transformers
pytorch-lightning==1.3.1 pytorch-lightning
GitPython GitPython
...@@ -13,6 +13,10 @@ Author: Sam Shleifer (https://github.com/sshleifer) ...@@ -13,6 +13,10 @@ Author: Sam Shleifer (https://github.com/sshleifer)
- `FSMTForConditionalGeneration` - `FSMTForConditionalGeneration`
- `T5ForConditionalGeneration` - `T5ForConditionalGeneration`
# Note
⚠️ This project should be run with pytorch-lightning==1.0.4 which has a potential security vulnerability
## Datasets ## Datasets
#### XSUM #### XSUM
......
...@@ -4,7 +4,7 @@ psutil ...@@ -4,7 +4,7 @@ psutil
sacrebleu sacrebleu
rouge-score rouge-score
tensorflow_datasets tensorflow_datasets
pytorch-lightning==1.0.4 pytorch-lightning
matplotlib matplotlib
git-python==1.0.3 git-python==1.0.3
faiss-cpu faiss-cpu
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment