Skip to content

GitLab

Unverified Commit ba7cd58d authored by Fengzhe Zhou's avatar Fengzhe Zhou Committed by GitHub
Browse files

[Update] Rename dataset pack (#922)

parent 5ce8e045
Show whitespace changes
Inline Side-by-side
Showing with 20 additions and 20 deletions
.github/workflows/pr-stage-check.yml
View file @ ba7cd58d
...@@ -44,8 +44,8 @@ jobs: ...@@ -44,8 +44,8 @@ jobs:
run: python -m pip install -e . run: python -m pip install -e .
- name: Prepare dataset - name: Prepare dataset
run: | run: |
wget https://github.com/open-compass/opencompass/releases/download/0.1.8.rc1/OpenCompassData-core-20231110.zip wget https://github.com/open-compass/opencompass/releases/download/0.2.2.rc1/OpenCompassData-core-20240207.zip
unzip OpenCompassData-core-20231110.zip unzip OpenCompassData-core-20240207.zip
- name: Dry run test - name: Dry run test
run: | run: |
python run.py --models hf_opt_125m --datasets siqa_gen winograd_ppl --dry-run python run.py --models hf_opt_125m --datasets siqa_gen winograd_ppl --dry-run
...@@ -85,8 +85,8 @@ jobs: ...@@ -85,8 +85,8 @@ jobs:
run: python -m pip install -e . run: python -m pip install -e .
- name: Prepare dataset - name: Prepare dataset
run: | run: |
wget https://github.com/open-compass/opencompass/releases/download/0.1.8.rc1/OpenCompassData-core-20231110.zip wget https://github.com/open-compass/opencompass/releases/download/0.2.2.rc1/OpenCompassData-core-20240207.zip
unzip OpenCompassData-core-20231110.zip unzip OpenCompassData-core-20240207.zip
- name: Dry run test - name: Dry run test
run: | run: |
python run.py --models hf_opt_125m --datasets siqa_gen winograd_ppl --dry-run python run.py --models hf_opt_125m --datasets siqa_gen winograd_ppl --dry-run
...@@ -114,8 +114,8 @@ jobs: ...@@ -114,8 +114,8 @@ jobs:
run: pip install -e . run: pip install -e .
- name: Prepare dataset - name: Prepare dataset
run: | run: |
Invoke-WebRequest -Uri https://github.com/open-compass/opencompass/releases/download/0.1.8.rc1/OpenCompassData-core-20231110.zip -OutFile OpenCompassData-core-20231110.zip Invoke-WebRequest -Uri https://github.com/open-compass/opencompass/releases/download/0.2.2.rc1/OpenCompassData-core-20240207.zip -OutFile OpenCompassData-core-20240207.zip
unzip OpenCompassData-core-20231110.zip unzip OpenCompassData-core-20240207.zip
- name: Dry run test - name: Dry run test
run: | run: |
python run.py --models hf_opt_125m --datasets siqa_gen winograd_ppl --dry-run python run.py --models hf_opt_125m --datasets siqa_gen winograd_ppl --dry-run
README.md
View file @ ba7cd58d
...@@ -114,8 +114,8 @@ pip install -e . ...@@ -114,8 +114,8 @@ pip install -e .
```bash ```bash
# Download dataset to data/ folder # Download dataset to data/ folder
wget https://github.com/open-compass/opencompass/releases/download/0.1.8.rc1/OpenCompassData-core-20231110.zip wget https://github.com/open-compass/opencompass/releases/download/0.2.2.rc1/OpenCompassData-core-20240207.zip
unzip OpenCompassData-core-20231110.zip unzip OpenCompassData-core-20240207.zip
``` ```
Some third-party features, like Humaneval and Llama, may require additional steps to work properly, for detailed steps please refer to the [Installation Guide](https://opencompass.readthedocs.io/en/latest/get_started/installation.html). Some third-party features, like Humaneval and Llama, may require additional steps to work properly, for detailed steps please refer to the [Installation Guide](https://opencompass.readthedocs.io/en/latest/get_started/installation.html).
......
README_zh-CN.md
View file @ ba7cd58d
...@@ -116,8 +116,8 @@ pip install -e . ...@@ -116,8 +116,8 @@ pip install -e .
```bash ```bash
# 下载数据集到 data/ 处 # 下载数据集到 data/ 处
wget https://github.com/open-compass/opencompass/releases/download/0.1.8.rc1/OpenCompassData-core-20231110.zip wget https://github.com/open-compass/opencompass/releases/download/0.2.2.rc1/OpenCompassData-core-20240207.zip
unzip OpenCompassData-core-20231110.zip unzip OpenCompassData-core-20240207.zip
``` ```
有部分第三方功能,如 Humaneval 以及 Llama,可能需要额外步骤才能正常运行，详细步骤请参考[安装指南](https://opencompass.readthedocs.io/zh_CN/latest/get_started/installation.html)。 有部分第三方功能,如 Humaneval 以及 Llama,可能需要额外步骤才能正常运行，详细步骤请参考[安装指南](https://opencompass.readthedocs.io/zh_CN/latest/get_started/installation.html)。
......
docs/en/get_started/installation.md
View file @ ba7cd58d
...@@ -83,20 +83,20 @@ Run the following commands to download and place the datasets in the `${OpenComp ...@@ -83,20 +83,20 @@ Run the following commands to download and place the datasets in the `${OpenComp
```bash ```bash
# Run in the OpenCompass directory # Run in the OpenCompass directory
wget https://github.com/open-compass/opencompass/releases/download/0.1.8.rc1/OpenCompassData-core-20231110.zip wget https://github.com/open-compass/opencompass/releases/download/0.2.2.rc1/OpenCompassData-core-20240207.zip
unzip OpenCompassData-core-20231110.zip unzip OpenCompassData-core-20240207.zip
``` ```
If you need to use the more comprehensive dataset (~500M) provided by OpenCompass, You can download and `unzip` it using the following command: If you need to use the more comprehensive dataset (~500M) provided by OpenCompass, You can download and `unzip` it using the following command:
```bash ```bash
wget https://github.com/open-compass/opencompass/releases/download/0.1.8.rc1/OpenCompassData-complete-20231110.zip wget https://github.com/open-compass/opencompass/releases/download/0.2.2.rc1/OpenCompassData-complete-20240207.zip
unzip OpenCompassData-complete-20231110.zip unzip OpenCompassData-complete-20240207.zip
cd ./data cd ./data
find . -name "*.zip" -exec unzip {} \; find . -name "*.zip" -exec unzip {} \;
``` ```
The list of datasets included in both `.zip` can be found [here](https://github.com/open-compass/opencompass/releases/tag/0.1.8.rc1) The list of datasets included in both `.zip` can be found [here](https://github.com/open-compass/opencompass/releases/tag/0.2.2.rc1)
OpenCompass has supported most of the datasets commonly used for performance comparison, please refer to `configs/dataset` for the specific list of supported datasets. OpenCompass has supported most of the datasets commonly used for performance comparison, please refer to `configs/dataset` for the specific list of supported datasets.
......
docs/zh_cn/get_started/installation.md
View file @ ba7cd58d
...@@ -84,20 +84,20 @@ OpenCompass 支持的数据集主要包括两个部分： ...@@ -84,20 +84,20 @@ OpenCompass 支持的数据集主要包括两个部分：
在 OpenCompass 项目根目录下运行下面命令，将数据集准备至 `${OpenCompass}/data` 目录下： 在 OpenCompass 项目根目录下运行下面命令，将数据集准备至 `${OpenCompass}/data` 目录下：
```bash ```bash
wget https://github.com/open-compass/opencompass/releases/download/0.1.8.rc1/OpenCompassData-core-20231110.zip wget https://github.com/open-compass/opencompass/releases/download/0.2.2.rc1/OpenCompassData-core-20240207.zip
unzip OpenCompassData-core-20231110.zip unzip OpenCompassData-core-20240207.zip
``` ```
如果需要使用 OpenCompass 提供的更加完整的数据集 (~500M)，可以使用下述命令进行下载和解压： 如果需要使用 OpenCompass 提供的更加完整的数据集 (~500M)，可以使用下述命令进行下载和解压：
```bash ```bash
wget https://github.com/open-compass/opencompass/releases/download/0.1.8.rc1/OpenCompassData-complete-20231110.zip wget https://github.com/open-compass/opencompass/releases/download/0.2.2.rc1/OpenCompassData-complete-20240207.zip
unzip OpenCompassData-complete-20231110.zip unzip OpenCompassData-complete-20240207.zip
cd ./data cd ./data
find . -name "*.zip" -exec unzip {} \; find . -name "*.zip" -exec unzip {} \;
``` ```
两个 `.zip` 中所含数据集列表如[此处](https://github.com/open-compass/opencompass/releases/tag/0.1.8.rc1)所示。 两个 `.zip` 中所含数据集列表如[此处](https://github.com/open-compass/opencompass/releases/tag/0.2.2.rc1)所示。
OpenCompass 已经支持了大多数常用于性能比较的数据集，具体支持的数据集列表请直接在 `configs/datasets` 下进行查找。 OpenCompass 已经支持了大多数常用于性能比较的数据集，具体支持的数据集列表请直接在 `configs/datasets` 下进行查找。
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment