"vscode:/vscode.git/clone" did not exist on "90cc9baade7b4e298d220b0f8735baeeeec0f4bb"
Commit 0d54bada authored by Rayyyyy's avatar Rayyyyy
Browse files

Add SCNet

parent f8ada28f
...@@ -65,7 +65,7 @@ export HF_ENDPOINT=https://hf-mirror.com ...@@ -65,7 +65,7 @@ export HF_ENDPOINT=https://hf-mirror.com
``` ```
## 数据集 ## 数据集
**训练数据**: [sentence-transformers/stsb](https://huggingface.co/datasets/sentence-transformers/stsb),训练代码自动下载。 **训练数据**: [sentence-transformers/stsb](https://hf-mirror.com/datasets/sentence-transformers/stsb),训练代码自动下载。
**推理数据**: 需要转换成txt格式,参考[gen_simple_wikipedia_v1.py](./gen_simple_wikipedia_v1.py)文件,生成`simple_wiki_pair.txt` **推理数据**: 需要转换成txt格式,参考[gen_simple_wikipedia_v1.py](./gen_simple_wikipedia_v1.py)文件,生成`simple_wiki_pair.txt`
数据集的目录结构如下: 数据集的目录结构如下:
...@@ -78,8 +78,8 @@ export HF_ENDPOINT=https://hf-mirror.com ...@@ -78,8 +78,8 @@ export HF_ENDPOINT=https://hf-mirror.com
``` ```
## 训练 ## 训练
- **训练**默认模型[bert-base-uncased](https://huggingface.co/google-bert/bert-base-uncased) - **训练**默认模型[bert-base-uncased](http://113.200.138.88:18080/aimodels/bert-base-uncased)
- **微调**默认模型[all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2) - **微调**默认模型[all-MiniLM-L6-v2](http://113.200.138.88:18080/aimodels/all-MiniLM-L6-v2)
### 单机多卡 ### 单机多卡
- 训练 - 训练
...@@ -114,7 +114,7 @@ python infer.py --data_path ./dataset/simple_wikipedia_v1/simple_wiki_pair.txt - ...@@ -114,7 +114,7 @@ python infer.py --data_path ./dataset/simple_wikipedia_v1/simple_wiki_pair.txt -
<img src="./doc/results.png"/> <img src="./doc/results.png"/>
</div> </div>
### 精度 ## 精度
在sts-test数据集上评估模型,Cosine-Similarity得分对比 在sts-test数据集上评估模型,Cosine-Similarity得分对比
| device | backbone | epoch | Pearson | Spearman | | device | backbone | epoch | Pearson | Spearman |
| :------: | :------: | :------: | :------: | :------: | | :------: | :------: | :------: | :------: | :------: |
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment