Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
sentence-BERT_pytorch
Commits
0d54bada
Commit
0d54bada
authored
Jul 05, 2024
by
Rayyyyy
Browse files
Add SCNet
parent
f8ada28f
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
4 deletions
+4
-4
README.md
README.md
+4
-4
No files found.
README.md
View file @
0d54bada
...
...
@@ -65,7 +65,7 @@ export HF_ENDPOINT=https://hf-mirror.com
```
## 数据集
**训练数据**
:
[
sentence-transformers/stsb
](
https://h
uggingface
.co/datasets/sentence-transformers/stsb
)
,训练代码自动下载。
**训练数据**
:
[
sentence-transformers/stsb
](
https://h
f-mirror
.co
m
/datasets/sentence-transformers/stsb
)
,训练代码自动下载。
**推理数据**
: 需要转换成txt格式,参考
[
gen_simple_wikipedia_v1.py
](
./gen_simple_wikipedia_v1.py
)
文件,生成
`simple_wiki_pair.txt`
。
数据集的目录结构如下:
...
...
@@ -78,8 +78,8 @@ export HF_ENDPOINT=https://hf-mirror.com
```
## 训练
-
**训练**
默认模型
[
bert-base-uncased
](
http
s
://
huggingface.co/google-bert
/bert-base-uncased
)
-
**微调**
默认模型
[
all-MiniLM-L6-v2
](
http
s
://
huggingface.co/sentence-transformer
s/all-MiniLM-L6-v2
)
-
**训练**
默认模型
[
bert-base-uncased
](
http://
113.200.138.88:18080/aimodels
/bert-base-uncased
)
-
**微调**
默认模型
[
all-MiniLM-L6-v2
](
http://
113.200.138.88:18080/aimodel
s/all-MiniLM-L6-v2
)
### 单机多卡
-
训练
...
...
@@ -114,7 +114,7 @@ python infer.py --data_path ./dataset/simple_wikipedia_v1/simple_wiki_pair.txt -
<img
src=
"./doc/results.png"
/>
</div>
##
#
精度
## 精度
在sts-test数据集上评估模型,Cosine-Similarity得分对比
| device | backbone | epoch | Pearson | Spearman |
| :------: | :------: | :------: | :------: | :------: |
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment