Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
opencompass
Commits
3871188c
Unverified
Commit
3871188c
authored
Sep 07, 2023
by
Songyang Zhang
Committed by
GitHub
Sep 07, 2023
Browse files
[Feat] Update URL (#368)
parent
a05daab9
Changes
21
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
docs/zh_cn/user_guides/metrics.md
docs/zh_cn/user_guides/metrics.md
+2
-2
No files found.
docs/zh_cn/user_guides/metrics.md
View file @
3871188c
...
...
@@ -12,7 +12,7 @@
## 已支持评估指标
目前 OpenCompass 中,常用的 Evaluator 主要放在
[
`opencompass/openicl/icl_evaluator`
](
https://github.com/
InternLM
/opencompass/tree/main/opencompass/openicl/icl_evaluator
)
文件夹下, 还有部分数据集特有指标的放在
[
`opencompass/datasets`
](
https://github.com/
InternLM
/opencompass/tree/main/opencompass/datasets
)
的部分文件中。以下是汇总:
目前 OpenCompass 中,常用的 Evaluator 主要放在
[
`opencompass/openicl/icl_evaluator`
](
https://github.com/
open-compass
/opencompass/tree/main/opencompass/openicl/icl_evaluator
)
文件夹下, 还有部分数据集特有指标的放在
[
`opencompass/datasets`
](
https://github.com/
open-compass
/opencompass/tree/main/opencompass/datasets
)
的部分文件中。以下是汇总:
| 评估指标 | 评估策略 | 常用后处理方式 | 数据集 |
| ------------------ | -------------------- | --------------------------- | -------------------------------------------------------------------- |
...
...
@@ -33,7 +33,7 @@
评估标准配置一般放在数据集配置文件中,最终的 xxdataset_eval_cfg 会传给
`dataset.infer_cfg`
作为实例化的一个参数。
下面是
`govrepcrs_eval_cfg`
的定义, 具体可查看
[
configs/datasets/govrepcrs
](
https://github.com/
InternLM
/opencompass/tree/main/configs/datasets/govrepcrs
)
。
下面是
`govrepcrs_eval_cfg`
的定义, 具体可查看
[
configs/datasets/govrepcrs
](
https://github.com/
open-compass
/opencompass/tree/main/configs/datasets/govrepcrs
)
。
```
python
from
opencompass.openicl.icl_evaluator
import
BleuEvaluator
...
...
Prev
1
2
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment