Skip to content

GitLab

Unverified Commit 608ff581 authored by jxd's avatar jxd Committed by GitHub
Browse files

support CHARM (https://github.com/opendatalab/CHARM) reasoning tasks (#1190) 

* support CHARM (https://github.com/opendatalab/CHARM

) reasoning tasks

* fix lint error

* add dataset card for CHARM

* minor refactor

* add txt

---------
Co-authored-by: default avatarwujiang <wujiang@pjlab.org.cn>
Co-authored-by: default avatarLeymore <zfz-960727@163.com>
parent 07a6dacf
Hide whitespace changes
Inline Side-by-side
Showing with 905 additions and 0 deletions
configs/_internal 0 → 120000
View file @ 608ff581
/cpfs01/user/zhoufengzhe/fattn2/opencompass/configs/internal/
\ No newline at end of file
configs/datasets/CHARM/README.md 0 → 100644
View file @ 608ff581
# CHARM✨ Benchmarking Chinese Commonsense Reasoning of LLMs: From Chinese-Specifics to Reasoning-Memorization Correlations [ACL2024]
[![arXiv](https://img.shields.io/badge/arXiv-2403.14112-b31b1b.svg)](https://arxiv.org/abs/2403.14112)
[![license](https://img.shields.io/github/license/InternLM/opencompass.svg)](./LICENSE)
<div align="center">
📃[Paper](https://arxiv.org/abs/2403.14112)
🏰[Project Page](https://opendatalab.github.io/CHARM/)
🏆[Leaderboard](https://opendatalab.github.io/CHARM/leaderboard.html)
✨[Findings](https://opendatalab.github.io/CHARM/findings.html)
</div>
<div align="center">
📖 <a href="./README_ZH.md"> 中文</a> | <a href="./README.md">English</a>
</div>
## Dataset Description
**CHARM** is the first benchmark for comprehensively and in-depth evaluating the commonsense reasoning ability of large language models (LLMs) in Chinese, which covers both globally known and Chinese-specific commonsense. In addition, the CHARM can evaluate the LLMs' memorization-independent reasoning abilities and analyze the typical errors.
## Comparison of commonsense reasoning benchmarks
<html lang="en">
<table align="center">
<thead class="fixed-header">
<tr>
<th>Benchmarks</th>
<th>CN-Lang</th>
<th>CSR</th>
<th>CN-specifics</th>
<th>Dual-Domain</th>
<th>Rea-Mem</th>
</tr>
</thead>
<tr>
<td>Most benchmarks in <a href="https://arxiv.org/abs/2302.04752"> davis2023benchmarks</a></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
</tr>
<tr>
<td><a href="https://arxiv.org/abs/1809.05053"> XNLI</a>, <a
href="https://arxiv.org/abs/2005.00333">XCOPA</a>,<a
href="https://arxiv.org/abs/2112.10668">XStoryCloze</a></td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
</tr>
<tr>
<td><a href="https://arxiv.org/abs/2007.08124">LogiQA</a>, <a
href="https://arxiv.org/abs/2004.05986">CLUE</a>, <a
href="https://arxiv.org/abs/2306.09212">CMMLU</a></td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
</tr>
<tr>
<td><a href="https://arxiv.org/abs/2312.12853">CORECODE</a> </td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
</tr>
<tr>
<td><strong><a href="https://arxiv.org/abs/2403.14112">CHARM (ours)</a> </strong></td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
</tr>
</table>
"CN-Lang" indicates the benchmark is presented in Chinese language. "CSR" means the benchmark is designed to focus on <strong>C</strong>ommon<strong>S</strong>ense <strong>R</strong>easoning. "CN-specific" indicates the benchmark includes elements that are unique to Chinese culture, language, regional characteristics, history, etc. "Dual-Domain" indicates the benchmark encompasses both Chinese-specific and global domain tasks, with questions presented in the similar style and format. "Rea-Mem" indicates the benchmark includes closely-interconnected <strong>rea</strong>soning and <strong>mem</strong>orization tasks.
## 🛠️ How to Use
Below are the steps for quickly downloading CHARM and using OpenCompass for evaluation.
### 1. Download CHARM
```bash
git clone https://github.com/opendatalab/CHARM ${path_to_CHARM_repo}
```
### 2. Run Inference and Evaluation
```bash
cd ${path_to_opencompass}
mkdir -p data
ln -snf ${path_to_CHARM_repo}/data/CHARM ./data/CHARM
# Infering and evaluating CHARM with hf_llama3_8b_instruct model
python run.py --models hf_llama3_8b_instruct --datasets charm_gen
```
## 🖊️ Citation
```bibtex
@misc{sun2024benchmarking,
title={Benchmarking Chinese Commonsense Reasoning of LLMs: From Chinese-Specifics to Reasoning-Memorization Correlations},
author={Jiaxing Sun and Weiquan Huang and Jiang Wu and Chenya Gu and Wei Li and Songyang Zhang and Hang Yan and Conghui He},
year={2024},
eprint={2403.14112},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```
configs/datasets/CHARM/README_ZH.md 0 → 100644
View file @ 608ff581
# CHARM✨ Benchmarking Chinese Commonsense Reasoning of LLMs: From Chinese-Specifics to Reasoning-Memorization Correlations [ACL2024]
[![arXiv](https://img.shields.io/badge/arXiv-2403.14112-b31b1b.svg)](https://arxiv.org/abs/2403.14112)
[![license](https://img.shields.io/github/license/InternLM/opencompass.svg)](./LICENSE)
<div align="center">
📃[Paper](https://arxiv.org/abs/2403.14112)
🏰[Project Page](https://opendatalab.github.io/CHARM/)
🏆[Leaderboard](https://opendatalab.github.io/CHARM/leaderboard.html)
✨[Findings](https://opendatalab.github.io/CHARM/findings.html)
</div>
<div align="center">
📖 <a href="./README_ZH.md"> 中文</a> | <a href="./README.md">English</a>
</div>
## 数据集介绍
**CHARM** 是首个全面深入评估大型语言模型（LLMs）在中文常识推理能力的基准测试，它覆盖了国际普遍认知的常识以及独特的中国文化常识。此外，CHARM 还可以评估 LLMs 独立于记忆的推理能力，并分析其典型错误。
## 与其他常识推理评测基准的比较
<html lang="en">
<table align="center">
<thead class="fixed-header">
<tr>
<th>基准</th>
<th>汉语</th>
<th>常识推理</th>
<th>中国特有知识</th>
<th>中国和世界知识域</th>
<th>推理和记忆的关系</th>
</tr>
</thead>
<tr>
<td><a href="https://arxiv.org/abs/2302.04752"> davis2023benchmarks</a> 中提到的基准</td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
</tr>
<tr>
<td><a href="https://arxiv.org/abs/1809.05053"> XNLI</a>, <a
href="https://arxiv.org/abs/2005.00333">XCOPA</a>,<a
href="https://arxiv.org/abs/2112.10668">XStoryCloze</a></td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
</tr>
<tr>
<td><a href="https://arxiv.org/abs/2007.08124">LogiQA</a>,<a
href="https://arxiv.org/abs/2004.05986">CLUE</a>, <a
href="https://arxiv.org/abs/2306.09212">CMMLU</a></td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
</tr>
<tr>
<td><a href="https://arxiv.org/abs/2312.12853">CORECODE</a> </td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
<td><strong><span style="color: red;">&#x2718;</span></strong></td>
</tr>
<tr>
<td><strong><a href="https://arxiv.org/abs/2403.14112">CHARM (ours)</a> </strong></td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
<td><strong><span style="color: green;">&#x2714;</span></strong></td>
</tr>
</table>
## 🛠️ 如何使用
以下是快速下载 CHARM 并在 OpenCompass 上进行评估的步骤。
### 1. 下载 CHARM
```bash
git clone https://github.com/opendatalab/CHARM ${path_to_CHARM_repo}
```
### 2. 推理和评测
```bash
cd ${path_to_opencompass}
mkdir -p data
ln -snf ${path_to_CHARM_repo}/data/CHARM ./data/CHARM
# 在CHARM上对模型hf_llama3_8b_instruct做推理和评测
python run.py --models hf_llama3_8b_instruct --datasets charm_gen
```
## 🖊️ 引用
```bibtex
@misc{sun2024benchmarking,
title={Benchmarking Chinese Commonsense Reasoning of LLMs: From Chinese-Specifics to Reasoning-Memorization Correlations},
author={Jiaxing Sun and Weiquan Huang and Jiang Wu and Chenya Gu and Wei Li and Songyang Zhang and Hang Yan and Conghui He},
year={2024},
eprint={2403.14112},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```
configs/datasets/CHARM/charm_rea_gen.py 0 → 100644
View file @ 608ff581
from mmengine.config import read_base
with read_base():
from .charm_rea_gen_f8fca2 import charm_rea_datasets # noqa: F401, F403
configs/datasets/CHARM/charm_rea_gen_f8fca2.py 0 → 100644
View file @ 608ff581
import os
from opencompass.openicl.icl_prompt_template import PromptTemplate
from opencompass.openicl.icl_retriever import ZeroRetriever
from opencompass.openicl.icl_inferencer import GenInferencer
from opencompass.datasets import CharmDataset, charm_rea_postprocess, CharmReaEvaluator
charm_tasks = [
'Chinese_Anachronisms_Judgment',
'Chinese_Movie_and_Music_Recommendation',
'Chinese_Natural_Language_Inference',
'Chinese_Reading_Comprehension',
'Chinese_Sequence_Understanding',
'Chinese_Sport_Understanding',
'Chinese_Time_Understanding',
'Global_Anachronisms_Judgment',
'Global_Movie_and_Music_Recommendation',
'Global_Natural_Language_Inference',
'Global_Reading_Comprehension',
'Global_Sequence_Understanding',
'Global_Sport_Understanding',
'Global_Time_Understanding',
]
data_dir = 'data/CHARM'
dataset_path_ZH = f'{data_dir}/reasoning'
dataset_path_TransEn = f'{data_dir}/reasoning_Translate-EN'
fewshot_example_path_ZH = os.path.join(os.path.dirname(__file__), 'few-shot-examples')
fewshot_example_path_TransEn = os.path.join(os.path.dirname(__file__), 'few-shot-examples_Translate-EN')
XLT_template = 'Follow the given examples and answer the question.\n{_hint}\n\n I want you to act as an commonsense reasoning expert for Chinese. \n Request: {{input}}\n'
Translate_EN_template = 'Follow the given examples and answer the question.\n{_hint}\n\nQ: {{input}}\nA: '
Other_template = '请按照给定的例子回答问题。\n{_hint}\n\nQ：{{input}}\nA：'
settings = [
(
'Direct',
'',
dataset_path_ZH,
fewshot_example_path_ZH,
Other_template,
),
(
'ZH-CoT',
'让我们一步一步来思考。',
dataset_path_ZH,
fewshot_example_path_ZH,
Other_template,
),
(
'EN-CoT',
"Let's think step by step.",
dataset_path_ZH,
fewshot_example_path_ZH,
Other_template,
),
(
'XLT',
"""You should retell the request in English.\nYou should do the answer step by step to choose the right answer.\nYou should step-by-step answer the request.\nYou should tell me the answer in this format 'So the answer is'.""",
dataset_path_ZH,
fewshot_example_path_ZH,
XLT_template,
),
(
'Translate-EN',
"Let's think step by step.",
dataset_path_TransEn,
fewshot_example_path_TransEn,
Translate_EN_template,
),
]
charm_rea_datasets = []
for _cot, _cot_prefix, dataset_path, fewshot_example_path, prompt_template in settings:
for _task in charm_tasks:
_fewshot_example_file = os.path.join(fewshot_example_path, f'{_task}_{_cot}.txt')
with open(_fewshot_example_file, 'r') as f:
_hint = f.read()
charm_rea_reader_cfg = dict(input_columns=['input'], output_column='target')
charm_rea_infer_cfg = dict(
prompt_template=dict(
type=PromptTemplate,
template=dict(round=[dict(role='HUMAN', prompt=prompt_template.format(_hint=_hint) + _cot_prefix)]),
),
retriever=dict(type=ZeroRetriever),
inferencer=dict(type=GenInferencer, max_out_len=512),
)
charm_rea_eval_cfg = dict(
evaluator=dict(type=CharmReaEvaluator),
pred_role='BOT',
pred_postprocessor=dict(type=charm_rea_postprocess),
dataset_postprocessor=dict(type=charm_rea_postprocess),
)
charm_rea_datasets.append(
dict(
type=CharmDataset,
path=dataset_path,
name=_task,
abbr='charm-rea-' + _task + '_' + _cot,
reader_cfg=charm_rea_reader_cfg,
infer_cfg=charm_rea_infer_cfg.copy(),
eval_cfg=charm_rea_eval_cfg.copy(),
)
)
configs/datasets/CHARM/few-shot-examples/Chinese_Anachronisms_Judgment_Direct.txt 0 → 100644
View file @ 608ff581
识别给定陈述是否包含时代错误。
Q：以下陈述是否包含时代错误，请选择正确选项。一个接受了义务教育、具备基本常识的人会如何选择？
李白用钢笔写诗。
选项：
(A) 是
(B) 否
A:(A)
Q：以下陈述是否包含时代错误，请选择正确选项。一个接受了义务教育、具备基本常识的人会如何选择？
唐朝时期，人们可以在街头买到《红楼梦》。
选项：
(A) 是
(B) 否
A:(A)
Q：以下陈述是否包含时代错误，请选择正确选项。一个接受了义务教育、具备基本常识的人会如何选择？
1998年10月1日，人们手举五星红旗，在天安门广场上庆祝国庆
选项：
(A) 是
(B) 否
A:(B)
\ No newline at end of file
configs/datasets/CHARM/few-shot-examples/Chinese_Anachronisms_Judgment_EN-CoT.txt 0 → 100644
View file @ 608ff581
识别给定陈述是否包含时代错误。
Q：以下陈述是否包含时代错误，请选择正确选项。一个接受了义务教育、具备基本常识的人会如何选择？
李白用钢笔写诗。
选项：
(A) 是
(B) 否
A：Let's think step by step.
This statement mentions "Li Bai", a poet from the Tang Dynasty in China. The "pen" mentioned in the statement is a modern device, so it is impossible for Li Bai to write poetry with a pen. This statement contains errors from the times. So the answer is (A).
Q：以下陈述是否包含时代错误，请选择正确选项。一个接受了义务教育、具备基本常识的人会如何选择？
唐朝时期，人们可以在街头买到《红楼梦》。
选项：
(A) 是
(B) 否
A：Let's think step by step.
This statement mentions "Dream of the Red Chamber", which was written by Qing Dynasty writer Cao Xueqin. There was no "Dream of the Red Chamber" during the Tang Dynasty, so this statement contains historical errors. So the answer is (A).
Q：以下陈述是否包含时代错误，请选择正确选项。一个接受了义务教育、具备基本常识的人会如何选择？
1998年10月1日，人们手举五星红旗，在天安门广场上庆祝国庆
选项：
(A) 是
(B) 否
A：Let's think step by step.
This statement mentions that in 1998, New China was established in 1949, and the five-star red flag was designated as the national flag of China. Therefore, October 1, 1998 is National Day, and it is reasonable for people to celebrate National Day at Tiananmen Square, excluding historical errors. So the answer is (B).
\ No newline at end of file
configs/datasets/CHARM/few-shot-examples/Chinese_Anachronisms_Judgment_XLT.txt 0 → 100644
View file @ 608ff581
识别给定陈述是否包含时代错误。
I want you to act as a commonsense reasoning expert for Chinese.
Request：以下陈述是否包含时代错误，请选择正确选项。一个接受了义务教育、具备基本常识的人会如何选择？
李白用钢笔写诗。
选项：
(A) 是
(B) 否
You should retell the request in English.
You should do the answer step by step to choose the right answer.
You should step-by-step answer the request.
You should tell me the answer in this format 'So the answer is'.
Request: How would a typical person answer each of the following statement whether contains an anachronism?
Li Bai writes poetry with a pen.
Option:
(A) Yes
(B) No
Step-by-step answer:
1.This statement mentions "Li Bai", a poet from the Tang Dynasty in China.
2.The pen mentioned in the statement is a modern device.
3.so it is impossible for Li Bai to write poetry with a pen. This statement contains errors from the times.
So the answer is (A).
I want you to act as a commonsense reasoning expert for Chinese.
Request：以下陈述是否包含时代错误，请选择正确选项。一个接受了义务教育、具备基本常识的人会如何选择？
唐朝时期，人们可以在街头买到《红楼梦》。
选项：
(A) 是
(B) 否
You should retell the request in English.
You should do the answer step by step to choose the right answer.
You should step-by-step answer the request.
You should tell me the answer in this format 'So the answer is'.
Request: How would a typical person answer each of the following statement whether contains an anachronism?
During the Tang Dynasty, people could buy "Dream of the Red Chamber" on the streets.
Option:
(A) Yes
(B) No
Step-by-step answer:
1.This statement mentions "Dream of the Red Chamber", which was written by Qing Dynasty writer Cao Xueqin
2.During the Tang Dynasty, there was no "Dream of the Red Chamber", so this statement contains historical errors.
So the answer is (A).
I want you to act as a commonsense reasoning expert for Chinese.
Request：以下陈述是否包含时代错误，请选择正确选项。一个接受了义务教育、具备基本常识的人会如何选择？
1998年10月1日，人们手举五星红旗，在天安门广场上庆祝国庆
选项：
(A) 是
(B) 否
You should retell the request in English.
You should do the answer step by step to choose the right answer.
You should step-by-step answer the request.
You should tell me the answer in this format 'So the answer is'.
Request: How would a typical person answer each of the following statement whether contains an anachronism?
On October 1, 1998, people held five-star red flags and celebrated National Day on Tiananmen Square
Option:
(A) Yes
(B) No
Step-by-step answer:
1.This statement mentions that in 1998, New China was established in 1949
2.The Five Star Red Flag was designated as the national flag of China in 1949.
3.So October 1st, 1998 is National Day, and it is reasonable for people to celebrate National Day at Tiananmen Square, so the statement does not contain any historical errors.
So the answer is (B).
\ No newline at end of file
configs/datasets/CHARM/few-shot-examples/Chinese_Anachronisms_Judgment_ZH-CoT.txt 0 → 100644
View file @ 608ff581
识别给定陈述是否包含时代错误。
Q：以下陈述是否包含时代错误，请选择正确选项。一个接受了义务教育、具备基本常识的人会如何选择？
李白用钢笔写诗。
选项：
(A) 是
(B) 否
A：让我们一步一步来思考。
这个陈述提到了“李白”，他是中国唐朝时期的诗人。而陈述中提到的“钢笔”是现代设备，因此李白不可能使用钢笔写诗，该陈述包含时代错误。所以答案是(A)。
Q：以下陈述是否包含时代错误，请选择正确选项。一个接受了义务教育、具备基本常识的人会如何选择？
唐朝时期，人们可以在街头买到《红楼梦》。
选项：
(A) 是
(B) 否
A：让我们一步一步来思考。
这个陈述提到了《红楼梦》，《红楼梦》是清代作家曹雪芹所写，唐朝时还没有《红楼梦》，因此该陈述包含时代错误。所以答案是(A)。
Q：以下陈述是否包含时代错误，请选择正确选项。一个接受了义务教育、具备基本常识的人会如何选择？
1998年10月1日，人们手举五星红旗，在天安门广场上庆祝国庆
选项：
(A) 是
(B) 否
A：让我们一步一步来思考。
这个陈述提到了1998年，新中国是1949年成立的，五星红旗在1949年被确定为中国国旗，因此1998年10月1日是国庆节，人们在天安门庆祝国庆是合理的，因此陈述不包含时代错误。所以答案是(B)。
\ No newline at end of file
configs/datasets/CHARM/few-shot-examples/Chinese_Movie_and_Music_Recommendation_Direct.txt 0 → 100644
View file @ 608ff581
给根据给定艺术作品清单，找出最类似的。
Q: 和这些电影《疯狂的外星人》、《斗牛》、《杀生》、《疯狂的石头》有共同点的电影是：
选项:
(A)《泰囧》
(B)《少年派》
(C)《江湖儿女》
(D)《湄公河行动》
A: (A)
Q: 和这些电影《红高梁》、《活着》、《大红灯笼高高挂》、《英雄》有共同点的电影是：
选项:
(A)《一个都不能少》
(B)《让子弹飞》
(C)《阿飞正传》
(D)《东邪西毒》
A: (A)
Q: 和这些歌曲《夜曲》、《本草纲目》、《听妈妈的话》、《七里香》有共同点的歌曲是：
选项:
(A)《双节棍》
(B)《年少有为》
(C)《浮夸》
(D)《三人游》
A: (A)
\ No newline at end of file
configs/datasets/CHARM/few-shot-examples/Chinese_Movie_and_Music_Recommendation_EN-CoT.txt 0 → 100644
View file @ 608ff581
给根据给定艺术作品清单，找出最类似的。
Q: 和这些电影《疯狂的外星人》、《斗牛》、《杀生》、《疯狂的石头》有共同点的电影是：
选项:
(A)《泰囧》
(B)《少年派》
(C)《江湖儿女》
(D)《湄公河行动》
A：Let's think step by step.
"Crazy Alien" is a comedy science fiction film directed by Ning Hao, written by Liu Cixin and Sun Xiaohang, and starring Huang Bo, Shen Teng, and Xu Zheng. It was released in 2019.
"Cow" is a dark comedy film directed by Guan Hu, starring Huang Bo and Yan Ni. It was released in 2009.
"Design of Death" is an absurd and suspenseful comedy film directed by Guan Hu, featuring Huang Bo, Simon Yam, Su Youpeng, and Yu Nan. It was released in 2012.
"Crazy Stone" is a dark comedy film directed by Ning Hao, featuring Guo Tao, Liu Hua, Lian Jin, Liu Gang, Xu Zheng, and Huang Bo. It was released in 2006.
These are all famous classic Chinese comedy films featuring Huang Bo. The only film among the options that seems to have something in common with these films is "Lost in Thailand" (directed by Xu Zheng, starring Huang Bo, Xu Zheng, and Wang Baoqiang), a comedy film released in 2012. So the answer is (A).
Q: 和这些电影《红高梁》、《活着》、《大红灯笼高高挂》、《英雄》有共同点的电影是：
选项:
(A)《一个都不能少》
(B)《让子弹飞》
(C)《阿飞正传》
(D)《东邪西毒》
A:Let's think step by step.
"Red Sorghum," directed by Zhang Yimou and starring Jiang Wen, Gong Li, and Teng Rujun, is a war drama film that was released in China in 1987.
"To Live," directed by Zhang Yimou and starring Ge You and Gong Li, is a drama film that was released in China in 1994.
"Raise the Red Lantern," directed by Zhang Yimou and starring Gong Li, He Saifei, Ma Jingwu, Cao Cuifen, Kong Lin, and Jin Shuyuan, is a drama film that was released in China in 1991.
"Hero," directed by Zhang Yimou and starring Jet Li, Tony Leung, Maggie Cheung, Chen Daoming, Zhang Ziyi, and Donnie Yen, is a wuxia film that was released in China in 2002.
These are all famous classic Chinese films directed by Zhang Yimou. The only film among the options that seems to have something in common with these films is "Not One Less" (directed by Zhang Yimou, starring Wei Minzhi and Zhang Huike), a drama film released in 1999. So the answer is (A).
Q: 和这些歌曲《夜曲》、《本草纲目》、《听妈妈的话》、《七里香》有共同点的歌曲是：
选项:
(A)《双节棍》
(B)《年少有为》
(C)《浮夸》
(D)《三人游》
A：Let's think step by step.
"Nocturne" is a song performed by Jay Chou, with lyrics by Vincent Fang, music by Jay Chou, and arrangement by Michael Lin. It is included in Jay Chou's 2005 album "November's Chopin."
"Herbalist's Manual" is a song performed by Jay Chou, with lyrics by Vincent Fang, music by Jay Chou, and arrangement by Michael Lin. It is included in Jay Chou's 2006 album "Still Fantasy."
"Listen to Your Mother" is a song performed by Jay Chou, with lyrics and music by Jay Chou, arrangement by Michael Lin and Hong Jingyao. It is included in Jay Chou's 2006 album "Still Fantasy."
"Common Jasmine Orange" is a song performed by Jay Chou, with lyrics by Vincent Fang, music by Jay Chou, and arrangement by Chung Hsin-min. It is included in Jay Chou's self-titled album "Common Jasmine Orange" released in 2004.
These are all famous pop songs performed by Jay Chou. The only song among the options that seems to have something in common with these songs is "Nunchucks" (performed by Jay Chou, composed by Jay Chou, lyrics by Vincent Fang, arrangement by Chung Hsin-min, included in Jay Chou's 2001 album "Fantasy"). So the answer is (A).
\ No newline at end of file
configs/datasets/CHARM/few-shot-examples/Chinese_Movie_and_Music_Recommendation_XLT.txt 0 → 100644
View file @ 608ff581
给根据给定艺术作品清单，找出最类似的。
I want you to act as a commonsense reasoning expert for Chinese.
Request：和这些电影《疯狂的外星人》、《斗牛》、《杀生》、《疯狂的石头》有共同点的电影是：
选项:
(A)《泰囧》
(B)《少年派》
(C)《江湖儿女》
(D)《湄公河行动》
You should retell the request in English.
You should do the answer step by step to choose the right answer.
You should step-by-step answer the request.
You should tell me the answer in this format 'So the answer is'.
Request：The movie that has something in common with these movies Crazy Aliens, Bullitt, Killjoys and Crazy Stone is:
Options.
(A)Lost in Thailand
(B)The Young and the Restless
(C)The Children of the River and the Lake
(D)The Mekong Operation
Step-by-step answer:
1."Crazy Alien" is a comedy science fiction film directed by Ning Hao, written by Liu Cixin and Sun Xiaohang, and starring Huang Bo, Shen Teng, and Xu Zheng. It was released in 2019.
2."Cow" is a dark comedy film directed by Guan Hu, starring Huang Bo and Yan Ni. It was released in 2009.
3."Design of Death" is an absurd and suspenseful comedy film directed by Guan Hu, featuring Huang Bo, Simon Yam, Su Youpeng, and Yu Nan. It was released in 2012.
4."Crazy Stone" is a dark comedy film directed by Ning Hao, featuring Guo Tao, Liu Hua, Lian Jin, Liu Gang, Xu Zheng, and Huang Bo. It was released in 2006.
5.These are all famous classic Chinese comedy films featuring Huang Bo. The only film among the options that seems to have something in common with these films is "Lost in Thailand" (directed by Xu Zheng, starring Huang Bo, Xu Zheng, and Wang Baoqiang), a comedy film released in 2012.
So the answer is (A).
I want you to act as a commonsense reasoning expert for Chinese.
Request：和这些电影《红高梁》、《活着》、《大红灯笼高高挂》、《英雄》有共同点的电影是：
选项:
(A)《一个都不能少》
(B)《让子弹飞》
(C)《阿飞正传》
(D)《东邪西毒》
You should retell the request in English.
You should do the answer step by step to choose the right answer.
You should step-by-step answer the request.
You should tell me the answer in this format 'So the answer is'.
Request：The movie that has something in common with these movies 'Red High Beam', 'Alive', 'Big Red Lantern' and 'Hero' is:
Option.
(A) 'Not One Less'
(B)Let the Bullets Fly
(C)The Legend of Ah Fei
(D)East is East, West is West
Step-by-step answer:
1."Red Sorghum," directed by Zhang Yimou and starring Jiang Wen, Gong Li, and Teng Rujun, is a war drama film that was released in China in 1987.
2."To Live," directed by Zhang Yimou and starring Ge You and Gong Li, is a drama film that was released in China in 1994.
3."Raise the Red Lantern," directed by Zhang Yimou and starring Gong Li, He Saifei, Ma Jingwu, Cao Cuifen, Kong Lin, and Jin Shuyuan, is a drama film that was released in China in 1991.
4."Hero," directed by Zhang Yimou and starring Jet Li, Tony Leung, Maggie Cheung, Chen Daoming, Zhang Ziyi, and Donnie Yen, is a wuxia film that was released in China in 2002.
5.These are all famous classic Chinese films directed by Zhang Yimou. The only film among the options that seems to have something in common with these films is "Not One Less" (directed by Zhang Yimou, starring Wei Minzhi and Zhang Huike), a drama film released in 1999.
So the answer is (A).
I want you to act as a commonsense reasoning expert for Chinese.
Request：和这些歌曲《夜曲》、《本草纲目》、《听妈妈的话》、《七里香》有共同点的歌曲是：
选项:
(A)《双节棍》
(B)《年少有为》
(C)《浮夸》
(D)《三人游》
You should retell the request in English.
You should do the answer step by step to choose the right answer.
You should step-by-step answer the request.
You should tell me the answer in this format 'So the answer is'.
Request：The songs that have something in common with these songs "Nocturne", "Materia Medica", "Listen to Your Mother" and "Seven Miles" are:
Option.
(A) 'Nunchaku'
(B) 'The Young and the Restless'
(C) 'Pomp and Circumstance'
(D) "Three's a Crowd
Step-by-step answer:
1."Nocturne" is a song performed by Jay Chou, with lyrics by Vincent Fang, music by Jay Chou, and arrangement by Michael Lin. It is included in Jay Chou's 2005 album "November's Chopin."
2."Herbalist's Manual" is a song performed by Jay Chou, with lyrics by Vincent Fang, music by Jay Chou, and arrangement by Michael Lin. It is included in Jay Chou's 2006 album "Still Fantasy."
3."Listen to Your Mother" is a song performed by Jay Chou, with lyrics and music by Jay Chou, arrangement by Michael Lin and Hong Jingyao. It is included in Jay Chou's 2006 album "Still Fantasy."
4."Common Jasmine Orange" is a song performed by Jay Chou, with lyrics by Vincent Fang, music by Jay Chou, and arrangement by Chung Hsin-min. It is included in Jay Chou's self-titled album "Common Jasmine Orange" released in 2004.
5.These are all famous pop songs performed by Jay Chou. The only song among the options that seems to have something in common with these songs is "Nunchucks" (performed by Jay Chou, composed by Jay Chou, lyrics by Vincent Fang, arrangement by Chung Hsin-min, included in Jay Chou's 2001 album "Fantasy").
So the answer is (A).
\ No newline at end of file
configs/datasets/CHARM/few-shot-examples/Chinese_Movie_and_Music_Recommendation_ZH-CoT.txt 0 → 100644
View file @ 608ff581
给根据给定艺术作品清单，找出最类似的。
Q: 和这些电影《疯狂的外星人》、《斗牛》、《杀生》、《疯狂的石头》有共同点的电影是：
选项:
(A)《泰囧》
(B)《少年派》
(C)《江湖儿女》
(D)《湄公河行动》
A: 让我们一步一步来思考。
《疯狂的外星人》是由宁浩执导，刘慈欣、孙小杭编剧，黄渤、沈腾、徐峥等主演的喜剧科幻片，2019年上映。
《斗牛》是由管虎执导，黄渤、闫妮等主演的黑色喜剧电影，2009年上映。
《杀生》是由管虎执导，黄渤、任达华、苏有朋、余男等联袂主演的荒诞悬疑喜剧片，2012年上映。
《疯狂的石头》是宁浩执导，郭涛、刘桦、连晋、刘刚、徐峥、黄渤等出演的黑色喜剧片，2006年上映。
这些都是有黄渤出演的著名经典中国喜剧电影，在所有选项中，唯一与这些电影有相同点的电影似乎是《泰囧》（徐峥执导，黄渤、徐峥、王宝强主演的喜剧片，2012年上映）。所以答案是(A)。
Q: 和这些电影《红高梁》、《活着》、《大红灯笼高高挂》、《英雄》有共同点的电影是：
选项:
(A)《一个都不能少》
(B)《让子弹飞》
(C)《阿飞正传》
(D)《东邪西毒》
A: 让我们一步一步来思考。
《红高粱》由张艺谋执导，姜文、巩俐、滕汝骏等主演的战争文艺片，1987年在中国上映。
《活着》是由张艺谋执导，葛优、巩俐等主演的剧情片，1994年在中国上映。
《大红灯笼高高挂》是由张艺谋执导，巩俐、何赛飞、马精武、曹翠芬、孔琳、金淑媛等主演的剧情片，1991年在中国上映。
《英雄》是张艺谋执导，由李连杰、梁朝伟、张曼玉、陈道明、章子怡及甄子丹主演的的武侠电影，2002年在中国上映。
这些都是由张艺谋执导的著名经典中国电影，在所有选项中，唯一与这些电影有相同点的电影似乎是《一个都不能少》（张艺谋执导，魏敏芝、张慧科主演的剧情电影，1999年上映）。所以答案是(A)。
Q: 和这些歌曲《夜曲》、《本草纲目》、《听妈妈的话》、《七里香》有共同点的歌曲是：
选项:
(A)《双节棍》
(B)《年少有为》
(C)《浮夸》
(D)《三人游》
A: 让我们一步一步来思考。
《夜曲》是周杰伦演唱的一首歌曲，由方文山作词，周杰伦作曲，林迈可编曲，收录在周杰伦2005年发行的专辑《11月的萧邦》中
《本草纲目》是周杰伦演唱的一首歌曲，由方文山作词，周杰伦作曲，林迈可编曲，收录在周杰伦2006年发行的专辑《依然范特西》中。
《听妈妈的话》是周杰伦演唱的一首歌曲，由周杰伦作词、作曲，林迈可、洪敬尧编曲，收录在周杰伦2006年发行的专辑《依然范特西》中。
《七里香》是周杰伦演唱的一首歌曲，由方文山作词，周杰伦谱曲，钟兴民编曲，收录在周杰伦2004年发行的同名专辑《七里香》中。
这些都是由周杰伦演唱的中国著名流行音乐歌曲，在所有选项中，唯一与这些歌曲有相同点的歌曲似乎是《双节棍》（由周杰伦演唱，由周杰伦作曲，方文山作词，钟兴民编曲，收录于周杰伦2001年发行的专辑《范特西》中）。所以答案是(A)。
\ No newline at end of file
configs/datasets/CHARM/few-shot-examples/Chinese_Natural_Language_Inference_Direct.txt 0 → 100644
View file @ 608ff581
请根据题目中两句话的关系选择正确答案。
Q:语句一：小明刚刚去什刹海滑冰
语句二：北京现在是冬季
请问这两句话什么关系？
(A) 蕴含
(B) 矛盾
(C) 无关
A:(A)
Q:语句一：下周，一股强降水将影响整个河北省
语句二：下周，上海天气很好
请问这两句话什么关系？
(A) 蕴含
(B) 矛盾
(C) 无关
A:(C)
Q:语句一：昨天，小明在山上看落日，感叹道："夕阳无限好，只是近黄昏"
语句二：昨天下雨，小明没有出门
请问这两句话什么关系？
(A) 蕴含
(B) 矛盾
(C) 无关
A:(B)
\ No newline at end of file
configs/datasets/CHARM/few-shot-examples/Chinese_Natural_Language_Inference_EN-CoT.txt 0 → 100644
View file @ 608ff581
请根据题目中两句话的关系选择正确答案。
Q:语句一：小明刚刚去什刹海滑冰
语句二：北京现在是冬季
请问这两句话什么关系？
(A) 蕴含
(B) 矛盾
(C) 无关
A: Let's think step by step.
The first sentence mentions that Xiaoming goes to Shichahai for ice skating, which usually takes place in winter. Moreover, Shichahai is located in Beijing, which contains the message from the second sentence that it is currently winter. So the answer is (A).
Q:语句一：下周，一股强降水将影响整个河北省
语句二：下周，上海天气很好
请问这两句话什么关系？
(A) 蕴含
(B) 矛盾
(C) 无关
A: Let's think step by step.
These two sentences describe the weather conditions in two geographical locations, one in Hebei Province and the other in Shanghai. Hebei Province and Shanghai are geographically far apart, so the weather conditions in these two places may not necessarily be directly related. So, the relationship between these two sentences is irrelevant. So the answer is (C).
Q:语句一：昨天，小明在山上看落日，感叹道："夕阳无限好，只是近黄昏"
语句二：昨天下雨，小明没有出门
请问这两句话什么关系？
(A) 蕴含
(B) 矛盾
(C) 无关
A: Let's think step by step.
The first sentence states that Xiaoming saw the sunset on the mountain yesterday, while the second sentence states that it rained yesterday and Xiaoming did not go out. There is a contradiction between these two sentences, because if Xiaoming had not gone out, he could not have seen the sunset on the mountain. So, the relationship between these two sentences is contradictory. So the answer is (B).
\ No newline at end of file
configs/datasets/CHARM/few-shot-examples/Chinese_Natural_Language_Inference_XLT.txt 0 → 100644
View file @ 608ff581
请根据题目中两句话的关系选择正确答案。
I want you to act as a commonsense reasoning expert for Chinese.
Request：语句一：小明刚刚去什刹海滑冰
语句二：北京现在是冬季
请问这两句话什么关系？
(A) 蕴含
(B) 矛盾
(C) 无关
You should retell the request in English.
You should do the answer step by step to choose the right answer.
You should step-by-step answer the request.
You should tell me the answer in this format 'So the answer is'.
Request：Sentence 1: Xiaoming has just gone ice-skating in Shichahai
Sentence 2: It's winter in Beijing
What is the relationship between these two statements?
(A) Implicit
(B) Contradictory
(C) Irrelevant
Step-by-step answer:
1.The first sentence mentions that Xiaoming goes to Shichahai for ice skating, which usually takes place in winter.
2.Moreover, Shichahai is located in Beijing, which contains the message from the second sentence that it is currently winter.
So the answer is (A).
I want you to act as a commonsense reasoning expert for Chinese.
Request：语句一：下周，一股强降水将影响整个河北省
语句二：下周，上海天气很好
请问这两句话什么关系？
(A) 蕴含
(B) 矛盾
(C) 无关
You should retell the request in English.
You should do the answer step by step to choose the right answer.
You should step-by-step answer the request.
You should tell me the answer in this format 'So the answer is'.
Request：Sentence 1：Next week, a heavy rainfall will affect the whole Hebei province
Sentence 2: Next week, the weather in Shanghai will be fine.
What is the relationship between these two statements?
(A) Implied
(B) Contradictory
(C) Irrelevant
Step-by-step answer:
1.These two sentences describe the weather conditions in two geographical locations, one in Hebei Province and the other in Shanghai.
2.Hebei Province and Shanghai are geographically far apart, so the weather conditions in these two places may not necessarily be directly related. So, the relationship between these two sentences is irrelevant.
So the answer is (C).
I want you to act as a commonsense reasoning expert for Chinese.
Request：语句一：昨天，小明在山上看落日，感叹道："夕阳无限好，只是近黄昏"
语句二：昨天下雨，小明没有出门
请问这两句话什么关系？
(A) 蕴含
(B) 矛盾
(C) 无关
You should retell the request in English.
You should do the answer step by step to choose the right answer.
You should step-by-step answer the request.
You should tell me the answer in this format 'So the answer is'.
Request：Sentence 1: Yesterday, Xiao Ming watched the sunset on a hill and exclaimed, "The sunset is infinite, but it's just near dusk"
Sentence 2: Yesterday it rained and Ming didn't go out
What is the relationship between these two statements?
(A) implied
(B) contradictory
(C) Irrelevant
Step-by-step answer:
1.The first sentence states that Xiaoming saw the sunset on the mountain yesterday, while the second sentence states that it rained yesterday and Xiaoming did not go out.
2.There is a contradiction between these two sentences, because if Xiaoming had not gone out, he could not have seen the sunset on the mountain. So, the relationship between these two sentences is contradictory.
So the answer is (B).
\ No newline at end of file
configs/datasets/CHARM/few-shot-examples/Chinese_Natural_Language_Inference_ZH-CoT.txt 0 → 100644
View file @ 608ff581
请根据题目中两句话的关系选择正确答案。
Q:语句一：小明刚刚去什刹海滑冰
语句二：北京现在是冬季
请问这两句话什么关系？
(A) 蕴含
(B) 矛盾
(C) 无关
A:让我们一步一步来思考。
第一句话提到小明去什刹海滑冰，而滑冰通常在冬季进行，而且什刹海位于北京，这蕴含了第二句话的信息，即当前是冬季。所以答案是(A)。
Q:语句一：下周，一股强降水将影响整个河北省
语句二：下周，上海天气很好
请问这两句话什么关系？
(A) 蕴含
(B) 矛盾
(C) 无关
A:让我们一步一步来思考。
这两句话描述的是两个地理位置的天气情况，一个是河北省，一个是上海。河北省和上海在地理位置上相距较远，因此，这两个地方的天气情况并不一定有直接关联。所以，这两句话之间的关系是无关的。所以答案是(C)。
Q:语句一：昨天，小明在山上看落日，感叹道："夕阳无限好，只是近黄昏"
语句二：昨天下雨，小明没有出门
请问这两句话什么关系？
(A) 蕴含
(B) 矛盾
(C) 无关
A:让我们一步一步来思考。
第一句话说小明昨天在山上看到了落日，而第二句话说昨天下雨，小明没有出门。这两句话之间存在矛盾，因为如果小明没有出门，那么他就不可能在山上看到落日。所以，这两句话之间的关系是矛盾的。所以答案是(B)。
\ No newline at end of file
configs/datasets/CHARM/few-shot-examples/Chinese_Reading_Comprehension_Direct.txt 0 → 100644
View file @ 608ff581
请理解题目含义并选择正确答案。
Q:有些广东人不爱吃辣椒.因此,有些南方人不爱吃辣椒. 以下哪项能保证上述论证的成立？
(A) 有些广东人爱吃辣椒
(B) 爱吃辣椒的有些是南方人
(C) 所有的广东人都是南方人
(D) 有些广东人不爱吃辣椒也不爱吃甜食
A：(C)
Q:唐卡是极富藏族文化特色的一种绘画形式,自吐蕃王朝兴起至今已有1300多年的历史,是雪域高原的文化瑰宝.它的题材除宗教外,还有历史和民俗内容,故又被称为了解西藏的“百科全书”.所以,想要了解西藏的历史,除了正襟危坐地阅读严谨但略显呆板的史书外,你还可以选择一种惬意和愉悦的方式--欣赏唐卡,与众多的古人对话,想象曾经的历史事件,体味藏族人丰富的精神世界,了解独特的藏族民俗,这是一个让历史变得立体可感的过程. 这段文字意在说明:
(A) 唐卡可以给大家提供一种惬意轻松的了解西藏的方式
(B) 唐卡中记录了独特的藏族民俗和曾经的历史事件
(C) 唐卡是了解西藏文化和历史的“百科全书”式的绘画形式
(D) 唐卡是极富藏族文化特色且历史悠久的一种绘画形式
A：(A)
Q:“知人论世”作为一种文学批评的原则和方法,最早由战国时期的思想家孟子提出.孟子认为,后人要交结古人,只是读其诗书是不行的,还必须了解他们的为人行事以及他们的生活的时代,这样,才能读懂古人的诗书,才能和古人心契神交,成为知音. 对这段话的理解,不正确的是?
(A) 人的心灵是可以互通和共鸣的
(B) “知人论世”作为一种文学评论发沿用至今并显现了强大的生命力
(C) “知人论世”可以帮助后人交结古人和古人成为知音
(D) 了解古人和他所处的时代,有助于理解他的作品
A: (B)
\ No newline at end of file
configs/datasets/CHARM/few-shot-examples/Chinese_Reading_Comprehension_EN-CoT.txt 0 → 100644
View file @ 608ff581
请理解题目含义并选择正确答案。
Q:有些广东人不爱吃辣椒.因此,有些南方人不爱吃辣椒. 以下哪项能保证上述论证的成立？
(A) 有些广东人爱吃辣椒
(B) 爱吃辣椒的有些是南方人
(C) 所有的广东人都是南方人
(D) 有些广东人不爱吃辣椒也不爱吃甜食
A: Let's think step by step.
In this argument, we infer from "some Cantonese people do not like to eat chili peppers" that "some southerners do not like to eat chili peppers". The establishment of this reasoning depends on the relationship between Cantonese and Southerners. In order for this reasoning to be valid, we need to ensure that at least a portion of Cantonese people are from the south. Therefore, option (C) "All Cantonese are southerners" can ensure the validity of this argument. So the answer is (C).
Q:唐卡是极富藏族文化特色的一种绘画形式,自吐蕃王朝兴起至今已有1300多年的历史,是雪域高原的文化瑰宝.它的题材除宗教外,还有历史和民俗内容,故又被称为了解西藏的“百科全书”.所以,想要了解西藏的历史,除了正襟危坐地阅读严谨但略显呆板的史书外,你还可以选择一种惬意和愉悦的方式--欣赏唐卡,与众多的古人对话,想象曾经的历史事件,体味藏族人丰富的精神世界,了解独特的藏族民俗,这是一个让历史变得立体可感的过程. 这段文字意在说明:
(A) 唐卡可以给大家提供一种惬意轻松的了解西藏的方式
(B) 唐卡中记录了独特的藏族民俗和曾经的历史事件
(C) 唐卡是了解西藏文化和历史的“百科全书”式的绘画形式
(D) 唐卡是极富藏族文化特色且历史悠久的一种绘画形式
A: Let's think step by step.
It is explicitly mentioned in the article that besides reading rigorous but somewhat rigid historical books, appreciating thangkas is a comfortable and enjoyable way for people to converse with numerous ancient people, imagine past historical events, appreciate the rich spiritual world of Tibetans, and understand unique Tibetan customs. So the main purpose of this passage is (A) "Thangka can provide a comfortable and easy way for everyone to understand Xizang". So the answer is (A).
Q:“知人论世”作为一种文学批评的原则和方法,最早由战国时期的思想家孟子提出.孟子认为,后人要交结古人,只是读其诗书是不行的,还必须了解他们的为人行事以及他们的生活的时代,这样,才能读懂古人的诗书,才能和古人心契神交,成为知音. 对这段话的理解,不正确的是?
(A) 人的心灵是可以互通和共鸣的
(B) “知人论世”作为一种文学评论发沿用至今并显现了强大的生命力
(C) “知人论世”可以帮助后人交结古人和古人成为知音
(D) 了解古人和他所处的时代,有助于理解他的作品
A: Let's think step by step.
From this passage, we cannot see (B) that "understanding people and discussing the world" as a literary criticism has been used to this day and has shown strong vitality. Although "knowing people and discussing the world" was indeed proposed by the philosopher Mencius during the Warring States period as a principle and method of literary criticism, this passage does not mention that "knowing people and discussing the world" is still in use today, or that it has shown strong vitality. Therefore, option (B) is an incorrect understanding. So the answer is (B).
\ No newline at end of file
configs/datasets/CHARM/few-shot-examples/Chinese_Reading_Comprehension_XLT.txt 0 → 100644
View file @ 608ff581
请理解题目含义并选择正确答案。
I want you to act as a commonsense reasoning expert for Chinese.
Request：有些广东人不爱吃辣椒.因此,有些南方人不爱吃辣椒. 以下哪项能保证上述论证的成立？
(A) 有些广东人爱吃辣椒
(B) 爱吃辣椒的有些是南方人
(C) 所有的广东人都是南方人
(D) 有些广东人不爱吃辣椒也不爱吃甜食
You should retell the request in English.
You should do the answer step by step to choose the right answer.
You should step-by-step answer the request.
You should tell me the answer in this format 'So the answer is'.
Request: Some Cantonese people don't like chili peppers. Therefore, some southerners don't like chili peppers. Which of the following ensures the validity of the above argument?
(A) Some Cantonese people love chili peppers
(B) Some Southerners love chili peppers.
(C) All Cantonese are Southerners.
(D) Some Cantonese people do not love chili or sweets.
Step-by-step answer:
1.In this argument, we infer from "some Cantonese people do not like to eat chili peppers" that "some southerners do not like to eat chili peppers".
2.The establishment of this reasoning depends on the relationship between Cantonese and Southerners. In order for this reasoning to be valid, we need to ensure that at least a portion of Cantonese people are from the south. Therefore, option (C) "All Cantonese are southerners" can ensure the validity of this argument.
So the answer is (C).
I want you to act as a commonsense reasoning expert for Chinese.
Request：唐卡是极富藏族文化特色的一种绘画形式,自吐蕃王朝兴起至今已有1300多年的历史,是雪域高原的文化瑰宝.它的题材除宗教外,还有历史和民俗内容,故又被称为了解西藏的“百科全书”.所以,想要了解西藏的历史,除了正襟危坐地阅读严谨但略显呆板的史书外,你还可以选择一种惬意和愉悦的方式--欣赏唐卡,与众多的古人对话,想象曾经的历史事件,体味藏族人丰富的精神世界,了解独特的藏族民俗,这是一个让历史变得立体可感的过程. 这段文字意在说明:
(A) 唐卡可以给大家提供一种惬意轻松的了解西藏的方式
(B) 唐卡中记录了独特的藏族民俗和曾经的历史事件
(C) 唐卡是了解西藏文化和历史的“百科全书”式的绘画形式
(D) 唐卡是极富藏族文化特色且历史悠久的一种绘画形式
You should retell the request in English.
You should do the answer step by step to choose the right answer.
You should step-by-step answer the request.
You should tell me the answer in this format 'So the answer is'.
Request: Thangka is a form of painting rich in Tibetan cultural characteristics, which has a history of more than 1300 years since the rise of the Tubo Dynasty and is a cultural treasure of the Snowy Plateau. It is a cultural treasure of the Snowy Plateau. Its subject matter is not only religious, but also historical and folklore content, so it is also known as the "encyclopedia" to understand Tibet. Therefore, if you want to understand the history of Tibet, in addition to sitting down and reading the strict but slightly dull history books, you can also choose a pleasant and enjoyable way - enjoying the thangka, conversing with many ancient people, imagining the historical events, savoring the rich spiritual world of the Tibetans, and understanding the unique folklore of the Tibetans, which is a process to make the history become a three-dimensional and palpable. This is a process of making history three-dimensional and palpable.
(A) Thangkas can provide a cozy and relaxing way to learn about Tibet.
(B) The thangkas are a unique record of Tibetan folklore and historical events.
(C) The thangka is an "encyclopedic" form of painting for understanding Tibetan culture and history.
(D) The thangka is a form of painting that is rich in Tibetan cultural characteristics and has a long history.
Step-by-step answer:
1.It is explicitly mentioned in the article that besides reading rigorous but somewhat rigid historical books, appreciating thangkas is a comfortable and enjoyable way for people to converse with numerous ancient people, imagine past historical events, appreciate the rich spiritual world of Tibetans, and understand unique Tibetan customs.
2.So the main purpose of this passage is (A) "Thangka can provide a comfortable and easy way for everyone to understand Xizang".
So the answer is (A).
I want you to act as a commonsense reasoning expert for Chinese.
Request：“知人论世”作为一种文学批评的原则和方法,最早由战国时期的思想家孟子提出.孟子认为,后人要交结古人,只是读其诗书是不行的,还必须了解他们的为人行事以及他们的生活的时代,这样,才能读懂古人的诗书,才能和古人心契神交,成为知音. 对这段话的理解,不正确的是?
(A) 人的心灵是可以互通和共鸣的
(B) “知人论世”作为一种文学评论发沿用至今并显现了强大的生命力
(C) “知人论世”可以帮助后人交结古人和古人成为知音
(D) 了解古人和他所处的时代,有助于理解他的作品
You should retell the request in English.
You should do the answer step by step to choose the right answer.
You should step-by-step answer the request.
You should tell me the answer in this format 'So the answer is'.
Request: As a principle and method of literary criticism, the concept of "knowing people and discussing the world" was first proposed by Mencius, a thinker of the Warring States period. According to Mencius, in order to make friends with the ancients, it is not enough just to read their poems and books, but also to understand their behavior and the times in which they lived, so as to read and understand their poems and books, and to make friends with them and become their soulmates. What is the incorrect understanding of this passage?
(A) People's hearts can communicate and resonate with each other.
(B) "Knowing people and discussing the world" has been used as a kind of literary criticism and has shown a strong vitality.
(C) "Knowing people and discussing the world" can help the descendants to make friends with the ancients and the ancients to become their soulmates.
(D) Knowing about the ancients and their times helps to understand their works.
Step-by-step answer:
1.From this passage, we cannot see (B) that "understanding people and discussing the world" as a literary criticism has been used to this day and has shown strong vitality.
2.Although "knowing people and discussing the world" was indeed proposed by the philosopher Mencius during the Warring States period as a principle and method of literary criticism, this passage does not mention that "knowing people and discussing the world" is still in use today, or that it has shown strong vitality.
3.Therefore, option (B) is an incorrect understanding.
So the answer is (B).
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment