Latest News
2018/03/05. Trial data has been released. [Download Now]
2018/02/06. CMRC 2018 official blog. [link]
2018/01/22. Pre-registration for participation. [Pre-registration]
Welcome!
Continued by the CMRC 2017 (The First Evaluation Workshop on Chinese Machine Reading Comprehension，CMRC2017), in this year, the Second Evaluation Workshop on Chinese Machine Reading Comprehension (CMRC 2018) will be held in Changsha on October 20-21, 2018.
In this year, we are focusing on the Span-Extraction Reading Comprension, which is similar to the SQuAD dataset.
We will release the first Chinese Span-Extraction Machine Reading Comprehension Dataset. The participants are required to set up a system that reads context, question and extract the answer from the context (the answer is a continuous span in the context). In order to preserve the integrity, we will not release the test set to the participants. The participants are required to submit their system to the Codalab platform and evaluate on the development set, and the officials will replace the development set to the hidden test set to produce the final result.
Prize
The winners will be awarded both bonus (provided by iFLYTEK) and certificates (provided by CIPS-CL).
 Gold Prize |
20,000 RMB + Certificates |
 Silver Prize |
￥10,000 RMB + Certificates |
 Bronze Prize |
5,000 RMB + Certificates |
| Best single system | 10,000 RMB + Certificates |
Important Dates
All the deadlines are Beijing Time (GMT+8) 23:59.
Keep up with the updates on the websites.
| Event | Status | Time |
| Pre-registration for Participation | >>Begin<< | Until April 22, 2018 |
| Registration Confirmation | Not yet | April 23, 2018 - April 27, 2018 |
| Training and Development Data Release | Not yet | May 7, 2018 |
| System Tuning | Not yet | May 7, 2018 - August 7, 2018 |
| Submission for Development Result | Not yet | June 7, 2018 - August 7, 2018 |
| Submission for Test Result | Not yet | August 13, 2018 - August 17, 2018 |
| Abstract of System Description | Not yet | Mid-September, 2018 |
| CMRC 2018 Evaluation Workshop | Not yet | TBD, October 20 or 21, 2018 |
Pre-registration for Evaluation Participation
If you are intertested in our evaluation, please pre-register through the following url: »Pre-registration«
以上链接仅限国外参赛队伍报名，国内参赛请使用如下链接：**»报名链接«**
Organization Committee
Host: Chinese Information Processing Society of China (CIPS)
Organizer: Joint Laboratory of HIT and iFLYTEK (HFL)
Sponsor: iFLYTEK Co., Ltd.
Evaluation Co-Chairs
Ting Liu, Harbin Institute of Technology
Yiming Cui, iFLYTEK Research
Contact Us
If you have any questions about CMRC 2018 Evaluation,
please feel free to contact us through mail: cmrc2018 [at] 126 [dot] com