Latest News

2018/03/05. Trial data has been released. [Download Now]

2018/02/06. CMRC 2018 official blog. [link]

2018/01/22. Pre-registration for participation. [Pre-registration]



Continued by the CMRC 2017 (The First Evaluation Workshop on Chinese Machine Reading Comprehension,CMRC2017), in this year, the Second Evaluation Workshop on Chinese Machine Reading Comprehension (CMRC 2018) will be held in Changsha on October 20-21, 2018.

In this year, we are focusing on the Span-Extraction Reading Comprension, which is similar to the SQuAD dataset.

We will release the first Chinese Span-Extraction Machine Reading Comprehension Dataset. The participants are required to set up a system that reads context, question and extract the answer from the context (the answer is a continuous span in the context). In order to preserve the integrity, we will not release the test set to the participants. The participants are required to submit their system to the Codalab platform and evaluate on the development set, and the officials will replace the development set to the hidden test set to produce the final result.


The winners will be awarded both bonus (provided by iFLYTEK) and certificates (provided by CIPS-CL).

gold Gold Prize 20,000 RMB + Certificates
gold Silver Prize ¥10,000 RMB + Certificates
gold Bronze Prize 5,000 RMB + Certificates
Best single system 10,000 RMB + Certificates

Important Dates

All the deadlines are Beijing Time (GMT+8) 23:59.
Keep up with the updates on the websites.

Event Status Time
Pre-registration for Participation >>Begin<< Until April 22, 2018
Trial Data Release Ended March 5, 2018
Registration Confirmation Not yet April 23, 2018 - April 27, 2018
Training and Development Data Release Not yet May 7, 2018
System Tuning Not yet May 7, 2018 - August 7, 2018
Submission for Development Result Not yet June 7, 2018 - August 7, 2018
Submission for Test Result Not yet August 13, 2018 - August 17, 2018
Abstract of System Description Not yet Mid-September, 2018
CMRC 2018 Evaluation Workshop Not yet TBD, October 20 or 21, 2018

Pre-registration for Evaluation Participation

If you are intertested in our evaluation, please pre-register through the following url: »Pre-registration«


Organization Committee

Host: Chinese Information Processing Society of China (CIPS)
Organizer: Joint Laboratory of HIT and iFLYTEK (HFL)
Sponsor: iFLYTEK Co., Ltd.

Evaluation Co-Chairs

Ting Liu, Harbin Institute of Technology
Yiming Cui, iFLYTEK Research

Contact Us

If you have any questions about CMRC 2018 Evaluation,
please feel free to contact us through mail: cmrc2018 [at] 126 [dot] com