Implement the BioREAD evaluation

[leogao2]

We present BioRead, a new publicly available cloze-style biomedical machine reading comprehension (MRC) dataset with approximately 16.4 million passage-question instances. BioRead was constructed in the same way as the widely used Children’s Book Test and
its extension BookTest, but using biomedical journal articles and employing MetaMap to identify UMLS concepts. BioRead is one of
the largest MRC datasets, and currently the largest one in the biomedical domain. We also provide a subset of BioRead, BioReadLite,
for research groups with fewer computational resources. We re-implemented and tested on BioReadLite two well-known MRC methods,
AS Reader and AOA Reader, along with four baselines, as a first step towards a BioRead (and BioReadLite) leaderboard. AOA Reader
is currently the best method on BioReadLite, with 51.19% test accuracy. Both AOA Reader and AS Reader outperform the baselines by
a wide margin on the test subset of BioReadLite. Our re-implementations of the two MRC methods are also publicly available.

https://www.aclweb.org/anthology/L18-1439/