Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement the QA4MRE evaluation #113

Closed
leogao2 opened this issue Feb 3, 2021 · 0 comments
Closed

Implement the QA4MRE evaluation #113

leogao2 opened this issue Feb 3, 2021 · 0 comments
Assignees

Comments

@leogao2
Copy link
Contributor

leogao2 commented Feb 3, 2021

QA4MRE dataset was created for the CLEF 2011/2012/2013 shared tasks to promote research in question answering and reading comprehension. The dataset contains a supporting passage and a set of questions corresponding to the passage. Multiple options for answers are provided for each question, of which only one is correct. The training and test datasets are available for the main track. Additional gold standard documents are available for two pilot studies: one on alzheimers data, and the other on entrance exams data.

https://www.tensorflow.org/datasets/catalog/qa4mre

@leogao2 leogao2 added this to To do, Evaluations to Implement in Implementing Evaluations via automation Feb 3, 2021
@leogao2 leogao2 moved this from To do, Evaluations to Implement to In Progress in Implementing Evaluations Feb 8, 2021
@leogao2 leogao2 assigned anishthite and jeffhsu3 and unassigned anishthite Feb 8, 2021
@jeffhsu3 jeffhsu3 mentioned this issue Feb 10, 2021
@leogao2 leogao2 closed this as completed Feb 12, 2021
Implementing Evaluations automation moved this from In Progress to Done, evaluations Feb 12, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
No open projects
Implementing Evaluations
  
Done, evaluations
Development

No branches or pull requests

3 participants