Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extracting and analyzing data from scientific articles #1126

Open
QuantumCoderr opened this issue Jun 8, 2023 · 0 comments
Open

Extracting and analyzing data from scientific articles #1126

QuantumCoderr opened this issue Jun 8, 2023 · 0 comments

Comments

@QuantumCoderr
Copy link

Describe the feature or improvement you're requesting

It will be possible to create a benchmark that will evaluate the ability of the model to extract key information from abstracts of scientific articles. For example, information such as:

  1. Object of study (what was studied in the article)
  2. Methodology (what methods were used to conduct the study)
  3. Results (what were the main results of the study)
  4. Conclusions (what conclusions were drawn by the authors based on the results)

Abstracts from real scientific articles can be used as input, and pre-prepared answers that accurately represent the information to be extracted can be used as the ideal answer. This will allow you to assess how well the model is able to understand and analyze scientific texts.

Additional context

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant