Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add TheoremQA #518

Open
StellaAthena opened this issue May 23, 2023 · 3 comments
Open

Add TheoremQA #518

StellaAthena opened this issue May 23, 2023 · 3 comments
Assignees
@ShayekhBinIslam
Labels
feature request A feature that isn't implemented yet. good first issue Good for newcomers help wanted Contributors and extra help welcome.

Comments

@StellaAthena
Copy link
Member

This is awesome work and we should include it. It may be a bit tricky as it involves external calls to the WolframAlpha API for answer evaluation though.

https://github.com/wenhuchen/TheoremQA
@StellaAthena StellaAthena added the feature request A feature that isn't implemented yet. label May 28, 2023
@rishabbala
Copy link

Hey @StellaAthena wondering if this issue is still open/required. If so I can take it on. Could you give me a brief overview of what has to be done

@lintangsutawika lintangsutawika added help wanted Contributors and extra help welcome. good first issue Good for newcomers labels Dec 14, 2023
@ShayekhBinIslam
Copy link

@lintangsutawika I am interested in contributing here.

@lintangsutawika
Copy link
Contributor

That's awesome! Feel free to start a PR anytime.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ShayekhBinIslam ShayekhBinIslam

Labels
feature request A feature that isn't implemented yet. good first issue Good for newcomers help wanted Contributors and extra help welcome.
Projects
LM-Eval Support and Development
Status: Ready
Milestone
No milestone
Development

No branches or pull requests
4 participants
@lintangsutawika @StellaAthena @ShayekhBinIslam @rishabbala