Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Request to change arithmetical_puzzles prompting #1448

Open
ArcticBeat05 opened this issue Dec 24, 2023 · 0 comments
Open

Request to change arithmetical_puzzles prompting #1448

ArcticBeat05 opened this issue Dec 24, 2023 · 0 comments

Comments

@ArcticBeat05
Copy link

Describe the feature or improvement you're requesting

arithmetical_puzzles prompts does not allow proper reasoning The following is added at the end of every prompt..."Do not give any reasoning or logic for your answer."

In a previous PR, usama-openai requested to change the prompting of eval math_for_5th-grader to add better prompting to allow the LLM to reason.

#1293 (review)

Request to change the prompt for arithmetical_puzzles as well.

Additional context

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant