Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Data formatting step outputs incorrectly keys for JSONL #567

Open
ridoy opened this issue Apr 3, 2023 · 0 comments
Open

Data formatting step outputs incorrectly keys for JSONL #567

ridoy opened this issue Apr 3, 2023 · 0 comments

Comments

@ridoy
Copy link

ridoy commented Apr 3, 2023

https://github.com/openai/evals/blob/main/docs/build-eval.md

Reproduction steps:
Have a csv with prompt and completion columns
Run openai tools fine_tunes.prepare_data -f data.csv
Inspect output JSONL file and verify entries have prompt and completion keys but not the required input key

It may very well be that the csv column names should be different, but prepare_data complains about the input not having prompt and completion columns. It would be helpful if the docs explained what columns are required.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant