Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tutorial2- Finetuning on exported feedback data - Exception: Input does not have the expected format #238

Closed
laifuchicago opened this issue Jul 16, 2020 · 2 comments
Assignees
Labels
type:bug Something isn't working

Comments

@laifuchicago
Copy link

laifuchicago commented Jul 16, 2020

To Author:
I tried your Tutorial2 and get some problems--Exception: Input does not have the expected format. I used your Feedback function, and currently have no idea. I guess the original squad format has "Title". Just like this:

"title" : "xxx",
"paragraphs" : [
{
"context" : "xxx",
"qas" : [
{
"question" : "xxxx",
"id" : "xxxx",
"answers" : [
{
"answer_start" : xxx,
"text" : "xxxx"
}
]
},
But your export feedback does not have. That might be the reason? Do you have any suggestions? Thank you.
4
5

Jonathan Sung

@tholor
Copy link
Member

tholor commented Jul 16, 2020

Hi @laifuchicago ,

Thanks for reporting this. The exported format did in fact not comply with SQuAD and caused trouble when training with FARM.
Fixed it in #241 .

Please also note:
The context currently contains all text of the indexed document. If you indexed short documents / passages, it will just work fine. However, if you index very long texts, you will have very long texts in the SQuAD "context", which will result in many negative training samples (passages with no annotated answer) and can impact training performance. We will address this in a future PR.

@tholor tholor changed the title Tutorial2--Exception: Input does not have the expected format Tutorial2- Finetuning on exported feedback data - Exception: Input does not have the expected format Jul 16, 2020
@laifuchicago
Copy link
Author

laifuchicago commented Jul 17, 2020

To Author:
Thank you, it can work now!
Jonathan Sung

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type:bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants