Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Whitespace removal during preprocessing #581

Closed
Timoeller opened this issue Nov 13, 2020 · 0 comments · Fixed by #582
Closed

Whitespace removal during preprocessing #581

Timoeller opened this issue Nov 13, 2020 · 0 comments · Fixed by #582
Assignees
@Timoeller
Labels
type:bug Something isn't working

Comments

@Timoeller
Copy link
Contributor

When splitting documents into passages based on wordcount and respecting sentence boundary we are missing a whitespace between sentences.
@Timoeller Timoeller added the type:bug Something isn't working label Nov 13, 2020
@Timoeller Timoeller self-assigned this Nov 13, 2020
@Timoeller Timoeller mentioned this issue Nov 13, 2020
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Timoeller Timoeller

Labels
type:bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add needed whitespace before sentence start deepset-ai/haystack
1 participant
@Timoeller