Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Detect CSV dialect correctly #4

Open
JoaoVitorStein opened this issue Dec 2, 2020 · 0 comments
Open

Detect CSV dialect correctly #4

JoaoVitorStein opened this issue Dec 2, 2020 · 0 comments
Assignees
@ecanuto @JoaoVitorStein

Comments

@JoaoVitorStein
Copy link
Contributor

We use Python's CSV Sniffer to detect the dialect from a CSV. For some reason, this Sniffer is not being able to detect the dialect from files that are upload to S3 and contains whitespaces in the end. If you try the same file locally, it works fine. Since we use smart-open to read files from S3, this problem could be related to a behavior from this library.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ecanuto ecanuto

@JoaoVitorStein JoaoVitorStein

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@ecanuto @JoaoVitorStein