New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Utf8 conversion #119

Merged

jqnatividad merged 1 commit into dathere:master from EricSoroos:utf8-conversion

Sep 26, 2023

Contributor

EricSoroos commented Aug 24, 2023

Install uchardet in the docker image
Convert use uchardet to detect non-utf8 csv files and convert to utf8 using iconv

cc @saj-derilinx who did this work.


Use uchardet/iconv to transcode CSV files to UTF-8

901bcda

jqnatividad merged commit 06f1f49 into dathere:master

2 checks passed

jqnatividad mentioned this pull request

Better processing of non UTF-8 files #118

Closed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment