-
Notifications
You must be signed in to change notification settings - Fork 708
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Implement high-level Parquet writer #35
Labels
parquet
Changes to the parquet crate
Comments
Comment from Andy Grove(andygrove) @ 2019-10-10T13:45:56.175+0000: [~csun] Are you still planning on working on this? Comment from Andy Grove(andygrove) @ 2019-10-10T13:51:15.064+0000: [~liurenjie1024] You might be interested in working on this as well? Comment from Renjie Liu(liurenjie1024) @ 2019-10-11T06:32:27.110+0000: [~andygrove] Yes it looks interesting to me. I'll take this if [~csun] is not available. |
I think the arrow writer (that writes parquet files from arrow arrays) is a pretty good high level parquet writer |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Note: migrated from original JIRA: https://issues.apache.org/jira/browse/ARROW-4392
We only have low-level parquet writer at the moment, which requires user to specify values, definition levels, repetition levels, etc. This is inconvenient. Instead, we should offer high-level Parquet writer that hide these details.
The text was updated successfully, but these errors were encountered: