Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parquet: Make MetadataLoader public #5137

Merged
merged 2 commits into from
Nov 28, 2023

Conversation

AdamGS
Copy link
Contributor

@AdamGS AdamGS commented Nov 28, 2023

Which issue does this PR close?

Closes #5129.

Rationale for this change

What changes are included in this PR?

Are there any user-facing changes?

Making the MetadataFetch trait and the MetadataLoader struct public APIs.

@github-actions github-actions bot added the parquet Changes to the parquet crate label Nov 28, 2023
@@ -198,7 +196,8 @@ impl<F: MetadataFetch> MetadataLoader<F> {
}
}

struct MetadataFetchFn<F>(F);
/// Helper struct to wrap async fetch functions so they can be used with [`MetadataLoader`] through [`MetadataFetch`]
pub struct MetadataFetchFn<F>(F);
Copy link
Contributor Author

@AdamGS AdamGS Nov 28, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is jus a useful utility for users, but it might not be desirable to make it part of the crate's public facing API.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think lets keep it private for now

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure thing

@AdamGS AdamGS changed the title Make MetadataLoader public Parquet: Make MetadataLoader public Nov 28, 2023
@tustvold tustvold merged commit 093a10e into apache:master Nov 28, 2023
16 checks passed
@AdamGS AdamGS deleted the make-metadata-loader-public branch November 28, 2023 19:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
parquet Changes to the parquet crate
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Parquet: read parquet metadata with page index in async and with size hints
2 participants