Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Store stats as a system metadata file #898

Closed
jqnatividad opened this issue Apr 2, 2023 · 2 comments
Closed

Store stats as a system metadata file #898

jqnatividad opened this issue Apr 2, 2023 · 2 comments
Labels
enhancement New feature or request

Comments

@jqnatividad
Copy link
Owner

stats should produce a system metadata file, similar to how index creates an index file.

The stats metadata file will be stored in <FILENAME>.csv.stats similar to how index creates an index file at <FILENAME>.csv.idx.

When another command requires summary stats (schema, tojsonl, the WIP describegpt, etc.), it will check if the stats file exists and use that instead of compiling the stats anew.

@jqnatividad jqnatividad added the enhancement New feature or request label Apr 2, 2023
@jqnatividad
Copy link
Owner Author

make it <FILENAME>.stats.csv so opening it with Excel and other tools will be easier as it will just be recognized as csv.

@jqnatividad
Copy link
Owner Author

Done with #902

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant