Skip to content
This repository has been archived by the owner on Jul 29, 2023. It is now read-only.

merge data command #119

Closed
pranathivemuri opened this issue Nov 6, 2019 · 2 comments
Closed

merge data command #119

pranathivemuri opened this issue Nov 6, 2019 · 2 comments
Milestone

Comments

@pranathivemuri
Copy link
Contributor

Documenting discussion with @smguo Basically one might have training data across different folders from different datasets. microdl must have a way to copy and merge all the 3 frames_meta.csv files for the 3 datasets and form one folder with one dataset for training and one csv file.

@smguo
Copy link
Collaborator

smguo commented Nov 6, 2019

Thanks @pranathivemuri for opening the issue! I've implemented a simple script where the users can specify in the config what datasets to merge, the script will then copy the datasets to the new location and merge the individual frames_meta.csv (or generate it if it doesn't exist). It will come in my next PR. Let me know if you have any suggestion for the implementation

@smguo smguo mentioned this issue Mar 5, 2020
@mattersoflight mattersoflight added this to the microDL 2.0.0 milestone Sep 10, 2022
@ziw-liu
Copy link
Contributor

ziw-liu commented Jul 13, 2023

Implemented as czbiohub-sf/iohub#154

@ziw-liu ziw-liu closed this as completed Jul 13, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants