Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add CL args to control file system dir naming #27

Open
HenryYihengXu opened this issue Jul 9, 2020 · 5 comments
Open

Add CL args to control file system dir naming #27

HenryYihengXu opened this issue Jul 9, 2020 · 5 comments

Comments

@HenryYihengXu
Copy link

Macsio generates a large number of log files. Is it possible to redirect those files to another directory in the command line?

login-1:macsio_darshan$ ls
darshan_runtime_logs	    macsio_silo_00002_005.silo	macsio_silo_00005_004.silo
macsio			    macsio_silo_00002_006.silo	macsio_silo_00005_005.silo
macsio-log.log		    macsio_silo_00002_007.silo	macsio_silo_00005_006.silo
macsio-timings.log	    macsio_silo_00002_008.silo	macsio_silo_00005_007.silo
macsio_silo_00000_000.silo  macsio_silo_00002_009.silo	macsio_silo_00005_008.silo
macsio_silo_00000_001.silo  macsio_silo_00003_000.silo	macsio_silo_00005_009.silo
macsio_silo_00000_002.silo  macsio_silo_00003_001.silo	macsio_silo_00006_000.silo
macsio_silo_00000_003.silo  macsio_silo_00003_002.silo	macsio_silo_00006_001.silo
macsio_silo_00000_004.silo  macsio_silo_00003_003.silo	macsio_silo_00006_002.silo
macsio_silo_00000_005.silo  macsio_silo_00003_004.silo	macsio_silo_00006_003.silo
macsio_silo_00000_006.silo  macsio_silo_00003_005.silo	macsio_silo_00006_004.silo
macsio_silo_00000_007.silo  macsio_silo_00003_006.silo	macsio_silo_00006_005.silo
macsio_silo_00000_008.silo  macsio_silo_00003_007.silo	macsio_silo_00006_006.silo
macsio_silo_00000_009.silo  macsio_silo_00003_008.silo	macsio_silo_00006_007.silo
macsio_silo_00001_000.silo  macsio_silo_00003_009.silo	macsio_silo_00006_008.silo
macsio_silo_00001_001.silo  macsio_silo_00004_000.silo	macsio_silo_00006_009.silo
@markcmiller86
Copy link
Member

Hmm....it is designed to be very frugal w.r.t. to log files and I see only two from macsio itself there macsio-log.log and macsio-timings.log. All the other .silo files are data files probably run in file-per-processor mode. Changing command-line arguments regarding -parallel_file_mode MIF affects this. Or, for those plugins that support single-shared-file like HDF5 plugin, using -parallel_file_mode SIF.

Am I miss-understanding your question?

@HenryYihengXu
Copy link
Author

Sorry for the unclear part. What I wanted to say are those .silo files. By command-line arguments, is there a way to put them into another directory instead of the current directory? They make the current directory kinda messy

@markcmiller86 markcmiller86 changed the title Specify macsio-logs directory Add CL args to control file system dir naming Jul 10, 2020
@markcmiller86
Copy link
Member

Ok, yeah, I get you. Currently, we don't support that. We should probably operate that way by default and maybe provide a CL arg. to override it.

@markcmiller86
Copy link
Member

I've modified the issue heading to reflect the desired enhancement.

@HenryYihengXu
Copy link
Author

Hi just want to check how's this issue going now. I want to run Macsio with Burst Buffers on Summit. I can write or read files in the burst buffer directory, but I cannot directly cd into the burst buffer directory. Therefore, if I want macsio to do I/O in that directory, I need to pass the directory to Macsio.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants