-
-
Notifications
You must be signed in to change notification settings - Fork 64
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Memory Limit #23
Comments
There is no set memory limit. So there is likely some error and then the processing fails. Can you include the output of the browser debug console? An alternative is to use the TorchXRayVision library to process the images in python. The model named "all" is the same as what is used in Chester (just a slight difference in calibration) https://github.com/mlmed/torchxrayvision |
I am using the windows application. If I add studies one by one, once I hit around ~15MB worth of images, I get the following error:index.htm?local=true:306 Status: Error! Failed to compile fragment shader. Before reaching ~15MB, the console shows this warning:High memory usage in GPU: 1307.86 MB, most likely due to a memory leak |
Interesting. Does it work if you run it in the web browser? Potentially the packaged webbrowser for the offline version is out of date to support the GPU you have. |
I want to avoid the browser version if possible because the names of the files have sensitive information and coming up with a code and changing all the names could be a bit of hassle. I downloaded TorchXRayVision library, but a little lost on which of the python files I should use. |
The web version does not send any data. It is all processed locally. You can use this script: https://github.com/mlmed/torchxrayvision/blob/master/scripts/process_image.py It should work like this:
I can write a version of that utility that will process an entire folder and output a csv file if that would work for you better? |
Yes, that would certainly be helpful! Thank you! |
Give this script a try: https://github.com/mlmed/torchxrayvision/blob/master/scripts/process_batch.py |
Strange. Try updating torch with Maybe that issue has to do with using the cpu so you can try to run the script with -cuda to use the GPU if that machine has one. |
I got it to work! It didn't like that I had some packages installed twice essentially (prior to importing this project and then as part of the project/package). I got an impatient and instead of figuring out which ones it did not like, I just uninstalled all the packages I had and started fresh haha. You mentioned that there were some calibration differences between this code and the algorithm behind Chester. Could you please outline the key differences so that we are aware? Thanks so much for all your help! |
There is some scaling done on the predictions >0.5 to make the interface more usable: https://github.com/mlmed/chester-xray/blob/master/res/js/system.js#L639 specified but the scaling factor here: https://github.com/mlmed/chester-xray/blob/master/models/xrv-all-45rot15trans15scale/config.json#L25 So the output from the model using the command line does not include this scaling. Just in case you see different numbers. The performance is not impacted because the AUC scores remain the same. |
Hello,
We are trying to analyze a large number of images and were wondering if it is at all possible to increase the program's memory limit. It currently seems to only be able to handle ~15 MB worth of images. After that, all images are imported entirely black with predictions at 0% for all pathologies.
Thank you!
The text was updated successfully, but these errors were encountered: