-
Notifications
You must be signed in to change notification settings - Fork 1.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Mavic 3M multispectral alignment issues #1768
Comments
That's seems to be related to differences is the RGB vs multispectral lenses? There no RGB being used in my case, just the multispectral bands. |
Thanks for opening the issue.
The problem is sufficiently related to be considered the same: either we choose a multispectral band to align to, as per @MarioTro's example here: https://gitlab.com/Yario/image_registration_dji_mavic_3m/-/blob/main/coregistration_mavic_3m_images_with_CV2.py?ref_type=heads or we align to the RGB per @lewispb's example here: https://gist.github.com/lewispb/6c7dd6022ba3266cfd4f1310d4d51f5f In the second scenario, the exif data for that alignment is extant in the multispectral bands, so it wouldn't require RGB upload with the MS bands, so it should be independent of how exactly the data are processed. |
This should be fixed with #1771 The problem was multifaceted:
Both should be addressed but some testing will be needed. |
Excellent. Happy to help test. |
looks much better with now with the new code. although still a slight offset with redband compared to G,NIR and Red edge which all line up. |
@ehallein could you post your task processing log? |
@pierotofy |
Thanks! I don't think it might matters in this case, but always re-run from the dataset stage between version updates. Mm, not sure why the red band ended up off. A link to the dataset (or better, a smaller subset) would help (the link on google no longer works?). |
here are TIFFs https://drive.google.com/file/d/1OEulM3PKqwOrRDX9oCg54osxpzyJNoTg/view?usp=sharing |
Definitely seeing some minor misalignment issues. https://crankyserver.com/map/project/350/task/ff48c492-0e67-4613-bc31-03b2367e8aa6/ |
They may have all the internal docs and specs, but we have a Piero 🤣 |
🤣 Indeed. It seems there's value to calculating homography even if you have specs from the factory. |
Can this be closed? |
Yes seems to be well aligned on my tests |
How did you install ODM? (Docker, installer, natively, ...)?
Docker
What is the problem?
Multispectral bands are not aligned in orthophoto
![image](https://private-user-images.githubusercontent.com/32348557/344089313-baba4a4d-9a0c-4701-bba4-6e73f7306d5f.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQ0MjIxNTgsIm5iZiI6MTcyNDQyMTg1OCwicGF0aCI6Ii8zMjM0ODU1Ny8zNDQwODkzMTMtYmFiYTRhNGQtOWEwYy00NzAxLWJiYTQtNmU3M2Y3MzA2ZDVmLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MjMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODIzVDE0MDQxOFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTUyNDZhYjNiN2VkYmU3ZDExNzZkYzBlNTJmYTU0ODgxMzg1MzkwMjQ0MTI4ZWIwMTlmODM3ZmU5NzBmODI4MDQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.OhJWfNJa4W964ijq_k7jNFqDwzwF-PV9DMVgNACN9Kc)
What should be the expected behavior? If this is a feature request, please describe in detail the changes you think should be made to the code, citing files and lines where changes should be made, if possible.
aligned bands
How can we reproduce this? What steps did you do to trigger the problem? If this is an issue with processing a dataset, YOU MUST include a copy of your dataset AND task output log, uploaded on Google Drive or Dropbox (otherwise we cannot reproduce this).
console.txt
output and images https://drive.google.com/file/d/1p2bUUqzd-TxL-kPQttbjuv-PtB49WtzS/view?usp=sharing
create project in webODM (using nvidia GPU) and run using multispectral option on TIFFs
possibly related to https://www.reddit.com/r/UAVmapping/comments/1cacp09/processing_multispectral_dji_mavic_3m_data_with/
"First, locate the fields 'Relative Optical Center X' and 'Relative Optical Center Y' in the EXIF information of each band's photograph. These values represent the positional offset of each camera band relative to the NIR band camera (in pixels). By setting the compensation values (offset) for each band's photograph (excluding the NIR band) in software like ENVI, you can correctly combine the images. The specific method for setting the compensation values for each band will need to be referenced from the manual of ENVI or similar software."
The text was updated successfully, but these errors were encountered: