Add support for DinoV2

[masc-it]

Hi, I think this is a good place to share the DinoV2 by FAIR (github link here.

I think it's a really interesting SSL method, based on ViT backbones. The code is well structured, with the interesting parts in: models, loss, layers and train.py

Would you consider supporting it?

[guarin]

Hi @masc-it, DinoV2 looks very interesting and could be a great addition to our package. I didn't have time to look into the details of the paper yet so not sure how much effort it is.

Would you be interested to help implementing it?

[adamjstewart]

I'm planning on looking into this. Depending on how much work is involved, I may be interested in working on this.

[johko]

I'd be interested in helping out if you need a hand @adamjstewart :)

[ioangatop]

Hi everyone! I see DinoV2 is in the roadmap; is there any updates? Thanks a lot!

[adamjstewart]

P.S. I never looked into this. It's up for grabs if @johko or anyone else wants to take over

[guarin]

Hi, we are still interested in adding it but didn't have time yet to work on it.

[johko]

@guarin I'll have a look at adding it