videos of LLaVA-NeXT-interleave

[farewellthree]

Hello, could you tell me which video datasets LLaVA-NeXT-interleave uses? It’s hard to determine where the videos come from just by the annotations; I can only recognize ActivityNet.

[ZrrSkywalker]

Thanks for your interest. In the M4-Instruct training data, we use the 300K videos from LLaVA-Hound. Pleases download this dataset and utilize our json for training.