Yosuke Toda (tyosuke-at-aquaseerser.com)

JST PRESTO researcher at Nagoya Univeristy / Agri-Heir Co., Ltd.

• Tutorials for deep learning based analysis (mainly) on biological relavent themes. Should give you a better implementation of DL much more than general tutorial tasks like MNIST and CIFAR-10.
• Google Colaboratory based notebooks. All you need is an internet connection, google chrome browser, and google account. GPU learning environment at a click!
• To open the notebook, click the in each section. Logging into Google Account and copying the ipynb to your local google doc folder is preferred for code customization and saving.

• Mathmatical calculations and/or theoretical backgrounds will not be thoroughly explained in this tutorial. The object of this notebook is to get a overview of how we can perform DL in the field of biology (especially in plant science and agriculture) for non informatitians.
• Keras with Tensorflow background is the main DL framework used in the notebook. I do not intend to mix different frameworks for clarity in the current situation.
• Feedbacks and requests, complements including typos and misusage of codes in the notebooks are highly welcomed in the issues of github repo or at twitter (@totti0223).
• A lot of stuff in this notebook is still in alpha ver. (code readability, comments). But to gain early feedbacks, opening them cowardly.

• Add more examples (described in the "Notebooks to be opened" section)

Basic code collection of Keras. Loading images, build, train, evaluate and using the CNN. As Keras is quite flexible and have multiple ways of writing code even for a simplest CNN, I have written down all the patterns in one Colab notebook. Images of rice seeds were provided from Dr. S. Nishiuchi at Nagoya Univ. in 2016 (personal communication). However, the data itself is not going to be discussed. Preferred to go through the notebook of Rice Seed Integrity below.

Finalize with feedbacks

An introductory notebook to deep learning based image analysis as well as comparing it with classical machine learning algorithms and manual image classification. The object of this notebook is to give the readers an implementation of; What does "Representative Learning" actually mean? What is Feature Selection? Images of rice seeds were provided from Dr. S. Nishiuchi at Nagoya Univ. in 2016 (personal communication).

Refurnish Codes and Comments

Will build a convolutional neural network (CNN) based classification model using a 17 category flower dataset provided by the team at University of Oxford (https://www.robots.ox.ac.uk/~vgg/data/flowers/17/). The dataset provides of 80 images per category. We will compare the training process starting from scratch (de novo), transfer-learning and fine-tuning which the later two are pretrained with ImageNet Dataset. We will see that upon training with not so much data (for CNN), pretraining has a great effect upon speed and (ocasionally) accuracy of the model.

Refurnish Codes and Comments

In this notebook, we will perform a segmentation of crop and weed region from images taken by an autonomous field robot, which the dataset are from Haug et al., "A Crop/Weed Field Image Dataset for the Evaluation of Computer Vision Based Precision Agriculture Tasks" (2015). With conventional approaches, we possibly can isolate the weed and crop resions from the soil area using a color threshold in the green domain. However, how can we further classify the weed (red) from the crop (green) region? Such feature selection is a master of a master craftsmanship. Instead, we will use DL, in specific, semantic segmentation methods to 1) Isolate the grass regions from the soil, 2) Isolating and classifying weeds and crops regions. A neural network architecture named U-Net will be used here.

Need to add commentary throughout the notebook.

Original paper from Watanabe et al., "Using deep learning for bamboo forest detection from Google Earth images" doi: https://doi.org/10.1101/351643.

The data was provided by Dr. Ise (personal communcation). However the image originates from Google Earth, so please confirm the copyright if you intend to use this in non research purpose.

Need to add commentary throughout the notebook and above.

Yet another classification task. Dataset from the paper Accurate Classification of Protein Subcellular Localization from High-Throughput Microscopy Images Using Deep Learning Tanel Pärnamaa and Leopold Parts G3: GENES, GENOMES, GENETICS May 1, 2017 vol. 7 no. 5 1385-1392. This dataset has a csv file with file name information associated with class label instead of allocating the file to folders corresponding to its class. Moreover, dataset comprises of 90,000 images, possibly too large to load everything in label. Here we use the ImageDataGenerator class and its flow_from_dataframe function to feed batches of image upon training. Note: flow_from_dataframe in keras repository has a bug. we instead install keras_preprocessing and use the uptodate ImageDataGenerator (19, Jan. 2019 ).

Need to add commentary throughout the notebook.

Need to add commentary throughout the notebook.

• Will have a major update including code sanitizing, reviewing, new sections etc.

• Crop disease diagnosis interpretability (currently under revision in peer reviewed journal)

• Arabidopsis Leaf Counting

• Stomatal Aperture Quantification pipeline

• GAN of somekind

• Pix2pix for microscope image alternation