NISNet3D: Three-Dimensional Nuclear Synthesis and Instance Segmentation for Fluorescence Microscopy Images

Abstract

Abstract The primary step in tissue cytometry is the automated distinction of individual cells (segmentation). Since cell borders are seldom labeled, researchers generally segment cells by their nuclei. While effective tools have been developed for segmenting nuclei in two dimensions, segmentation of nuclei in three-dimensional volumes remains a challenging task for which few tools have been developed. The lack of effective methods for three-dimensional segmentation represents a bottleneck in the realization of the potential of tissue cytometry, particularly as methods of tissue clearing present researchers with the opportunity to characterize entire organs. Methods based upon deep-learning have shown enormous promise, but their implementation is hampered by the need for large amounts of manually annotated training data. In this paper we describe 3D Nuclei Instance Segmentation Network (NISNet3D), a deep learning-based approach in which training is accomplished using synthetic data, profoundly reducing the effort required for network training. We compare results obtained from NISNet3D with results obtained from eight existing techniques.