XuvTools: free, fast and reliable stitching of large 3D datasets
- 15 January 2009
- journal article
- research article
- Published by Wiley in Journal of Microscopy
- Vol. 233 (1), 42-60
- https://doi.org/10.1111/j.1365-2818.2008.03094.x
Abstract
Current biomedical research increasingly requires imaging large and thick 3D structures at high resolution. Prominent examples are the tracking of fine filaments over long distances in brain slices, or the localization of gene expression or cell migration in whole animals like Caenorhabditis elegans or zebrafish. To obtain both high resolution and a large field of view (FOV), a combination of multiple recordings ('tiles') is one of the options. Although hardware solutions exist for fast and reproducible acquisition of multiple 3D tiles, generic software solutions are missing to assemble ('stitch') these tiles quickly and accurately. In this paper, we present a framework that achieves fully automated recombination of tiles recorded at arbitrary positions in 3D space, as long as some small overlap between tiles is provided. A fully automated 3D correlation between all tiles is achieved such that no manual interaction or prior knowledge about tile positions is needed. We use (1) phase-only correlation in a multi-scale approach to estimate the coarse positions, (2) normalized cross-correlation of small patches extracted at salient points to obtain the precise matches, (3) find the globally optimal placement for all tiles by a singular value decomposition and (4) accomplish a nearly seamless stitching by a bleaching correction at the tile borders. If the dataset contains multiple channels, all channels are used to obtain the best matches between tiles. For speedup we employ a heuristic method to prune unneeded correlations, and compute all correlations via the fast Fourier transform (FFT), thereby achieving very good runtime performance. We demonstrate the successful application of the proposed framework to a wide range of different datasets from whole zebrafish embryos and C. elegans, mouse and rat brain slices and fine plant hairs (trichome). Further, we compare our stitching results to those of other commercially and freely available software solutions. The algorithms presented are being made available freely as an open source toolset 'XuvTools' at the corresponding author's website (http://lmb.informatik.uni-freiburg.de/people/ronneber), licensed under the GNU General Public License (GPL) v2. Binaries are provided for Linux and Microsoft Windows. The toolset is written in templated C++, such that it can operate on datasets with any bit-depth. Due to the consequent use of 64bit addressing, stacks of arbitrary size (i.e. larger than 4 GB) can be stitched. The runtime on a standard desktop computer is in the range of a few minutes. A user friendly interface for advanced manual interaction and visualization is also available.Keywords
This publication has 14 references indexed in Scilit:
- Mosaicing of microscope images with global geometric and radiometric correctionsJournal of Microscopy, 2006
- Automated microscopy system for mosaic acquisition and processingJournal of Microscopy, 2006
- Application of Phase Correlation to the Montage Synthesis and Three-Dimensional Reconstruction of Large Tissue Volumes from Confocal Laser Scanning MicroscopyMicroscopy and Microanalysis, 2006
- Three-dimensional volume reconstruction of extracellular matrix proteins in uveal melanoma from fluorescent confocal laser scanning microscope imagesJournal of Microscopy, 2006
- Three-dimensional computer reconstruction of large tissue volumes based on composing series of high-resolution confocal images by GlueMRC and LinkMRC softwareMicroscopy Research and Technique, 2003
- Algorithms for accurate 3D registration of neuronal images acquired by confocal scanning laser microscopyJournal of Microscopy, 2003
- A feature-based, robust, hierarchical algorithm for registering pairs of images of the curved human retinaIeee Transactions On Pattern Analysis and Machine Intelligence, 2002
- Alignment of adjacent picture frames captured by a CLSMIEEE Transactions on Information Technology in Biomedicine, 1999
- Automated 3-D montage synthesis from laser-scanning confocal images: Application to quantitative tissue-level cytological analysisCytometry, 1996
- Random sample consensusCommunications of the ACM, 1981