Abstract

This manuscript evaluates the usage of fused cross-spectral images in a monocular visual odometry approach. Fused images are obtained through a Discrete Wavelet Transform (DWT) scheme, where the best setup is empirically obtained by means of a mutual information based evaluation metric. The objective is to have a flexible scheme where fusion parameters are adapted according to the characteristics of the given images. Visual odometry is computed from the fused monocular images using an off the shelf approach. Experimental results using data sets obtained with two different platforms are presented. Additionally, comparison with a previous approach as well as with monocular visible/infrared spectra are also provided showing the advantages of the proposed scheme.

Dataset

We provide the rectified images and GPS data from the three video sequences used in the article.

Bibtex

@article{Sappa201626,
title = "Monocular visual odometry: A cross-spectral image fusion based approach ",
journal = "Robotics and Autonomous Systems ",
volume = "85",
number = "",
pages = "26 - 36",
year = "2016",
note = "",
issn = "0921-8890",
doi = "http://dx.doi.org/10.1016/j.robot.2016.08.005",
url = "http://www.sciencedirect.com/science/article/pii/S0921889016301002",
author = "Angel D. Sappa and Cristhian A. Aguilera and Juan A. Carvajal Ayala and Miguel Oliveira and Dennis Romero and Boris X. Vintimilla and Ricardo Toledo",
keywords = "Monocular visual odometry",
keywords = "LWIR-RGB cross-spectral imaging",
keywords = "Image fusion "
}