Publication detail

Multispectral Texture Mapping for Telepresence and Autonomous Mobile Robotics

KOCMANOVÁ, P. BURIAN, F. ŽALUD, L.

Original Title

Multispectral Texture Mapping for Telepresence and Autonomous Mobile Robotics

English Title

Multispectral Texture Mapping for Telepresence and Autonomous Mobile Robotics

Type

conference paper

Language

en

Original Abstract

The aim of this paper is to describe the data-fusion acquired from a CCD camera and a thermal imager. The fusion is realized by means of spatial data from a TOF camera to ensure ”natural” representation of a robot’s environment; thus, the thermal and CCD camera data are comprised in one stereo image presented to a binocular, head-mounted display. The data acquisition is performed using a sensor head, which is placed on an Orpheus-X3 robot; both the head and the robot were developed by our working group. The head contains five matrix sensors: a pair of CCD cameras, a pair of thermal imagers, and one TOF camera. After the geometrical calibration of each sensor, the positions of the sensors in 6DOFs are computed. The corresponding data from the CCD camera and the thermal imager are subsequently determined via homogeneous and perspective transformations. The result consists in an image containing aligned data from the CCD camera and the thermal imager for each eye. TOF camera calibration and its impact to the precision of fusion is described. Thermal imager color misbalance caused by mutualtemperature shift is described and solution is shown.

English abstract

The aim of this paper is to describe the data-fusion acquired from a CCD camera and a thermal imager. The fusion is realized by means of spatial data from a TOF camera to ensure ”natural” representation of a robot’s environment; thus, the thermal and CCD camera data are comprised in one stereo image presented to a binocular, head-mounted display. The data acquisition is performed using a sensor head, which is placed on an Orpheus-X3 robot; both the head and the robot were developed by our working group. The head contains five matrix sensors: a pair of CCD cameras, a pair of thermal imagers, and one TOF camera. After the geometrical calibration of each sensor, the positions of the sensors in 6DOFs are computed. The corresponding data from the CCD camera and the thermal imager are subsequently determined via homogeneous and perspective transformations. The result consists in an image containing aligned data from the CCD camera and the thermal imager for each eye. TOF camera calibration and its impact to the precision of fusion is described. Thermal imager color misbalance caused by mutualtemperature shift is described and solution is shown.

Keywords

Data fusion, Sensory head, Range camera, CCD camera, Thermal imager.

RIV year

2014

Released

14.08.2014

ISBN

978-1-927877-05-0

Book

3rd International Conference on Mechanical Engineering and Mechatronics (ICMEM'14)

Pages from

158-1

Pages to

158-9

Pages count

9

URL

BibTex


@inproceedings{BUT111492,
  author="Petra {Kalvodová} and František {Burian} and Luděk {Žalud}",
  title="Multispectral Texture Mapping for Telepresence and Autonomous Mobile Robotics",
  annote="The aim of this paper is to describe the data-fusion acquired from a CCD camera and a thermal imager.
The fusion is realized by means of spatial data from a TOF camera to ensure ”natural” representation of a robot’s environment; thus, the thermal and CCD camera data are comprised in one stereo image presented to a binocular, head-mounted display. The data acquisition is performed using a sensor head, which is placed on an Orpheus-X3 robot; both the head and the robot were developed by our working group. The head contains five matrix sensors: a pair of CCD cameras, a pair of thermal imagers, and one TOF camera. After the geometrical calibration of each sensor, the positions of the sensors in 6DOFs are computed. The corresponding data from the CCD camera and the thermal imager are subsequently determined via homogeneous and perspective transformations. The result consists in an image containing aligned data from the CCD camera and the thermal imager for each eye. TOF camera calibration and its impact to the precision of fusion is described. Thermal imager color misbalance caused by mutualtemperature shift is described and solution is shown.",
  booktitle="3rd International Conference on Mechanical Engineering and Mechatronics (ICMEM'14)",
  chapter="111492",
  howpublished="online",
  year="2014",
  month="august",
  pages="158-1--158-9",
  type="conference paper"
}