3-D motion and structure estimation for arbitrary scenes from 2-D optical and sonar video

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (Scopus)

Abstract

Imaging system are routinely deployed for underwater search, inspection and scientific surveys of manmade and natural structures, etc. Optical cameras, while providing high resolution and target details, have range limitation according to water visibility and become ineffective in turbid environments. In comparison, high-frequency (MHz) 2-D imaging sonar video systems, introduced to the commercial market in recent years, image targets at distances of 10's of meters in highly turbid waters. Visibility permitting, the integration of visual cues in 2-D optical and sonar data would enable better performance compared to deploying either imaging system alone. We address the problem of motion estimation- e.g., for vision-based navigation and target-based positioning of a mobile submersible platform- from 2-D optical and sonar images. The application of structure from motion paradigm in this multimodal imaging scenario also enables the 3-D reconstruction of scene features. We rely on the tracking of features in the sonar and optical motion sequences independently, without the need to establish multi-modal association between corresponding optical and sonar features. In addition to improving the motion estimation accuracy, advantages of the proposed method comprise overcoming certain inherent ambiguities of monocular vision, e.g., the scale-factor ambiguity, and although rare, up to three interpretations for certain scene structures and camera motion. Experiment with synthetic and real data are presented in support of our technical contribution.

Original languageEnglish
Title of host publicationOCEANS 2008
DOIs
StatePublished - Dec 1 2008
EventOCEANS 2008 - Quebec City, QC, Canada
Duration: Sep 15 2008Sep 18 2008

Other

OtherOCEANS 2008
CountryCanada
CityQuebec City, QC
Period9/15/089/18/08

Fingerprint

Sonar
sonar
Motion estimation
Visibility
visibility
Imaging systems
Cameras
Imaging techniques
visual cue
submersible
positioning
navigation
Water
Navigation
Inspection
video
water
market
experiment
Experiments

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Oceanography

Cite this

3-D motion and structure estimation for arbitrary scenes from 2-D optical and sonar video. / Negahdaripour, Shahriar; Taatian, A.

OCEANS 2008. 2008. 5151985.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

@inproceedings{9a23666a147748feb2e6d34d2ab30c1e,
title = "3-D motion and structure estimation for arbitrary scenes from 2-D optical and sonar video",
abstract = "Imaging system are routinely deployed for underwater search, inspection and scientific surveys of manmade and natural structures, etc. Optical cameras, while providing high resolution and target details, have range limitation according to water visibility and become ineffective in turbid environments. In comparison, high-frequency (MHz) 2-D imaging sonar video systems, introduced to the commercial market in recent years, image targets at distances of 10's of meters in highly turbid waters. Visibility permitting, the integration of visual cues in 2-D optical and sonar data would enable better performance compared to deploying either imaging system alone. We address the problem of motion estimation- e.g., for vision-based navigation and target-based positioning of a mobile submersible platform- from 2-D optical and sonar images. The application of structure from motion paradigm in this multimodal imaging scenario also enables the 3-D reconstruction of scene features. We rely on the tracking of features in the sonar and optical motion sequences independently, without the need to establish multi-modal association between corresponding optical and sonar features. In addition to improving the motion estimation accuracy, advantages of the proposed method comprise overcoming certain inherent ambiguities of monocular vision, e.g., the scale-factor ambiguity, and although rare, up to three interpretations for certain scene structures and camera motion. Experiment with synthetic and real data are presented in support of our technical contribution.",
author = "Shahriar Negahdaripour and A. Taatian",
year = "2008",
month = "12",
day = "1",
doi = "10.1109/OCEANS.2008.5151985",
language = "English",
isbn = "9781424426201",
booktitle = "OCEANS 2008",

}

TY - GEN

T1 - 3-D motion and structure estimation for arbitrary scenes from 2-D optical and sonar video

AU - Negahdaripour, Shahriar

AU - Taatian, A.

PY - 2008/12/1

Y1 - 2008/12/1

N2 - Imaging system are routinely deployed for underwater search, inspection and scientific surveys of manmade and natural structures, etc. Optical cameras, while providing high resolution and target details, have range limitation according to water visibility and become ineffective in turbid environments. In comparison, high-frequency (MHz) 2-D imaging sonar video systems, introduced to the commercial market in recent years, image targets at distances of 10's of meters in highly turbid waters. Visibility permitting, the integration of visual cues in 2-D optical and sonar data would enable better performance compared to deploying either imaging system alone. We address the problem of motion estimation- e.g., for vision-based navigation and target-based positioning of a mobile submersible platform- from 2-D optical and sonar images. The application of structure from motion paradigm in this multimodal imaging scenario also enables the 3-D reconstruction of scene features. We rely on the tracking of features in the sonar and optical motion sequences independently, without the need to establish multi-modal association between corresponding optical and sonar features. In addition to improving the motion estimation accuracy, advantages of the proposed method comprise overcoming certain inherent ambiguities of monocular vision, e.g., the scale-factor ambiguity, and although rare, up to three interpretations for certain scene structures and camera motion. Experiment with synthetic and real data are presented in support of our technical contribution.

AB - Imaging system are routinely deployed for underwater search, inspection and scientific surveys of manmade and natural structures, etc. Optical cameras, while providing high resolution and target details, have range limitation according to water visibility and become ineffective in turbid environments. In comparison, high-frequency (MHz) 2-D imaging sonar video systems, introduced to the commercial market in recent years, image targets at distances of 10's of meters in highly turbid waters. Visibility permitting, the integration of visual cues in 2-D optical and sonar data would enable better performance compared to deploying either imaging system alone. We address the problem of motion estimation- e.g., for vision-based navigation and target-based positioning of a mobile submersible platform- from 2-D optical and sonar images. The application of structure from motion paradigm in this multimodal imaging scenario also enables the 3-D reconstruction of scene features. We rely on the tracking of features in the sonar and optical motion sequences independently, without the need to establish multi-modal association between corresponding optical and sonar features. In addition to improving the motion estimation accuracy, advantages of the proposed method comprise overcoming certain inherent ambiguities of monocular vision, e.g., the scale-factor ambiguity, and although rare, up to three interpretations for certain scene structures and camera motion. Experiment with synthetic and real data are presented in support of our technical contribution.

UR - http://www.scopus.com/inward/record.url?scp=70350126208&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70350126208&partnerID=8YFLogxK

U2 - 10.1109/OCEANS.2008.5151985

DO - 10.1109/OCEANS.2008.5151985

M3 - Conference contribution

SN - 9781424426201

BT - OCEANS 2008

ER -