Application of Forward-Scan Sonar Stereo for 3-D Scene Reconstruction

Research output: Contribution to journalArticle

Abstract

New generation of underwater 2-D forward-look sonar video cameras operating at near and over 1-MHz frequency offer images with enhanced target details. Within their limited range of only tens of meters, they are the most suitable imaging systems for conducting visually guided missions in turbid waters. These include, but are not limited to inspecting underwater structures for routine maintenance, search, and surveillance, the detection, localization, and identification of small sought after objects, as well as target-based positioning and navigation. To this end, the automatic 3-D reconstruction of 3-D target shape and establishing the 3-D spatial location of interest points are highly desired capabilities in many such operations. As achieved with 2-D optical images, multiple images from nearby positions may be utilized. This paper investigates the estimation of 3-D point locations from two overlapping images collected with two forward-scan (FS) sonar systems in stereo configuration, or with one FS sonar at known relative poses, established from visual motion cues. The first contribution includes the analysis of a sonar stereo epipolar geometry. Beyond reducing the correspondence problem to a 1-D search along epipolar curves, this reveals unique properties associated with sonar measurements of range and azimuth angle. Next, certain linear closed-form reconstruction solutions are presented, their degeneracies are established, and adjustments under degenerate conditions are proposed. Two preferred method for the degenerate and nondegenerate stereo configurations are identified: a regularization-based method and one employing a range constraint approximation, respectively. These primarily provide the initial estimate for an iterative nonlinear optimization scheme based on gradient descent. Finally, the results of experiments with synthetic data are presented to assess various estimation methods, and with real data sets to demonstrate performance under two subsea operational scenarios.

Original languageEnglish (US)
JournalIEEE Journal of Oceanic Engineering
DOIs
StateAccepted/In press - Jan 1 2018

Fingerprint

Sonar
Underwater structures
Video cameras
Imaging systems
Navigation
Geometry
Water
Experiments

Keywords

  • 2-D forward-scan (FS) sonar imaging
  • Cameras
  • Epipolar geometry
  • Geometry
  • Image reconstruction
  • multiple-view 3-D reconstruction
  • Sonar measurements
  • stereo vision
  • Three-dimensional displays

ASJC Scopus subject areas

  • Ocean Engineering
  • Mechanical Engineering
  • Electrical and Electronic Engineering

Cite this

@article{9e503d2b8a224301bb7dd7e2a74e7217,
title = "Application of Forward-Scan Sonar Stereo for 3-D Scene Reconstruction",
abstract = "New generation of underwater 2-D forward-look sonar video cameras operating at near and over 1-MHz frequency offer images with enhanced target details. Within their limited range of only tens of meters, they are the most suitable imaging systems for conducting visually guided missions in turbid waters. These include, but are not limited to inspecting underwater structures for routine maintenance, search, and surveillance, the detection, localization, and identification of small sought after objects, as well as target-based positioning and navigation. To this end, the automatic 3-D reconstruction of 3-D target shape and establishing the 3-D spatial location of interest points are highly desired capabilities in many such operations. As achieved with 2-D optical images, multiple images from nearby positions may be utilized. This paper investigates the estimation of 3-D point locations from two overlapping images collected with two forward-scan (FS) sonar systems in stereo configuration, or with one FS sonar at known relative poses, established from visual motion cues. The first contribution includes the analysis of a sonar stereo epipolar geometry. Beyond reducing the correspondence problem to a 1-D search along epipolar curves, this reveals unique properties associated with sonar measurements of range and azimuth angle. Next, certain linear closed-form reconstruction solutions are presented, their degeneracies are established, and adjustments under degenerate conditions are proposed. Two preferred method for the degenerate and nondegenerate stereo configurations are identified: a regularization-based method and one employing a range constraint approximation, respectively. These primarily provide the initial estimate for an iterative nonlinear optimization scheme based on gradient descent. Finally, the results of experiments with synthetic data are presented to assess various estimation methods, and with real data sets to demonstrate performance under two subsea operational scenarios.",
keywords = "2-D forward-scan (FS) sonar imaging, Cameras, Epipolar geometry, Geometry, Image reconstruction, multiple-view 3-D reconstruction, Sonar measurements, stereo vision, Three-dimensional displays",
author = "Shahriar Negahdaripour",
year = "2018",
month = "1",
day = "1",
doi = "10.1109/JOE.2018.2875574",
language = "English (US)",
journal = "IEEE Journal of Oceanic Engineering",
issn = "0364-9059",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - JOUR

T1 - Application of Forward-Scan Sonar Stereo for 3-D Scene Reconstruction

AU - Negahdaripour, Shahriar

PY - 2018/1/1

Y1 - 2018/1/1

N2 - New generation of underwater 2-D forward-look sonar video cameras operating at near and over 1-MHz frequency offer images with enhanced target details. Within their limited range of only tens of meters, they are the most suitable imaging systems for conducting visually guided missions in turbid waters. These include, but are not limited to inspecting underwater structures for routine maintenance, search, and surveillance, the detection, localization, and identification of small sought after objects, as well as target-based positioning and navigation. To this end, the automatic 3-D reconstruction of 3-D target shape and establishing the 3-D spatial location of interest points are highly desired capabilities in many such operations. As achieved with 2-D optical images, multiple images from nearby positions may be utilized. This paper investigates the estimation of 3-D point locations from two overlapping images collected with two forward-scan (FS) sonar systems in stereo configuration, or with one FS sonar at known relative poses, established from visual motion cues. The first contribution includes the analysis of a sonar stereo epipolar geometry. Beyond reducing the correspondence problem to a 1-D search along epipolar curves, this reveals unique properties associated with sonar measurements of range and azimuth angle. Next, certain linear closed-form reconstruction solutions are presented, their degeneracies are established, and adjustments under degenerate conditions are proposed. Two preferred method for the degenerate and nondegenerate stereo configurations are identified: a regularization-based method and one employing a range constraint approximation, respectively. These primarily provide the initial estimate for an iterative nonlinear optimization scheme based on gradient descent. Finally, the results of experiments with synthetic data are presented to assess various estimation methods, and with real data sets to demonstrate performance under two subsea operational scenarios.

AB - New generation of underwater 2-D forward-look sonar video cameras operating at near and over 1-MHz frequency offer images with enhanced target details. Within their limited range of only tens of meters, they are the most suitable imaging systems for conducting visually guided missions in turbid waters. These include, but are not limited to inspecting underwater structures for routine maintenance, search, and surveillance, the detection, localization, and identification of small sought after objects, as well as target-based positioning and navigation. To this end, the automatic 3-D reconstruction of 3-D target shape and establishing the 3-D spatial location of interest points are highly desired capabilities in many such operations. As achieved with 2-D optical images, multiple images from nearby positions may be utilized. This paper investigates the estimation of 3-D point locations from two overlapping images collected with two forward-scan (FS) sonar systems in stereo configuration, or with one FS sonar at known relative poses, established from visual motion cues. The first contribution includes the analysis of a sonar stereo epipolar geometry. Beyond reducing the correspondence problem to a 1-D search along epipolar curves, this reveals unique properties associated with sonar measurements of range and azimuth angle. Next, certain linear closed-form reconstruction solutions are presented, their degeneracies are established, and adjustments under degenerate conditions are proposed. Two preferred method for the degenerate and nondegenerate stereo configurations are identified: a regularization-based method and one employing a range constraint approximation, respectively. These primarily provide the initial estimate for an iterative nonlinear optimization scheme based on gradient descent. Finally, the results of experiments with synthetic data are presented to assess various estimation methods, and with real data sets to demonstrate performance under two subsea operational scenarios.

KW - 2-D forward-scan (FS) sonar imaging

KW - Cameras

KW - Epipolar geometry

KW - Geometry

KW - Image reconstruction

KW - multiple-view 3-D reconstruction

KW - Sonar measurements

KW - stereo vision

KW - Three-dimensional displays

UR - http://www.scopus.com/inward/record.url?scp=85055893859&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85055893859&partnerID=8YFLogxK

U2 - 10.1109/JOE.2018.2875574

DO - 10.1109/JOE.2018.2875574

M3 - Article

JO - IEEE Journal of Oceanic Engineering

JF - IEEE Journal of Oceanic Engineering

SN - 0364-9059

ER -