TY - JOUR
T1 - Learning-based spatio-temporal vehicle tracking and indexing for transportation multimedia database systems
AU - Chen, Shu Ching
AU - Shyu, Mei Ling
AU - Peeta, Srinivas
AU - Zhang, Chengcui
N1 - Funding Information:
Manuscript received July 20, 2001; revised September 22, 2003. The work of S.-C. Chen was supported in part by the National Science Foundation (NSF) under Grants EIA-0-220-562 and NSF HRD-0-317-692. The work of M.-L. Shyu was supported in part by the National Science Foundation (NSF) under Grant ITR-0-325-260 (Medium). The Guest Editor for this paper was P. A. Ioannou.
Funding Information:
Ms. Zhang is the recipient of several awards, including the Presidential Fellowship and the Best Graduate Student Research Award at FIU.
Copyright:
Copyright 2008 Elsevier B.V., All rights reserved.
PY - 2003/9
Y1 - 2003/9
N2 - One key technology of intelligent transportation systems is the use of advanced sensor systems for on-line surveillance to gather detailed information on traffic conditions. Traffic video analysis can provide a wide range of useful information to traffic planners. In this context, the object-level indexing of video data can enable vehicle classification, traffic flow analysis, incident detection, and analysis at intersections, vehicle tracking for traffic operations, and update of design warrants. In this paper, a learning-based automatic framework is proposed to support the multimedia data indexing and querying of spatio-temporal relationships of vehicle objects in a traffic video sequence. The spatio-temporal relationships of vehicle objects are captured via the proposed unsupervised image/video segmentation method and object tracking algorithm, and modeled using a multimedia augmented transition network model and multimedia input strings. An efficient and effective background learning and subtraction technique is employed to eliminate the complex background details in the traffic video frames. It substantially enhances the efficiency of the segmentation process and the accuracy of the segmentation results to enable more accurate video indexing and annotation. The paper uses four real-life traffic video sequences from several road intersections under different weather conditions in the study experiments. The results show that the proposed framework is effective in automating data collection and access for complex traffic situations.
AB - One key technology of intelligent transportation systems is the use of advanced sensor systems for on-line surveillance to gather detailed information on traffic conditions. Traffic video analysis can provide a wide range of useful information to traffic planners. In this context, the object-level indexing of video data can enable vehicle classification, traffic flow analysis, incident detection, and analysis at intersections, vehicle tracking for traffic operations, and update of design warrants. In this paper, a learning-based automatic framework is proposed to support the multimedia data indexing and querying of spatio-temporal relationships of vehicle objects in a traffic video sequence. The spatio-temporal relationships of vehicle objects are captured via the proposed unsupervised image/video segmentation method and object tracking algorithm, and modeled using a multimedia augmented transition network model and multimedia input strings. An efficient and effective background learning and subtraction technique is employed to eliminate the complex background details in the traffic video frames. It substantially enhances the efficiency of the segmentation process and the accuracy of the segmentation results to enable more accurate video indexing and annotation. The paper uses four real-life traffic video sequences from several road intersections under different weather conditions in the study experiments. The results show that the proposed framework is effective in automating data collection and access for complex traffic situations.
KW - Advanced traffic management systems (ATMS)
KW - Advanced traveler information systems (ATIS)
KW - Background learning and background subtraction
KW - Intelligent transportation systems (ITS)
KW - Multimedia database indexing
KW - Segmentation
KW - Vehicle tracking
KW - Video analysis
UR - http://www.scopus.com/inward/record.url?scp=1242277316&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=1242277316&partnerID=8YFLogxK
U2 - 10.1109/TITS.2003.821290
DO - 10.1109/TITS.2003.821290
M3 - Article
AN - SCOPUS:1242277316
VL - 4
SP - 154
EP - 167
JO - IEEE Transactions on Intelligent Transportation Systems
JF - IEEE Transactions on Intelligent Transportation Systems
SN - 1524-9050
IS - 3
ER -