Computer Vision for Structural Dynamics and Health Monitoring

Dongming Feng, Maria Q. Feng

• Publisher: Wiley-ASME Press Series
• Year: 2020
• Print ISBN: 9781119566588
• eBook ISBN: 9781119566571
• Edition: 1
• Topic: Biological Sciences
• Subtopic: System Theory
• Index: Biological Sciences

Provides comprehensive coverage of theory and hands-on implementation of computer vision-based sensors for structural health monitoring

This book is the first to fill the gap between scientific research of computer vision and its practical applications for structural health monitoring (SHM). It provides a complete, state-of-the-art review of the collective experience that the SHM community has gained in recent years. It also extensively explores the potentials of the vision sensor as a fast and cost-effective tool for solving SHM problems based on both time and frequency domain analytics, broadening the application of emerging computer vision sensor technology in not only scientific research but also engineering practice.

Computer Vision for Structural Dynamics and Health Monitoring presents fundamental knowledge, important issues, and practical techniques critical to successful development of vision-based sensors in detail, including robustness of template matching techniques for tracking targets; coordinate conversion methods for determining calibration factors to convert image pixel displacements to physical displacements; sensing by tracking artificial targets vs. natural targets; measurements in real time vs. by post-processing; and field measurement error sources and mitigation methods. The book also features a wide range of tests conducted in both controlled laboratory and complex field environments in order to evaluate the sensor accuracy and demonstrate the unique features and merits of computer vision-based structural displacement measurement.

• Offers comprehensive understanding of the principles and applications of computer vision for structural dynamics and health monitoring
• Helps broaden the application of the emerging computer vision sensor technology from scientific research to engineering practice such as field condition assessment of civil engineering structures and infrastructure systems
• Includes a wide range of laboratory and field testing examples, as well as practical techniques for field application
• Provides MATLAB code for most of the issues discussed including that of image processing, structural dynamics, and SHM applications

Computer Vision for Structural Dynamics and Health Monitoring is ideal for graduate students, researchers, and practicing engineers who are interested in learning about this emerging sensor technology and advancing their applications in SHM and other engineering problems. It will also benefit those in civil and aerospace engineering, energy, and computer science.

1
Introduction

1.1 Structural Health Monitoring: A Quick Review

Structures and civil infrastructure systems, including bridges, buildings, dams, and pipelines, are exposed to various external loads throughout their lifetimes. As they age and deteriorate, effective inspection, monitoring, and maintenance of these systems becomes increasingly important. However, conventional practice based on periodic human visual inspection is time‐consuming, labor‐intensive, subjective, and prone to human error. Nondestructive testing techniques have shown potential for detecting hidden damages, but the large size of the structural systems presents a significant challenge for conducting such localized tests. Over the past few decades, a significant number of studies have been conducted in the area of structural health monitoring (SHM), aiming at timely, objective detection of damage or anomalies and quantitative assessment of structural integrity and safety based on measurements by various on‐structure sensors [1–4]. Most of the SHM techniques are based on structural dynamics, and the basic principle is that any structural damage or degradation would result in changes in structural dynamic responses as well as the corresponding modal characteristics. The SHM process is implemented in four key steps: data acquisition, system identification, condition assessment, and decision‐making.

Dynamics‐based SHM techniques can be categorized into frequency‐domain and time‐domain system identification methods. Carden and Fanning [5] presented an extensive literature review of frequency‐domain SHM techniques based on changes in measured modal properties such as natural frequencies, mode shapes and their curvatures, modal flexibility and its derivatives, modal strain energy, frequency response functions, etc. Modal properties are obtained using various modal analysis techniques, e.g. the natural excitation technique, frequency domain decomposition, stochastic subspace identification, the random decrement technique, blind source separation, and the autoregressive‐moving‐average model‐fitting method. All of these methods have achieved satisfactory performance in numerical and experimental studies. For example, Kim and Stubbs [6] proposed a technique to locate and quantify cracks in beam‐type structures based on a single damage indicator by using changes in natural frequencies. Lee et al. [7] presented a neural network–based method for element‐level damage detection using mode shape differences between intact and damaged structures. Pandey et al. [8] proposed for the first time that mode shape curvature, which is the second derivative of the mode shape, is a sensitive indicator of damage. Feng et al. [9] developed the first neural network–based system identification framework for updating baseline structural models of two sensor‐instrumented highway bridges.

Time‐domain SHM techniques, rather than working with modal quantities, directly utilize measured structural response time histories to identify structural parameters. The identification in the time domain is often formulated as an optimization process, wherein the objective function is defined as the discrepancy between the measured and predicted responses. In the majority of existing studies, which are referred to as input–output methods, the known or measured excitation forces are a prerequisite for obtaining the predicted structural responses. However, it is highly difficult to measure excitation forces such as vehicle loads on bridges. Recently, there have been attempts to simultaneously identify both structural parameters and input forces from output‐only identification formulations. For example, Rahneshin and Chierichetti [10] proposed an iterative algorithm – the extended load confluence algorithm – to predict dynamic structural responses in which limited or no information about the applied loads is available. Xu et al. [11] presented a weighted adaptive iterative least‐squares estimation method to identify structural parameters and dynamic input loadings from incomplete measurements. Sun and Betti [12] demonstrated the effectiveness of a hybrid heuristic optimization strategy for simultaneous identification of structural parameters and input loads via three numerical examples. Feng et al. [13] proposed a numerical methodology to simultaneously identify bridge structural parameters and moving vehicle axle load histories from a limited number of acceleration measurements.

On the other hand, various filter‐type algorithms for online system identification have been extensively studied in the literature, using either input–output or output‐only time‐domain data. Examples include the extended Kalman filter, unscented Kalman filter, particle filter, and H_∞ filter. For example, Chen and Feng [14] proposed a recursive Bayesian filtering approach to update structural parameters and their uncertainties in a probabilistic structural model. Soyoz and Feng [15] formulated an extended Kalman filter for instantaneous detection of seismic damage of bridges and validated its efficacy through large‐scale seismic shaking‐table tests. Although these online estimation algorithms have proved to be successful in many applications, they also present challenges. For example, the sensitivity of these methods to initial guess values affects the stability and convergence of estimated parameters to exact ones. In addition, parameter/damage identification methods based on heuristic algorithms – e.g. genetic algorithm, particle swarm optimization, artificial neural network, differential evolution, and artificial bee colony – have gained increasing attention due to their global optimization performance. However, validation of these methods is mostly limited to numerical or controlled laboratory examples rather than real‐world structures.

For both frequency‐ and time‐domain methods, vibration‐based SHM strategies have proved effective in evaluating the global health state of structures and performing a rapid risk assessment. However, their wide deployment in realistic engineering structures is limited by the prohibitive requirement of installing dense on‐structure sensor networks (primarily accelerometers) and associated data‐acquisition systems. Contact‐type wired sensors require time‐consuming, labor‐intensive installation and costly maintenance for successful long‐term monitoring, which poses many economic and practical challenges. Although wireless sensor technology has addressed several limitations of wired sensors by eliminating cumbersome wiring, data acquisition remains challenging due to the complexity of data transmission, time synchronization, and power consumption, especially when hundreds of wireless sensors are mounted on a large‐scale structure to measure dynamic responses. Moreover, one main bottleneck is that conventional on‐structure sensors provide sparse, discrete point‐wise measurements and thus low spatial‐sensing resolutions, which limits the effectiveness of SHM on a large‐scale structure. Although such a sensor network with a limited number of sensors may allow for the detection of changes in overall structural dynamics, it is often insufficient for identifying the location or assessing the extent of damage.

To address these practical limitations, the research and engineering practitioner communities have been actively exploring new sensor technologies that can advance the current state of SHM practice. This book introduces the emerging computer vision–based sensor technology.

1.2 Computer Vision Sensors for Structural Health Monitoring

While most...

Table of contents

• Cover
• Table of Contents
• Title Page
• Copyright Page
• List of Figures
• List of Tables
• Series Preface
• Preface
• About the Companion Website
• 1 Introduction
• 2 Development of a Computer Vision Sensor for Structural Displacement Measurement
• 3 Performance Evaluation Through Laboratory and Field Tests
• 4 Application in Modal Analysis, Model Updating, and Damage Detection
• 5 Application in Model Updating of Railway Bridges under Trainloads
• 6 Application in Simultaneously Identifying Structural Parameters and Excitation Forces
• 7 Application in Estimating Cable Force
• 8 Achievements, Challenges, and Opportunities
• Appendix: Fundamentals of Digital Image Processing Using MATLAB
• References
• Index
• End User License Agreement