Deep learning-based post-earthquake structural damage level recognition

authored by: Xiaoying Zhuang, Than V. Tran, H. Nguyen-Xuan, Timon Rabczuk
Abstract: Rapid assessment of building damage levels has become very important and has received considerable attention in structural engineering. Traditional methods for this work involve manual inspection, which is often tedious and time-consuming. Deep learning technology in computer vision has developed rapidly in recent years and has proven its superiority. This paper aims to develop an efficient approach to recognize quick post-earthquake structural damage levels. First, we develop a feature extraction with seven pre-trained CNN models (Xception, InceptionV3, InceptionResNetV2, MobileNet, MobileNetV2, DenseNet121, NASNetMobile) on a small dataset of 2000 images. The CNN models are then trained by five fold cross-validation. The performance of the models is compared on a testing set, the MobileNet model demonstrated the best classifier performance with an accuracy of 90.89 %. Second, the Bayesian optimization method and the fine-tuning strategy are used to find the optimal hyperparameters of the MobileNet model. The results revealed that the performance of the MobileNet model increased significantly with an accuracy of 96.11 %. Third, Gradient-weighted class activation mapping (Grad-CAM) is used to highlight crucial regions on structural damage images for CNN's prediction. Finally, the generalizability of the MobileNet model is improved by training it on an extended dataset of 3600 images. The proposed approach demonstrates the feasibility and potential uses of deep learning in image-based structural damage level recognition.
Organisation(s): Institute of Photonics
External Organisation(s): Tongji University
Ho Chi Minh City University of Technology (HUTECH)
Bauhaus-Universität Weimar
Type: Article
Journal: Computers and Structures
Volume: 315
No. of pages: 18
ISSN: 0045-7949
Publication date: 08.2025
Publication status: Published
Peer reviewed: Yes
ASJC Scopus subject areas: Civil and Structural Engineering, Modelling and Simulation, General Materials Science, Mechanical Engineering, Computer Science Applications
Electronic version(s): https://doi.org/10.1016/j.compstruc.2025.107761 (Access: Open)
: Details in the research portal "Research@Leibniz University"

BibTeX

@article{91d1a72a4dab42fda0135154bd063caa,
title = "Deep learning-based post-earthquake structural damage level recognition",
abstract = "Rapid assessment of building damage levels has become very important and has received considerable attention in structural engineering. Traditional methods for this work involve manual inspection, which is often tedious and time-consuming. Deep learning technology in computer vision has developed rapidly in recent years and has proven its superiority. This paper aims to develop an efficient approach to recognize quick post-earthquake structural damage levels. First, we develop a feature extraction with seven pre-trained CNN models (Xception, InceptionV3, InceptionResNetV2, MobileNet, MobileNetV2, DenseNet121, NASNetMobile) on a small dataset of 2000 images. The CNN models are then trained by five fold cross-validation. The performance of the models is compared on a testing set, the MobileNet model demonstrated the best classifier performance with an accuracy of 90.89 %. Second, the Bayesian optimization method and the fine-tuning strategy are used to find the optimal hyperparameters of the MobileNet model. The results revealed that the performance of the MobileNet model increased significantly with an accuracy of 96.11 %. Third, Gradient-weighted class activation mapping (Grad-CAM) is used to highlight crucial regions on structural damage images for CNN's prediction. Finally, the generalizability of the MobileNet model is improved by training it on an extended dataset of 3600 images. The proposed approach demonstrates the feasibility and potential uses of deep learning in image-based structural damage level recognition.",
keywords = "Bayesian optimization, Convolutional neural network, Damage level recognition, Deep learning, Image classification, Transfer learning",
author = "Xiaoying Zhuang and Tran, {Than V.} and H. Nguyen-Xuan and Timon Rabczuk",
note = "Publisher Copyright: {\textcopyright} 2025 The Authors",
year = "2025",
month = aug,
doi = "10.1016/j.compstruc.2025.107761",
language = "English",
volume = "315",
journal = "Computers and Structures",
issn = "0045-7949",
publisher = "Elsevier Ltd.",
}

Back