Crack detection plays an important role in infrastructure inspection; however, the utilization of existing pixel-level crack annotations for object detection remains challenging due to the absence of detection-oriented bounding-box labels. In this study, an Adaptive Crack-Guided Attention Mask R-CNN (Adaptive CGA-Mask R-CNN) framework is proposed for automatic crack detection. An adaptive mask-to-box generation strategy is developed to transform pixel-level crack masks into object detection annotations through background identification, morphological refinement, and connected-component analysis. Furthermore, an adaptive crack-guided attention module is introduced into the feature pyramid network of Mask R-CNN to enhance crack-related feature representation across multiple scales. The proposed framework preserves the original detection architecture while improving the sensitivity to thin, irregular, and complex crack structures. Experimental results demonstrate that the proposed method achieves competitive localization performance compared with conventional object detection approaches. Additional comparative and cross-dataset evaluations further verify the effectiveness and generalization capability of the proposed framework. The proposed method provides an efficient solution for exploiting existing segmentation annotations in automatic crack detection applications.
- Open Access
- Article
Adaptive Mask-Guided Crack Attention Mask R-CNN for Automatic Crack Detection
- Lihua Pan,
- Yuanyuan Ou,
- Wanyi Li *,
- Yuewei Ma,
- Shiyong Huang,
- Jinmei He,
- Daizheng Kuang and
- Qian Zhang
Author Information
Received: 05 July 2026 | Revised: 22 October 2026 | Accepted: 26 October 2026 | Published: 09 November 2026
Abstract
Keywords
crack detection | adaptive crack-guided attention | Mask R-CNN | mask-to-box generation | object detection | infrastructure inspection
References
- 1.
Fujita, Y.; Hamamoto, Y. A Robust Automatic Crack Detection Method from Noisy Concrete Surfaces. Mach. Vis. Appl. 2011, 22, 245–254. https://doi.org/10.1007/s00138-009-0244-5.
- 2.
Hamishebahar, Y.; Guan, H.; So, S.; et al. A Comprehensive Review of Deep Learning-Based Crack Detection Approaches. Appl. Sci. 2022, 12, 1374. https://doi.org/10.3390/app12031374.
- 3.
Ren, S.; He, K.; Girshick, R.; et al. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Trans. Pattern Anal. Mach. Intell. 2017, 39, 1137–1149. https://doi.org/10.1109/tpami.2016.2577031.
- 4.
Liu, W.; Anguelov, D.; Erhan, D.; et al. SSD: Single Shot MultiBox Detector. In Computer Vision–ECCV 2016, Proceedings of the 14th European Conference, Amsterdam, The Netherlands, 11–14 October 2016; Springer: Cham, Switzerland, 2016; pp. 21–37. https://doi.org/10.1007/978-3-319-46448-0_2.
- 5.
Ultralytics YOLOv8. Available online: https://github.com/ultralytics/ultralytics (accessed on 31 October 2026).
- 6.
Zhang, A.; Wang, K.C.P.; Fei, Y.; et al. Automated Pixel-Level Pavement Crack Detection on 3D Asphalt Surfaces with a Recurrent Neural Network. Comput.-Aided Civ. Infrastruct. Eng. 2019, 34, 213–229. https://doi.org/10.1111/mice.12409.
- 7.
Dung, C.V.; Anh, L.D. Autonomous Concrete Crack Detection Using Deep Fully Convolutional Neural Network. Autom. Constr. 2019, 99, 52–58. https://doi.org/10.1016/j.autcon.2018.11.028.
- 8.
He, K.; Gkioxari, G.; Dollar, P.; et al. Mask R-CNN. In Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy, 22–29 October 2017; pp. 2980–2988. https://doi.org/10.1109/iccv.2017.322.
- 9.
Lin, T.Y.; Dollar, P.; Girshick, R.; et al. Feature Pyramid Networks for Object Detection. In Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017; pp. 936–944. https://doi.org/10.1109/cvpr.2017.106.
- 10.
Kang, D.H.; Cha, Y.J. Efficient Attention-Based Deep Encoder and Decoder for Automatic Crack Segmentation. Struct. Health Monit. 2022, 21, 2190–2205. https://doi.org/10.1177/14759217211053776.
- 11.
Wang, J.; Zeng, Z.; Wang, J.; et al. Automatic Crack Segmentation Model Based on Multi-Branch Aggregation Transformer. Adv. Struct. Eng. 2024, 27, 2289–2302. https://doi.org/10.1177/13694332241266538.
- 12.
Guo, P.; Bao, Y. HRCDS: A Benchmark Dataset for High-Resolution Concrete Damage Segmentation. Available online: https://doi.org/10.17632/6x4dzzrs2h.1 (accessed on 31 October 2026).
- 13.
Kim, B.; Cho, S. Automated Vision-Based Detection of Cracks on Concrete Surfaces Using a Deep Learning Technique. Sensors 2018, 18, 3452. https://doi.org/10.3390/s18103452.
- 14.
Rajadurai, R.S.; Kang, S.T. Automated Vision-Based Crack Detection on Concrete Surfaces Using Deep Learning. Appl. Sci. 2021, 11, 5229. https://doi.org/10.3390/app11115229.
- 15.
Rao, A.S.; Nguyen, T.; Palaniswami, M.; et al. Vision-Based Automated Crack Detection Using Convolutional Neural Networks for Condition Assessment of Infrastructure. Struct. Health Monit. 2021, 20, 2124–2142. https://doi.org/10.1177/1475921720965445.
- 16.
Cha, Y.J.; Choi, W.; Büyüköztürk, O. Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks. Comput.-Aided Civ. Infrastruct. Eng. 2017, 32, 361–378. https://doi.org/10.1111/mice.12263.
- 17.
Shelhamer, E.; Long, J.; Darrell, T. Fully Convolutional Networks for Semantic Segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 2017, 39, 640–651. https://doi.org/10.1109/tpami.2016.2572683.
- 18.
Ronneberger, O.; Fischer, P.; Brox, T. U-Net: Convolutional Networks for Biomedical Image Segmentation. In Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015, Proceedings of the 18th International Conference, Munich, Germany, 5–9 October 2015; Springer: Cham, Switzerland, 2015; pp. 234–241. https://doi.org/10.1007/978-3-319-24574-4_28.
- 19.
Xu, X.; Zhao, M.; Shi, P.; et al. Crack Detection and Comparison Study Based on Faster R-CNN and Mask R-CNN. Sensors 2022, 22, 1215. https://doi.org/10.3390/s22031215.
- 20.
Zhao, M.; Shi, P.; Xu, X.; et al. Improving the Accuracy of an R-CNN-Based Crack Identification System Using Different Preprocessing Algorithms. Sensors 2022, 22, 7089. https://doi.org/10.3390/s22187089.
- 21.
Gan, L.; Liu, H.; Yan, Y.; et al. Bridge Bottom Crack Detection and Modeling Based on Faster R-CNN and BIM. IET Image Process. 2024, 18, 664–677. https://doi.org/10.1049/ipr2.12976.
- 22.
Wang, W.; Su, C. Automatic Concrete Crack Segmentation Model Based on Transformer. Autom. Constr. 2022, 139, 104275. https://doi.org/10.1016/j.autcon.2022.104275.
- 23.
Lin, T.Y.; Maire, M.; Belongie, S.; et al. Microsoft COCO: Common Objects in Context. In Computer Vision—ECCV 2014, Proceedings of the 13th European Conference, Zurich, Switzerland, 6–12 September 2014; Springer: Cham, Switzerland, 2014; pp. 740–755. https://doi.org/10.1007/978-3-319-10602-1_48.
- 24.
Shi, Y.; Cui, L.; Qi, Z.; et al. Automatic Road Crack Detection Using Random Structured Forests. IEEE Trans. Intell. Transp. Syst. 2016, 17, 3434–3445. https://doi.org/10.1109/tits.2016.2552248.
This work is licensed under a Creative Commons Attribution 4.0 International License.
