Road Surface Condition Identification with Deep Neural Networks and SVM Classifier
Received: 9 January 2025 | Revised: 29 January 2025 and 25 February 2025 | Accepted: 27 February 2025 | Online: 9 March 2025
Corresponding author: R. Ramya Krishna
Abstract
Roads are people's main transportation mode, deeming them an important aspect of worldwide everyday life. However, weather conditions increasingly impact road infrastructure, necessitating improved road safety measures. Identifying road types enhances traffic management and safety, particularly as roads often sustain damage during the rainy season and require restoration that takes time. In many countries, weather conditions also affect road usability. This study proposes a Deep Neural Network (DNN) for automatic road classification Road Surface Images (RSI). ResNet-50 is employed for feature extraction, while additional features, such as Gray-Level Co-Occurrence Matrix (GLCM), correlation factor, and Histogram of Oriented Gradients (HOG) are integrated to improve detection accuracy. These features collectively form the GHR50 model. Next, the collected features are classified using a Support Vector Machine (SVM) classifier and the parameters are evaluated. The proposed GHR50 model achieves 97.39% accuracy in detecting road types, such as dry mud, fresh snow, and water-asphalt smooth, representing a 0.95% improvement over conventional Convolutional Neural Networks (CNNs).
Keywords:
road surface images, deep neural network, histogram of oriented gradient, grey level co-occurrence matrix, residual network, support vector machineDownloads
References
T. N. Wiesel and D. H. Hubel, "Effects of Visual Deprivation on Morphology and Physiology of Cells in the Cat’s Lateral Geniculate Body," Journal of Neurophysiology, vol. 26, no. 6, pp. 978–993, Nov. 1963.
Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proceedings of the IEEE, vol. 86, no. 11, pp. 2278–2324, Nov. 1998.
A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks," Communications of the ACM, vol. 60, no. 6, pp. 84–90, May 2017.
D. Doan Van, "Application of Advanced Deep Convolutional Neural Networks for the Recognition of Road Surface Anomalies," Engineering, Technology & Applied Science Research, vol. 13, no. 3, pp. 10765–10768.
Z. Liu, J. Yang, and C. Liu, "Extracting Multiple Features in the CID Color Space for Face Recognition," IEEE Transactions on Image Processing, vol. 19, no. 9, pp. 2502–2509, Sep. 2010.
S. Zhang, S. Zhao, Y. Sui, and L. Zhang, "Single Object Tracking With Fuzzy Least Squares Support Vector Machine," IEEE Transactions on Image Processing, vol. 24, no. 12, pp. 5723–5738, Dec. 2015.
Y. Liu, Y. Cheng, and W. Wang, "A survey of the application of deep learning in computer vision," in Global Intelligence Industry Conference (GIIC 2018), Beijing, China, Aug. 2018, p. 68.
D. Erhan, Y. Bengio, A. Courville, P.-A. Manzagol, P. Vincent, and S. Bengio, "Why Does Unsupervised Pre-training Help Deep Learning?," J. Mach. Learn. Res., vol. 11, pp. 625–660, Mar. 2010.
P. Petersen and F. Voigtlaender, "Optimal approximation of piecewise smooth functions using deep ReLU neural networks," Neural Networks, vol. 108, pp. 296–330, Dec. 2018.
T. Zhao and Y. Wei, "A road surface image dataset with detailed annotations for driving assistance applications," Data in Brief, vol. 43, Aug. 2022, Art. no. 108483.
L. Cai, D. C. Zhang, B. Li, L. D. Gao, and L. Wang, "Traffic meteorological embedded road conditions detector test method research," Road Traffic and Safety, vol. 14, no. 6, pp. 55–59, 2014.
Z. Qi, B. Wang, X. Pei, and G. Ma, "A method of road surface identification based on road characteristics and the features of antilock braking adjustment," Qiche Gongcheng/Automotive Engineering, vol. 36, pp. 310–315, Mar. 2014.
W. Chinkhuntha, A. Owayo, and N. Ambassah, "Performance Evaluation of Red Clay Soils stabilized with Bluegum Sawdust Ash and Sisal Fiber as Low-Volume Road Sub-base Materials," Engineering, Technology & Applied Science Research, vol. 14, no. 6, pp. 18105–18113, Dec. 2024.
A. Kuehnle and W. Burghout, "Winter Road Condition Recognition Using Video Image Classification," Transportation Research Record: Journal of the Transportation Research Board, vol. 1627, no. 1, pp. 29–33, Jan. 1998.
A. B. Slimane, M. Khoudeir, J. Brochard, and M.-T. Do, "Characterization of road microtexture by means of image analysis," Wear, vol. 264, no. 5–6, pp. 464–468, Mar. 2008.
Y. Chen, "Image analysis applied to black ice detection," presented at the Orlando ’91, Orlando, FL, Orlando, FL, Mar. 1991, pp. 551–562.
I. Yamamoto, M. Kawana, I. Yamazaki, H. Tamura, and Y. Ookubo, "The Application of Visible Image Road Surface Sensors to Winter Road Management," in Proceedings of the 12th World Congress on Intelligent Transport Systems, San Francisco California, United States, Nov. 2005.
D. Patil and S. Jadhav, "Road Segmentation in High-Resolution Images Using Deep Residual Networks," Engineering, Technology & Applied Science Research, vol. 12, no. 6, pp. 9654–9660, Dec. 2022.
H. Li, Y. H. Feng, and J. Lin, "Study on road surface condition identification based on BP network improved," Microcomputer Information, vol. 26, no. 2, pp. 3-4, 2010.
X. Y. Liu and Q. D. Huang, "Study on classifier of wet road images based on SVM," Journal of Wuhan University of Technology (Transportation Science and Engineering), vol. 35, no. 4, pp. 784–787, 2011.
I. Abdic et al., "Detecting road surface wetness from audio: A deep learning approach," in 2016 23rd International Conference on Pattern Recognition (ICPR), Cancun, Dec. 2016, pp. 3458–3463.
M. Nolte, N. Kister, and M. Maurer, "Assessment of Deep Convolutional Neural Networks for Road Surface Classification," 2018.
J. Carrillo, M. Crowley, G. Pan, and L. Fu, "Design of Efficient Deep Learning models for Determining Road Surface Condition from Roadside Camera Images and Weather Data," 2020.
J. Carrillo and M. Crowley, "Integration of Roadside Camera Images and Weather Data for Monitoring Winter Road Surface Conditions," 2020.
J. W. Seo, J. S. Kim, and C. C. Chung, "Classification Method of Road Surface Condition and Type with LiDAR Using Spatiotemporal Information." arXiv, Aug. 11, 2023.
Tong Zhao, "Road Surface Image Dataset with Detailed Annotations." Mendeley, Jul. 11, 2022.
A. Raj, D. Krishna, R. Hari Priya, K. Shantanu, and S. Niranjani Devi, "Vision based road surface detection for automotive systems," in 2012 International Conference on Applied Electronics, 2012, pp. 223–228.
K. J. Hoon, and W. J. Moo, "A Development of The Road Surface Decision Algorithm Using SVM (Support Vector Machine) Clustering Methods," The Journal of The Korea Institute of Intelligent Transport Systems, vol. 12, no. 5, pp. 1–12, Oct. 2013.
J. Zhao, H. Wu, and L. Chen, "Road Surface State Recognition Based on SVM Optimization and Image Segmentation Processing," Journal of Advanced Transportation, vol. 2017, pp. 1–21, 2017.
L. Cheng, X. Zhang, and J. Shen, "Road surface condition classification using deep learning," Journal of Visual Communication and Image Representation, vol. 64, Oct. 2019, Art. no. 102638.
S. Lee, J. Jeon, and T. H. M. Le, "Feasibility of Automated Black Ice Segmentation in Various Climate Conditions Using Deep Learning," Buildings, vol. 13, no. 3, Mar. 2023, Art. no. 767.
Y. Moroto, K. Maeda, R. Togo, T. Ogawa, and M. Haseyama, "Multimodal Transformer Model Using Time-Series Data to Classify Winter Road Surface Conditions," Sensors, vol. 24, no. 11, May 2024, Art. no. 3440.
Downloads
How to Cite
License
Copyright (c) 2025 R. Ramya Krishna, N. Jyothi
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
