EcRD: Edge-Cloud Computing Framework for Smart Road Damage Detection and Warning

Yachao Yuan, Md Saiful Islam, Yali Yuan, Shengjin Wang, Thar Baker, Lutz Maria Kolbe

Research output: Contribution to journalArticlepeer-review

Abstract

Road damages have caused numerous fatalities, thus the study of road damage detection, especially hazardous road damage detection and warning is critical for traffic safety. Existing road damage detection systems mainly process data at cloud, which suffers from a high latency caused by long-distance. Meanwhile, supervised machine learning algorithms are usually used in these systems requiring large precisely labeled data sets to achieve a good performance. In this article, we propose EcRD: an edge-cloud-based road damage detection and warning framework, that leverages the fast-responding advantage of edge and the large storage and computation resources advantages of cloud. There are three main contributions in this article: we first propose a simple yet efficient road segmentation algorithm to enable fast and accurate road area detection. Then, a light-weighted road damage detector is developed based on gray level co-occurrence matrix features at edge for rapid hazardous road damage detection and warning. Furthermore, a multitypes road damage detection model is introduced for long-term road management at cloud, embedded with a novel image generator based on cycle-consistent adversarial networks which automatically generates images with labels to further improve road damage detection accuracy. By comparing with the state-of-the-art, we demonstrate that the proposed EcRD can accurately detect both hazardous road damages at edge and multitypes road damages at cloud. Besides, it is around 579 times faster than cloud-based approaches without affecting users' experience and requiring very low storage and labeling cost.
Original languageEnglish
Pages (from-to)12734 - 12747
Number of pages4
JournalIEEE Internet of Things Journal
Volume8
Issue number16
DOIs
Publication statusPublished - 18 Sep 2020

Cite this