TY - GEN
T1 - Assessing reliability of big data stream for smart city
AU - Puangpontip, Supadchaya
AU - Hewett, Rattikorn
N1 - Publisher Copyright:
© 2019 Association for Computing Machinery.
PY - 2019/11/20
Y1 - 2019/11/20
N2 - Proliferation of IoT (Internet of Things) and sensor technology has expedited the realization of Smart City. To enable necessary functions, sensors distributed across the city generate a huge volume of stream data that are crucial for controlling Smart City devices. However, due to conditions such as wears and tears, battery drain, or malicious attacks, not all data are reliable even when they are accurately measured. These data could lead to invalid and devastating consequences (e.g., failed utility or transportation services). The assessment of data reliability is necessary and challenging especially for Smart City, as it has to keep up with velocity of big data stream to provide up-to-date results. Most research on data reliability has focused on data fusion and anomaly detection that lack a quantified measure of how much the data over a period of time are adequately reliable for decision-makings. This paper alleviates these issues and presents an online approach to assessing Big stream data reliability in a timely manner. By employing a well-studied evidence-based theory, our approach provides a computational framework that assesses data reliability in terms of belief likelihoods. The framework is lightweight and easy to scale, deeming fit for streaming data. We evaluate the approach using a real application of light sensing data of 1,323,298 instances. The preliminary results are consistent with logical rationales, confirming validity of the approach.
AB - Proliferation of IoT (Internet of Things) and sensor technology has expedited the realization of Smart City. To enable necessary functions, sensors distributed across the city generate a huge volume of stream data that are crucial for controlling Smart City devices. However, due to conditions such as wears and tears, battery drain, or malicious attacks, not all data are reliable even when they are accurately measured. These data could lead to invalid and devastating consequences (e.g., failed utility or transportation services). The assessment of data reliability is necessary and challenging especially for Smart City, as it has to keep up with velocity of big data stream to provide up-to-date results. Most research on data reliability has focused on data fusion and anomaly detection that lack a quantified measure of how much the data over a period of time are adequately reliable for decision-makings. This paper alleviates these issues and presents an online approach to assessing Big stream data reliability in a timely manner. By employing a well-studied evidence-based theory, our approach provides a computational framework that assesses data reliability in terms of belief likelihoods. The framework is lightweight and easy to scale, deeming fit for streaming data. We evaluate the approach using a real application of light sensing data of 1,323,298 instances. The preliminary results are consistent with logical rationales, confirming validity of the approach.
KW - Data reliability
KW - IoT
KW - Smart city
KW - Theory of evidence
UR - http://www.scopus.com/inward/record.url?scp=85079121074&partnerID=8YFLogxK
U2 - 10.1145/3372454.3372478
DO - 10.1145/3372454.3372478
M3 - Conference contribution
AN - SCOPUS:85079121074
T3 - ACM International Conference Proceeding Series
SP - 18
EP - 23
BT - ICBDR 2019 - Proceedings of the 2019 3rd International Conference on Big Data Research
PB - Association for Computing Machinery
T2 - 3rd International Conference on Big Data Research, ICBDR 2019
Y2 - 20 November 2019 through 21 November 2019
ER -