TY - GEN
T1 - Recovering missing values from corrupted spatio-temporal sensory data via robust low-rank tensor completion
AU - Ruan, Wenjie
AU - Xu, Peipei
AU - Sheng, Quan Z.
AU - Falkner, Nickolas J. G.
AU - Li, Xue
AU - Zhang, Wei Emma
PY - 2017
Y1 - 2017
N2 - With the booming of the Internet of Things, tremendous amount of sensors have been installed in different geographic locations, generating massive sensory data with both time-stamps and geo-tags. Such type of data usually have shown complex spatio-temporal correlation and are easily missing in practice due to communication failure or data corruption. In this paper, we aim to tackle the challenge-how to accurately and efficiently recover the missing values for corrupted spatio-temporal sensory data. Specifically, we first formulate such sensor data as a high-dimensional tensor that can naturally preserve sensors’ both geographical and time information, thus we call spatio-temporal Tensor. Then we model the sensor data recovery as a low-rank robust tensor completion problem by exploiting its latent low-rank structure and sparse noise property. To solve this optimization problem, we design a highly efficient optimization method that combines the alternating direction method of multipliers and accelerated proximal gradient to minimize the tensor’s convex surrogate and noise’s ℓ1-norm. In addition to testing our method by a synthetic dataset, we also use passive RFID (radiofrequency identification) sensors to build a real-world sensor-array testbed, which generates overall 115,200 sensor readings for model evaluation. The experimental results demonstrate the accuracy and robustness of our approach.
AB - With the booming of the Internet of Things, tremendous amount of sensors have been installed in different geographic locations, generating massive sensory data with both time-stamps and geo-tags. Such type of data usually have shown complex spatio-temporal correlation and are easily missing in practice due to communication failure or data corruption. In this paper, we aim to tackle the challenge-how to accurately and efficiently recover the missing values for corrupted spatio-temporal sensory data. Specifically, we first formulate such sensor data as a high-dimensional tensor that can naturally preserve sensors’ both geographical and time information, thus we call spatio-temporal Tensor. Then we model the sensor data recovery as a low-rank robust tensor completion problem by exploiting its latent low-rank structure and sparse noise property. To solve this optimization problem, we design a highly efficient optimization method that combines the alternating direction method of multipliers and accelerated proximal gradient to minimize the tensor’s convex surrogate and noise’s ℓ1-norm. In addition to testing our method by a synthetic dataset, we also use passive RFID (radiofrequency identification) sensors to build a real-world sensor-array testbed, which generates overall 115,200 sensor readings for model evaluation. The experimental results demonstrate the accuracy and robustness of our approach.
UR - http://www.scopus.com/inward/record.url?scp=85032300663&partnerID=8YFLogxK
U2 - 10.1007/978-3-319-55753-3_38
DO - 10.1007/978-3-319-55753-3_38
M3 - Conference proceeding contribution
AN - SCOPUS:85032300663
SN - 9783319557526
T3 - Lecture Notes in Computer Science
SP - 607
EP - 622
BT - Database Systems for Advanced Applications
A2 - Candan, Selçuk
A2 - Chen, Lei
A2 - Bach Pedersen, Torben
A2 - Chang, Lijun
A2 - Hua, Wen
PB - Springer, Springer Nature
CY - Cham, Switzerland
T2 - 22nd International Conference on Database Systems for Advanced Applications, DASFAA 2017
Y2 - 27 March 2017 through 30 March 2017
ER -