Historical data storage for large scale sensor networks

Loïc Petit*, Abdelhamid Nafaa, Raja Jurdak

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

7 Citations (Scopus)

Abstract

Wireless sensor networks are rapidly finding their way through a plethora of new applications like precision farming and forestry, with increasing network scale, system complexity, and data rate. While scalable MAC and routing protocols for sensor networks have been well addressed in recent years, the scalability of the back-end storage architecture has been largely overlooked. As a result, current storage and retrieval architectures usually lead to an excessive I/O cost when it comes to improving the scalability and responsiveness of the system. In this paper, we present a scalable backend storage and retrieval architecture to support very large volumes of real-time measurements from wireless sensor networks. In particular, our contribution provides: (i) a database partitioning and structuring scheme coupled with a double-buffering technique to reduce the end-to-end delay while minimizing the processing power, and (ii) an optimized historical measurement data query format tailored for superior performance in terms of data retrieval responsiveness. Through a realistic emulator for large scale sensor network, we evaluate this storage and retrieval system to illustrates its delay and I/O benefits in both high and low traffic rate scenarios. The evaluation guides our design of an adaptive design, that applies batch insert method for smaller deployments to reduce insertion delay, and double-buffering for larger deployments to reduce I/O cost and avoid saturation, at the cost of higher delay.

Original languageEnglish
Title of host publicationProceedings of the 5th French-Speaking Conference on Mobility and Ubiquity Computing, UbiMob '09
Place of PublicationNew York
PublisherAssociation for Computing Machinery (ACM)
Pages45-52
Number of pages8
Volume394
ISBN (Print)9781605586229
DOIs
Publication statusPublished - 2009
Externally publishedYes
Event5th French-Speaking Conference on Mobility and Ubiquity Computing, UbiMob '09 - Lille, France
Duration: 7 Jul 20098 Jul 2009

Other

Other5th French-Speaking Conference on Mobility and Ubiquity Computing, UbiMob '09
Country/TerritoryFrance
CityLille
Period7/07/098/07/09

Keywords

  • database partitioning
  • double-buffer
  • historical storage
  • sensor

Fingerprint

Dive into the research topics of 'Historical data storage for large scale sensor networks'. Together they form a unique fingerprint.

Cite this