The Anatomy of an intent based search and crawler engine for the Web of Things

Ali Shemshadi*, Quan Z. Sheng, Yongrui Qin

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingChapterpeer-review

1 Citation (Scopus)


Web of Things (WoT) is becoming increasingly interesting for researchers and professionals over the past few years. It provides numerous opportunities by disseminating the data that is generated by physical things and fills the gap between the physical and the virtual world. Despite its importance, WoT search has not been studied enough in the past. Given the dynamic challenge of the WoT, collecting data from WoT resources is not well developed. Furthermore, the effectiveness of WoT search can be significantly improved if the users' intention of the search is also considered. This can be facilitated by knowing the existing status of the WoT in real-world. In this chapter, we address multiple challenges in this area. Firstly, we depict the analytical structure of the future WoT which facilitate crawling, indexing and searching the data from physical things. Secondly, we show how we can identify WoT and extract the data from it. Thirdly, we use our crawler to crawl and analyse WoT data on the Internet. Furthermore, we provide a showcase in the analysis of the flights delay data. Finally, we provide a discussion on future research in this area.

Original languageEnglish
Title of host publicationManaging the Web of Things
Subtitle of host publicationlinking the real world to the web
EditorsQuan Z. Sheng, Yongrui Qin, Lina Yao, Boualem Benatallah
Place of PublicationCambridge, MA
PublisherMorgan Kaufmann Publishers
Number of pages36
ISBN (Electronic)9780128097656
ISBN (Print)9780128097649
Publication statusPublished - 8 Feb 2017


  • Big sata
  • Flight delay
  • Internet of things
  • Search engine
  • Web of things


Dive into the research topics of 'The Anatomy of an intent based search and crawler engine for the Web of Things'. Together they form a unique fingerprint.

Cite this