On automating basic data curation tasks

Seyed Mehdi Reza Beheshti, Alireza Tabebordbar, Boualem Benatallah, Reza Nouri

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

22 Citations (Scopus)
140 Downloads (Pure)

Abstract

Big data analytics is firmly recognized as a strategic priority for modern enterprises. At the heart of big data analytics lies the data curation process, consists of tasks that transform raw data (unstructured, semi-structured and structured data sources) into curated data, i.e. contextualized data and knowledge that is maintained and made available for use by end-users and applications. To achieve this, the data curation process may involve techniques and algorithms for extracting, classifying, linking, merging, enriching, sampling, and the summarization of data and knowledge. To facilitate the data curation process and enhance the productivity of researchers and developers, we identify and implement a set of basic data curation APIs and make them available as services to researchers and developers to assist them in transforming their raw data into curated data. The curation APIs enable developers to easily add features - such as extracting keyword, part of speech, and named entities such as Persons, Locations, Organizations, Companies, Products, Diseases, Drugs, etc.; providing synonyms and stems for extracted information items leveraging lexical knowledge bases for the English language such as WordNet; linking extracted entities to external knowledge bases such as Google Knowledge Graph and Wikidata; discovering similarity among the extracted information items, such as calculating similarity between string and numbers; classifying, sorting and categorizing data into various types, forms or any other distinct class; and indexing structured and unstructured data - into their data applications. These services can be accessed via a REST API, and the data is returned as a JSON file that can be integrated into data applications. The curation APIs are available as an open source project on GitHub.

Original languageEnglish
Title of host publicationProceedings of the 26th International Conference on World Wide Web Companion , WWW 2017 Companion
PublisherInternational World Wide Web Conferences Steering Committee
Pages165-169
Number of pages5
ISBN (Electronic)9781450349147
DOIs
Publication statusPublished - 1 Jan 2019
Externally publishedYes
Event26th International World Wide Web Conference, WWW 2017 Companion - Perth, Australia
Duration: 3 Apr 20177 Apr 2017

Conference

Conference26th International World Wide Web Conference, WWW 2017 Companion
CountryAustralia
CityPerth
Period3/04/177/04/17

Bibliographical note

Copyright the International World Wide Web Conference Committee (IW3C2) 2017. Version archived for private and non-commercial use with the permission of the author/s and according to publisher conditions. For further rights please contact the publisher.

Keywords

  • Big data analytics
  • Curation API
  • Data curation

Fingerprint

Dive into the research topics of 'On automating basic data curation tasks'. Together they form a unique fingerprint.

Cite this