Supporting healthy grocery shopping via mobile augmented reality

Junho Ahn, James Williamson, Mike Gartrell, Richard Han, Qin Lv, Shivakant Mishra*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

63 Citations (Scopus)


Augmented reality (AR) applications have recently become popular on modern smartphones. We explore the effectiveness of this mobile AR technology in the context of grocery shopping, in particular as a means to assist shoppers in making healthier decisions as they decide which grocery products to buy. We construct an AR-assisted mobile grocery-shopping application that makes real-time, customized recommendations of healthy products to users and also highlights products to avoid for various types of health concerns, such as allergies to milk or nut products, low-sodium or low-fat diets, and general caloric intake. We have implemented a prototype of this AR-assisted mobile grocery shopping application and evaluated its effectiveness in grocery store aisles. Our application's evaluation with typical grocery shoppers demonstrates that AR overlay tagging of products reduces the search time to find healthy food items, and that coloring the tags helps to improve the user's ability to quickly and easily identify recommended products, as well as products to avoid. We have evaluated our application's functionality by analyzing the data we collected from 15 in-person actual grocery-shopping subjects and 104 online application survey participants.

Original languageEnglish
Article number16
Number of pages24
JournalACM Transactions on Multimedia Computing, Communications and Applications
Issue number1S
Publication statusPublished - Oct 2015
Externally publishedYes


  • Augmented reality
  • Grocery shopping
  • Mobile health
  • Nutrition
  • Recommendation


Dive into the research topics of 'Supporting healthy grocery shopping via mobile augmented reality'. Together they form a unique fingerprint.

Cite this