Robot gesture sonification to enhance awareness of robot status and enjoyment of interaction

Lisa Zahray, Richard Savery, Liana Syrkett, Gil Weinberg

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

18 Citations (Scopus)

Abstract

We present a divergent approach to robotic sonification with the goal of improving the quality and safety of human-robot interactions. Sonification (turning data into sound) has been underutilized in robotics, and has broad potential to convey robotic movement and intentions to users without requiring visual engagement. We design and evaluate six different sonifications of movements for a robot with four degrees of freedom. Our sonification techniques include a direct mapping from each degree of freedom to pitch and timbre changes, emotion-based sound mappings, and velocity-based mappings using different types of sounds such as motors and music. We evaluate these sonifications using metrics for ease of use, enjoyment/appeal, and conveyance of movement information. Based on our results, we make recommendations to inform decisions for future robot sonification design. We suggest that when using sonification to improve safety of human-robot collaboration, it is necessary not only to convey sufficient information about movements, but also to convey that information in a pleasing and even social way to to enhance the human-robot relationship.
Original languageEnglish
Title of host publication2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN 2020)
Subtitle of host publicationRobots with heart, mind, and soul
Place of PublicationPiscataway, USA
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages978-985
Number of pages8
ISBN (Electronic)9781728160757
DOIs
Publication statusPublished - Aug 2020
Externally publishedYes
EventIEEE International Conference on Robot and Human Interactive Communication (29th : 2020) - online
Duration: 31 Aug 20204 Sept 2020

Conference

ConferenceIEEE International Conference on Robot and Human Interactive Communication (29th : 2020)
Abbreviated titleRO-MAN 2020
Period31/08/204/09/20

Fingerprint

Dive into the research topics of 'Robot gesture sonification to enhance awareness of robot status and enjoyment of interaction'. Together they form a unique fingerprint.

Cite this