Finding Shimi's voice: fostering human-robot communication with music and a NVIDIA Jetson TX2

Richard Savery, Ryan Rose, Gil Weinberg

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

Abstract

We present a novel robotic implementation of an embedded linux system in Shimi, a musical robot companion. We discuss the challenges and benefits of this transition as well as a system and technical overview. We also present a unique approach to robotic gesture generation and a new voice generation system designed for robot audio vocalization of any MIDI file. Our interactive system combines NLP, audio capture and processing, and emotion and contour analysis from human speech input. Shimi ultimately acts as an exploration into how a robot can use music as a driver for human engagement.
Original languageEnglish
Title of host publicationProceedings of the Linux Audio Conference 2019
PublisherStanford University
Pages101-105
Number of pages5
ISBN (Electronic)9780359463879
Publication statusPublished - 2019
Externally publishedYes
EventLinux Audio Conference (17th : 2019) - Stanford University, United States
Duration: 23 Mar 201926 Mar 2019

Conference

ConferenceLinux Audio Conference (17th : 2019)
Country/TerritoryUnited States
Period23/03/1926/03/19

Fingerprint

Dive into the research topics of 'Finding Shimi's voice: fostering human-robot communication with music and a NVIDIA Jetson TX2'. Together they form a unique fingerprint.

Cite this