Manipulating molecules: using Kinect for immersive learning in chemistry

Ian M. Jamie, Christopher R. McRae

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contribution


An element of "play" is an essential condition for deep learning to occur. Play is more than simply having a good time; it is about working out rules, understanding constraints, being absorbed by novelty, using imagination and innovating. It is also about extending, modifying and augmenting learning activities. This project brings an overt element of play to the representation of fundamental chemical concepts and thus engages students more strongly in the learning process. The Microsoft Kinect™ gesture recognition video game device enable users to control and interact with the "game" through a "natural user interface" by using hand and whole body movement and through spoken commands. This project brings together the play element of the Kinect technology with the virtual reality immersive environment of molecular structure by constructing a molecular manipulation "game" for use in tutorials, lectures and the home. The project will focus on developing the human gesture interface (HGI) for the manipulation of molecular structures, initially using the standard JMOL/PDB format, which will result in a system that can be used with monitors, data projectors and smart whiteboards. It may be used in lectures, tutorials and by students at home.
Original languageEnglish
Title of host publicationProceedings of The Australian Conference on Science & Mathematics Education 2011
EditorsManjula Sharma, Alexandra Yeung
Place of PublicationMelbourne
PublisherUniversity of Melbourne
Number of pages1
ISBN (Print)9780987183408
Publication statusPublished - 2011
EventAnnual UniServe Science Conference (17th : 2011) - Melbourne
Duration: 28 Sep 201130 Sep 2011


ConferenceAnnual UniServe Science Conference (17th : 2011)


  • immersive learning
  • play
  • visualisation
  • chemistry
  • technology

Fingerprint Dive into the research topics of 'Manipulating molecules: using Kinect for immersive learning in chemistry'. Together they form a unique fingerprint.

Cite this