KINECTed LIVING is a gesture and speech-controlled system wherein a user can control the lights and fans in a living space. The speech command is responsible for changing the state of the device whereas the gesture aids in identification of the device. Additionally, the users have the choice of performing the same commands with either gesture or speech solely. The devices are controlled centrally via an Arduino Uno board.
Project Proposal: https://drive.google.com/file/d/0B0xFcMduKl4peTYxd0FTR0Z3Mkk/view?usp=sharing
User Study Video: https://www.youtube.com/channel/UC0jodRmObsA_9C3YBVLVRpg
Inspiration from the video: Project by Chris Schmandt (1979),MIT Media Lab Speech Interface group https://www.youtube.com/watch?v=RyBEUyEtxQo&t=1s
Papers: Akos Vetek and Saija Lemmelä. 2011. Could a dialog save your life?: analyzing the effects of speech interaction strategies while driving. In Proceedings of the 13th international conference on multimodal interfaces (ICMI ’11). ACM, New York, NY, USA, 145-152. http://doi.acm.org/10.1145/2070481.2070506