Skip to content

Advanced User Interfaces project - Emanuele Torelli, Francesco Vona - Politecnico di Milano AA 2017-2018; Master thesis project - Emanuele Torelli - Politecnico di Milano AA 2018-2019

License

mennetorelli/HoloLearn

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

HoloLearn

HoloLearn is a new way of learning. Thanks to the potential that Mixed Reality and Microsoft HoloLens offer us, we want to help people with cognitive disability to learn some things that we take for granted. HoloLearn aims to improve the autonomy of people with cognitive disability in a domestic environment, and to be a useful tool for therapists and tutors who follow them. The two features currently implemented are laying a table and doing the garbage collection. In the first activity the device scans the surroundings to identify a table and then puts holographic cutlery on it; by means of the gestures provided by HoloLens the user must move the cutlery from one position to another to obtain a table properly set. In the second task the user must put some holographic waste into the correct bin. Several levels and settings are available for each task, so that the therapist can choose the configuration that is most suited for the user. In addition to the tasks, it’s possible to exploit a virtual assistant (a holographic minion), which helps the user if he doesn’t know how to act. The application is built in C# with Unity and Visual Studio.

Publications

  • Beatrice Aruanno, Franca Garzotto, Emanuele Torelli, and Francesco Vona. 2018. HoloLearn: Wearable Mixed Reality for People with Neurodevelopmental Disorders (NDD). In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '18). ACM, New York, NY, USA, 40-51. DOI: https://doi.org/10.1145/3234695.3236351
  • F. Garzotto, E. Torelli, F. Vona and B. Aruanno, "HoloLearn: Learning through Mixed Reality for People with Cognitive Disability," 2018 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), Taichung, Taiwan, 2018, pp. 189-190. doi: https://doi.org/10.1109/AIVR.2018.00042

Screenshots

About

Advanced User Interfaces project - Emanuele Torelli, Francesco Vona - Politecnico di Milano AA 2017-2018; Master thesis project - Emanuele Torelli - Politecnico di Milano AA 2018-2019

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published