Ulster University Logo

Voice Driven Virtual Assistant Tutor in Virtual Reality for Electronic and Electrical Engineering Remote Laboratories

Callaghan, MJ, Bengloan, Gildas, Ferrer, Julien, Cherel, Léo, El Mostadi, Mohamed Ali, Gómez Eguíluz, Augusto and McShane, Niall (2017) Voice Driven Virtual Assistant Tutor in Virtual Reality for Electronic and Electrical Engineering Remote Laboratories. In: 15th International Conference on Remote Engineering and Virtual Instrumentation (REV), Duesseldorf, Germany. Springer. 13 pp. [Conference contribution]

[img] Text - Accepted Version
[img] Text (Acceptance email) - Supplemental Material
Indefinitely restricted to Repository staff only.


URL: http://www.rev-conference.org/REV2018/index.php


The first generation of affordable consumer virtual reality headsets and related peripherals are now available. Question-Answering (QA) systems and speech recognition/synthesis has improved dramatically over the last decade. Virtual assistants, based on speech-based services are growing in popularity and can be used in a range of diverse application areas. This paper explores the practical use of virtual reality, IOT and voice driven virtual assistants in remote laboratories to facilitate visualization of electrical phenomena and to tutor students; guiding them through each stage of an experiment; presenting supplementary teaching resources when requested; accessing, controlling and configuring instrumentation and hardware and providing feedback with summative and formative assessment. The re-purposing of existing teaching material for use in an immersive environment with a virtual assistant is shown and the limitations and opportunities offered by the approach taken and the technologies used are discussed. The process of integrating test instrumentation, the board under test, a switching matrix and additional teaching resources into virtual reality using IOT is discussed and the inclusion of virtual assistants described. Two case studies of practical working examples of remote laboratories in virtual reality with a virtual assistant tutor are demonstrated and the viability and long-term opportunities for the use of virtual reality and virtual assistants in the context discussed

Item Type:Conference contribution (Paper)
Keywords:Virtual Reality, IoT, Automatic Question-Answering (QA) systems, speech recognition and synthesis, virtual assistants, voice user interface practical laboratories.
Faculties and Schools:Faculty of Computing & Engineering
Faculty of Computing & Engineering > School of Computing and Intelligent Systems
Research Institutes and Groups:Computer Science Research Institute > Intelligent Systems Research Centre
Computer Science Research Institute
ID Code:39247
Deposited By: Mr Michael Callaghan
Deposited On:04 Jan 2018 13:12
Last Modified:23 Mar 2019 23:23

Repository Staff Only: item control page