VR and EEG Based Virtual Travel
Ahmed Abdulaziz Computer Engineering Student
Hussain Mohammed Computer Engineering Student
Sayed Ahmed Majed Computer Engineering Student
Supervised By: Dr. Riyadh Al Hakim Assistant Professor
Virtual travel, a new form of travel that has arisen with virtual reality ( technology, which allows a person to examine new locations using media such as 360360°images and videos Nevertheless, these media lacks interactivity of physical human interactions with the surroundings In this project an affordable, intuitive, and real time virtual travel system have been built using Samsung Gear VR headset, Neurosky Mindwave Mobile electroencephalogram ( headset a custom made Raspberry Pi controlled robot car with video camera, Unity game engine, Ionic framework, Microsoft Azure, and Amazon Web Services The system has been tested and validated to be an effective prototype that enable users to control the video streaming robot remotely and navigate a realistic VR environment all using EEG signals with 92 accuracy Using cloud services as a platform, the system has exceptional scalability and high network responsivity.
The purpose of this project it to develop a consumer friendly, intuitive system capable of constructing virtual environments that can be navigated using a virtual reality headset and an electroencephalogram brain computer interface Virtual travel is an efficient and immersive form of travel, which can be beneficial for physically challenged people, for traversing hazardous locations, and even as an affordable alternative to regular tourism.
The system was tested on ten participants between the age of fifteen and forty five All of the subsystems have met the requirements successfully To elaborate, the EEG classification has achieved an average accuracy of over ninety percent using binary support vector machine algorithm The VR and companion applications runs flawlessly, and the live video streaming from the robot car have a low latency suitable for VR content consumption.
Conclusion and Future Work
In this project, a novel VR/EEG mixed brain computer interface is implemented with two possible virtual tour construction modes Static mode uses realistic 360360°images, while live mode uses live video stream from a robot car at a remote location In the testing sessions, most of the participants were able to navigate comfortably Future work will concentrate on optimizing the brain activity detection techniques and efficient deployment of robot cars.