This paper documents the design and play-testing of a videogame that incorporates electroencephalography (EEG) technology to augment traditional controls. A survival horror game was created using Unity3D. The player navigates the game using conventional keyboard and mouse movement, however, they also wear an Emotiv EPOC headset that transmits their level of calm to the game via OSC. In order to complete the game, the player must remain as calm as possible. An adaptive audio engine was developed to act as an auditory display for this complex parameter in lieu of a distracting visual indicator. Every element of the audio was designed to adapt to the constantly fluctuating value. Procedural audio modules were created in Max, where player EEG data was simultaneously mapped to a myriad of modulators. FMOD Studio was used for non-procedural elements due to its facilitation of real-time control parameters, as well as its integration with Unity3D.
(See document for exact affiliation information.)
https://aes2.org/publications/elibrary-page/?id=18676
(879KB)
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member Join the AES. If you need to check your member status, login to the Member Portal.
