emteqPRO—Fully Integrated Biometric Sensing Array for Non-Invasive Biomedical Research in Virtual Reality

Michal Gnacek, John Broulidakis, Ifigeneia Mavridou, Mohsen Fatoorechi, Ellen Seiss, Theodoros Kostoulas, Emili Balaguer-Ballester, Ivana Kiprijanovska, Claire Rosten, Charles Nduka

Research output: Contribution to journalArticlepeer-review

Abstract

Virtual Reality (VR) enables the simulation of ecologically validated scenarios, which are ideal for studying behaviour in controllable conditions. Physiological measures captured in these studies provide a deeper insight into how an individual responds to a given scenario. However, the combination of the various biosensing devices presents several challenges, such as efficient time synchronisation between multiple devices, replication between participants and settings, as well as managing cumbersome setups. Additionally, important salient facial information is typically covered by the VR headset, requiring a different approach to facial muscle measurement. These challenges can restrict the use of these devices in laboratory settings. This paper describes a solution to this problem. More specifically, we introduce the emteqPRO system which provides an all-in-one solution for the collection of physiological data through a multi-sensor array built into the VR headset. EmteqPRO is a ready to use, flexible sensor platform enabling convenient, heterogenous, and multimodal emotional research in VR. It enables the capture of facial muscle activations, heart rate features, skin impedance, and movement data—important factors for the study of emotion and behaviour. The platform provides researchers with the ability to monitor data from users in real-time, in co-located and remote set-ups, and to detect activations in physiology that are linked to arousal and valence changes. The SDK (Software Development Kit), developed specifically for the Unity game engine enables easy integration of the emteqPRO features into VR environments.

Code available at: (https://github.com/emteqlabs/emteqvr-unity/releases)
Original languageEnglish
Article number781218
Number of pages17
JournalFrontiers in Virtual Reality
Volume3
DOIs
Publication statusPublished - 11 Mar 2022

Bibliographical note

Funding Information:
This work is supported by Bournemouth University and Emteq ltd. via the Centre for Digital Entertainment (EPSRC Grant No. EP/L016540/1). This work was also partially funded by the NIHR Invention for Innovation (i4i) Programme (Grant No. NIHR201283).

Publisher Copyright:
Copyright © 2022 Gnacek, Broulidakis, Mavridou, Fatoorechi, Seiss, Kostoulas, Balaguer-Ballester, Kiprijanovska, Rosten and Nduka.

Keywords

  • Digital Health
  • Virtual reality

Fingerprint

Dive into the research topics of 'emteqPRO—Fully Integrated Biometric Sensing Array for Non-Invasive Biomedical Research in Virtual Reality'. Together they form a unique fingerprint.

Cite this