ALIVE: Avatar Learning Impact assessment for Virtual Environments
DOI:
https://doi.org/10.56198/A6PFYXTWIKeywords:
Human Computer Interaction, Avatars, Virtual RealityAbstract
Currently, accurate representation of physical spaces and, especially, human interactions in Virtual Reality (VR)can often feel clunky, unrealistic and require specialist knowledge and development. Our project explores avatar use through the Unreal Meta Humans tool (an extraordinary new 3D character creation technology), specifically, testing the use of realistic avatars in soft skills training and social interactions. This is a proof-of-concept project to generate ideas that address this gap in knowledge, do fast, low-cost prototyping and user testing to further our understanding of the field. We built and tested the recognition of basic emotions in Meta Humans and cartoon avatars in VR. The aim was to understand whether the realism of the avatar impacts our perception of basic human emotion and the sense of immersion in VR. This work aims to advance the study of artificial social interactions, and guide industry practice.
References
D. Hepperle, C. F. Purps, J. Deuchler, and M. Wölfel, ‘Aspects of visual avatar appearance: self-representation, display type, and uncanny valley’, Vis. Comput., Jun. 2021, doi: 10.1007/s00371-021-02151-0.
J.-L. Lugrin, J. Latt, and M. E. Latoschik, ‘Anthropomorphism and illusion of virtual body ownership’, in Proceedings of the 25th International Conference on Artificial Reality and Telexistence and 20th Eurographics Symposium on Virtual Environments, Goslar, DEU, Oct. 2015, pp. 1–8.
M. Slater and A. Steed, ‘A Virtual Presence Counter’, Presence, vol. 9, no. 5, pp. 413–434, Oct. 2000, doi: 10.1162/105474600566925.
M. E. Latoschik, D. Roth, D. Gall, J. Achenbach, T. Waltemate, and M. Botsch, ‘The effect of avatar realism in immersive social virtual realities’, in Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, New York, NY, USA, Nov. 2017, pp. 1–10. doi: 10.1145/3139131.3139156.
S. Mansour, M. El-Said, C. Rude-Parkins, and J. Nandigam, ‘The Interactive Effect of Avatar Visual Fidelity and Behavioral Fidelity in the Collaborative Virtual Reality Environment on the Perception of Social Interaction’, presented at the 10th WSEAS International Conference on COMMUNICATION, Vouliagemi, Athens, Greece, 2006.
G. Freeman and D. Maloney, ‘Body, Avatar, and Me: The Presentation and Perception of Self in Social Virtual Reality’, Proc. ACM Hum.-Comput. Interact., vol. 4, no. CSCW3, p. 239:1-239:27, Jan. 2021, doi: 10.1145/3432938.
J. N. Bailenson, J. Blascovich, A. C. Beall, and J. M. Loomis, ‘Equilibrium Theory Revisited: Mutual Gaze and Personal Space in Virtual Environments’, Presence Teleoperators Virtual Environ., vol. 10, no. 6, pp. 583–598, Dec. 2001, doi: 10.1162/105474601753272844.
F. Moustafa and A. Steed, ‘A longitudinal study of small group interaction in social virtual reality’, in Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology, New York, NY, USA, Nov. 2018, pp. 1–10. doi: 10.1145/3281505.3281527.
M. Mori, K. F. MacDorman, and N. Kageki, ‘The Uncanny Valley [From the Field]’, IEEE Robot. Autom. Mag., vol. 19, no. 2, pp. 98–100, Jun. 2012, doi: 10.1109/MRA.2012.2192811.
A. Diel and K. F. MacDorman, ‘Creepy cats and strange high houses: Support for configural processing in testing predictions of nine uncanny valley theories’, J. Vis., vol. 21, no. 4, p. 1, Apr. 2021, doi: 10.1167/jov.21.4.1.
M. Mäkäräinen, J. Kätsyri, and T. Takala, ‘Exaggerating Facial Expressions: A Way to Intensify Emotion or a Way to the Uncanny Valley?’, Cogn. Comput., vol. 6, no. 4, pp. 708–721, Dec. 2014, doi: 10.1007/s12559-014-9273-0.
A. W. de Borst and B. de Gelder, ‘Is it the real deal? Perception of virtual characters versus humans: an affective cognitive neuroscience perspective’, Front. Psychol., vol. 6, 2015.
K. Zibrek and R. McDonnell, ‘Social presence and place illusion are affected by photorealism in embodied VR’, in Motion, Interaction and Games, New York, NY, USA, Oct. 2019, pp. 1–7. doi: 10.1145/3359566.3360064.
H. Wang, V. Gaddy, J. R. Beveridge, and F. R. Ortega, ‘Building an Emotionally Responsive Avatar with Dynamic Facial Expressions in Human—Computer Interactions’, Multimodal Technol. Interact., vol. 5, no. 3, Art. no. 3, Mar. 2021, doi: 10.3390/mti5030013.
M. Gonzalez-Franco, A. Steed, S. Hoogendyk, and E. Ofek, ‘Using Facial Animation to Increase the Enfacement Illusion and Avatar Self-Identification’, IEEE Trans. Vis. Comput. Graph., vol. 26, no. 5, pp. 2023–2029, May 2020, doi: 10.1109/TVCG.2020.2973075.
D. Higgins, D. Egan, R. Fribourg, B. Cowan, and R. McDonnell, ‘Ascending from the valley: Can state-of-the-art photorealism avoid the uncanny?’, in ACM Symposium on Applied Perception 2021, New York, NY, USA, Sep. 2021, pp. 1–5. doi: 10.1145/3474451.3476242.
P. Ekman, Pictures of facial affect. Consulting Psychologists Press, 1976.
R. E. Jack and P. G. Schyns, ‘The Human Face as a Dynamic Tool for Social
Communication’, Curr. Biol., vol. 25, no. 14, pp. R621–R634, Jul. 2015, doi: 10.1016/j.cub.2015.05.052.
N. L. Nelson and J. A. Russell ‘Universality Revisited’, Emot. Rev., vol. 5, no. 1, pp. 8–15, Jan. 2013, doi: 10.1177/1754073912457227.
D. A. Sauter and A. H. Fischer, ‘Can perceivers recognise emotions from spontaneous expressions?’, Cogn. Emot., vol. 32, no. 3, pp. 504–515, Apr. 2018, doi: 10.1080/02699931.2017.1320978.
S. Tsotsi, M. H. Kosmidis, and V. P. Bozikas, ‘Improved facial affect recognition in schizophrenia following an emotion intervention, but not training attention-to-facial-features or treatment-as-usual’, Psychiatry Res., vol. 254, pp. 135–142, Aug. 2017, doi: 10.1016/j.psychres.2017.04.038.
Y. Wu et al., ‘Effects of Virtual Human Animation on Emotion Contagion in Simulated Inter-Personal Experiences’, IEEE Trans. Vis. Comput. Graph., vol. 20, no. 4, pp. 626–635, Apr. 2014, doi: 10.1109/TVCG.2014.19.
S. Marcos-Pablos, E. González-Pablos, C. Martín-Lorenzo, L. A. Flores, J. Gómez-García-Bermejo, and E. Zalama, ‘Virtual Avatar for Emotion Recognition in Patients with Schizophrenia: A Pilot Study’, Front. Hum. Neurosci., vol. 10, 2016, Accessed: Jan. 18, 2022. [Online]. Available: https://www.frontiersin.org/article/10.3389/fnhum.2016.00421
Downloads
Published
Conference Proceedings Volume
Section
Categories
License
Copyright (c) 2023 The Immersive Learning Reseach Network
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
The papers in this book comprise the proceedings of the meeting mentioned on the cover and title page. They reflect the authors' opinions and, in the interests of timely dissemination, are published as presented and without change. Their inclusion in this publication does not necessarily constitute endorsement by the editors or the Immersive Learning Research Network.
Contact: publications@immersivelrn.org
