Browse by author
Lookup NU author(s): Dr Quoc Vuong
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (CC BY-NC-ND).
A great deal of perceptual and social information is conveyed by facial motion. Here, we investigated observers' sensitivity to the complex spatio-temporal information in facial expressions and what cues they use to judge the similarity of these movements. We motion-captured four facial expressions and decomposed them into time courses of semantically meaningful local facial actions (e.g., eyebrow raise). We then generated approximations of the time courses which differed in the amount of information about the natural facial motion they contained, and used these and the original time courses to animate an avatar head. Observers chose which of two animations based on approximations was more similar to the animation based on the original time course. We found that observers preferred animations containing more information about the natural facial motion dynamics. To explain observers' similarity judgments, we developed and used several measures of objective stimulus similarity. The time course of facial actions (e.g., onset and peak of eyebrow raise) explained observers' behavioral choices better than image-based measures (e.g., optic flow). Our results thus revealed observers' sensitivity to changes of natural facial dynamics. Importantly, our method allows a quantitative explanation of the perceived similarity of dynamic facial expressions, which suggests that sparse but meaningful spatio-temporal cues are used to process facial motion. (C) 2014 The Authors. Published by Elsevier Ltd.
Author(s): Dobs K, Bulthoff I, Breidt M, Vuong QC, Curio C, Schultz J
Publication type: Article
Publication status: Published
Journal: Vision Research
Year: 2014
Volume: 100
Pages: 78-87
Print publication date: 28/04/2014
Online publication date: 28/04/2014
Date deposited: 19/08/2014
ISSN (print): 0042-6989
ISSN (electronic): 1878-5646
Publisher: Pergamon Press
URL: http://dx.doi.org/10.1016/j.visres.2014.04.009
DOI: 10.1016/j.visres.2014.04.009
Altmetrics provided by Altmetric
