Published April 21, 2022 | Version v1
Journal article Open

Deep models of superficial face judgments

  • 1. Princeton University
  • 2. University of Chicago
  • 3. Stevens Institute of Technology

Description

The diversity of human faces and the contexts in which they appear gives rise to an expansive stimulus space over which people infer psychological traits (e.g., trustworthiness or alertness) and other attributes (e.g., age or adiposity). Machine learning methods, in particular deep neural networks, provide expressive feature representations of face stimuli, but the correspondence between these representations and various human attribute inferences is difficult to determine because the former are high-dimensional vectors produced via black-box optimization algorithms. Here we combine deep generative image models with over 1 million judgments to model inferences of more than 30 attributes over a comprehensive latent face space. The predictive accuracy of our model approaches human interrater reliability, which simulations suggest would not have been possible with fewer faces, fewer judgments, or lower-dimensional feature representations. Our model can be used to predict and manipulate inferences with respect to arbitrary face photographs or to generate synthetic photorealistic face stimuli that evoke impressions tuned along the modeled attributes.

Data availability

The One Million Impressions dataset and all behavioral judgments and synthesized images have been deposited in a GitHub repository (https://github.com/jcpeterson/omi.

Files

Deep-models-of-superficial-face-judgments.pdf

Files (32.6 MB)

Name Size Download all
Article
md5:98cc4e9bc26c2ca40bff4b163578aba3
1.6 MB Preview Download
Supporting information
md5:451f2b574acbcb68603ae9b45f5cd4e4
31.0 MB Preview Download

Additional details

Identifiers

DOI
10.1073/pnas.2115228119
Other
oai:uchicago.tind.io:9144

Funding

University of Chicago
Booth School of Business Richard N. Rosett Faculty Fellowship
Princeton University
Dean for Research Innovation Fund for New Ideas in the Natural Sciences

UChicago Information

Division(s)
Booth School of Business
Department(s)
Behavioral Science