Mobile facial affect recognition and real-time social experiences in serious mental illness

Emma M. Parrish, Jiayi Lin, Vanessa Scott, Amy E. Pinkham, Philip D. Harvey, Raeanne C. Moore, Robert Ackerman, Colin A. Depp

Research output: Contribution to journalArticlepeer-review


Background: Emotion recognition deficits are linked with social dysfunction in psychosis, as is inaccurate self-assessment of emotion recognition abilities. However, little is known about the link between ER and real-time social appraisals and behavior. Methods: In 136 people with psychotic disorders or affective disorder with psychosis we administered a novel ecological momentary cognitive test of emotion recognition which both assesses emotion recognition ability and self-assessed performance in conjunction with ecological momentary assessment of social appraisals, motivation, and time spent alone. Hybrid mixed effects models evaluated emotion recognition's associations with social experiences. Results: Better recognition ability was associated with greater pleasure and more positive appraisals of others during interactions, whereas accuracy of self-assessment of emotion recognition ability was associated with more positive appraisals of interactions and social motivation. Overestimation of emotion recognition was linked with concurrent higher social motivation yet greater desire to avoid others. Time alone was unrelated to emotion recognition ability or self-assessment of ability. Discussion: Mobile emotion recognition performance was associated with appraisals of recent interactions but not behavior. Self-assessment of social cognitive performance was associated with more positive appraisals and social motivation, and may be a novel target for interventions aimed at social dysfunction.

Original languageEnglish (US)
Article number100253
JournalSchizophrenia Research: Cognition
StatePublished - Sep 2022
Externally publishedYes


  • Digital health
  • Ecological momentary assessment
  • Facial affect recognition
  • Mobile cognitive testing
  • Serious mental illness
  • Social motivation

ASJC Scopus subject areas

  • Cognitive Neuroscience
  • Psychiatry and Mental health


Dive into the research topics of 'Mobile facial affect recognition and real-time social experiences in serious mental illness'. Together they form a unique fingerprint.

Cite this