Automated rating of patient and physician emotion in primary care visits
Recommended Citation
Park J, Jindal A, Kuo P, Tanana M, Lafata JE, Tai-Seale M, Atkins DC, Imel ZE, and Smyth P. Automated rating of patient and physician emotion in primary care visits. Patient Educ Couns 2021.
Document Type
Article
Publication Date
1-7-2021
Publication Title
Patient education and counseling
Abstract
OBJECTIVE: Train machine learning models that automatically predict emotional valence of patient and physician in primary care visits.
METHODS: Using transcripts from 353 primary care office visits with 350 patients and 84 physicians (Cook, 2002 [1], Tai-Seale et al., 2015 [2]), we developed two machine learning models (a recurrent neural network with a hierarchical structure and a logistic regression classifier) to recognize the emotional valence (positive, negative, neutral) (Posner et al., 2005 [3]) of each utterance. We examined the agreement of human-generated ratings of emotional valence with machine learning model ratings of emotion.
RESULTS: The agreement of emotion ratings from the recurrent neural network model with human ratings was comparable to that of human-human inter-rater agreement. The weighted-average of the correlation coefficients for the recurrent neural network model with human raters was 0.60, and the human rater agreement was also 0.60.
CONCLUSIONS: The recurrent neural network model predicted the emotional valence of patients and physicians in primary care visits with similar reliability as human raters.
PRACTICE IMPLICATIONS: As the first machine learning-based evaluation of emotion recognition in primary care visit conversations, our work provides valuable baselines for future applications that might help monitor patient emotional signals, supporting physicians in empathic communication, or examining the role of emotion in patient-centered care.
PubMed ID
33468364
ePublication
ePub ahead of print
