Young-Adult Multimodal Attachment Style Classification: Multimodal Attachment Style Classification Model Based on Non-Verbal Signals

Research output: Contribution to journalArticlepeer-review

Abstract

Attachment systems, representing emotional bonds with significant others, have emerged as an important aspect of psychology that influences self-development and social interactions. Adult attachment studies in psychology have mostly relied on questionnaires and interviews, primarily centered on romantic relationships and parent-child dynamics during childhood. In machine learning-based adult attachment studies, the assessment of objective aspects of non-verbal behaviors is also investigated, but how these behavioral characteristics are associated with attachment remains unexplored. This paper introduces a new multimodal model for attachment style classification, focusing on close relationships established within young adults. Our proposed model integrates representations of emotions derived from non-verbal behaviors alongside subjective responses to classify attachment styles. Leveraging pre-trained Swin Transformers for capturing emotion associations in facial expression videos and pre-trained ResNet50 for analyzing speech responses, we fuse the best emotion representations from both datasets with rating data from the Experiences in Close Relationships - Relationship Structures (ECR-RS) for attachment style classification. The experimental results demonstrate that the proposed model enhances the performance of unimodal behavioral data and subjective questionnaire responses by 1.13%.

Original languageEnglish
Pages (from-to)1
Number of pages1
JournalIEEE Access
Volume12
DOIs
Publication statusAccepted/In press - 2024

Keywords

  • Analytical models
  • Attachment
  • Classification algorithms
  • emotion
  • Emotion recognition
  • facial expression
  • Feature extraction
  • Heart rate variability
  • Hidden Markov models
  • Interviews
  • machine learning
  • multimodal
  • speech
  • Speech analysis
  • Transformers
  • Videos

Fingerprint

Dive into the research topics of 'Young-Adult Multimodal Attachment Style Classification: Multimodal Attachment Style Classification Model Based on Non-Verbal Signals'. Together they form a unique fingerprint.

Cite this