The Interspeech 2024 TAUKADIAL Challenge: Multilingual Mild Cognitive Impairment Detection with Multimodal Approach

  • Benjamin Barrera-Altuna
  • , Daeun Lee
  • , Zaima Zarnaz
  • , Jinyoung Han
  • , Seungbae Kim

Research output: Contribution to journalConference articlepeer-review

3 Scopus citations

Abstract

Mild cognitive impairment (MCI) and dementia significantly impact millions worldwide and rank as a major cause of mortality. Since traditional diagnostic methods are often costly and result in delayed diagnoses, many efforts have been made to propose automatic detection approaches. However, most methods focus on monolingual cases, limiting the scalability of their models to individuals speaking different languages. To understand the common characteristics of people with MCI speaking different languages, we propose a multilingual MCI detection model using multimodal approaches that analyze both acoustic and linguistic features. It outperforms existing machine learning models by identifying universal MCI indicators across languages. Particularly, we find that speech duration and pauses are crucial in detecting MCI in multilingual settings. Our findings can potentially facilitate early intervention in cognitive decline across diverse linguistic backgrounds.

Original languageEnglish
Pages (from-to)967-971
Number of pages5
JournalProceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
DOIs
StatePublished - 2024
Event25th Interspeech Conferece 2024 - Kos Island, Greece
Duration: 1 Sep 20245 Sep 2024

Keywords

  • Mild Cognitive Impairment detection
  • multilingual processing
  • multimodal feature analysis
  • multimodal machine learning
  • TAUKADIAL Challenge

Fingerprint

Dive into the research topics of 'The Interspeech 2024 TAUKADIAL Challenge: Multilingual Mild Cognitive Impairment Detection with Multimodal Approach'. Together they form a unique fingerprint.

Cite this