"I know my data doesn’t leave my phone, but still feel like being wiretapped": Understanding (Mis)Perceptions of On-Device AI Vishing Detection Apps

Subin Park, Hyungjun Yoon, Janu Kim, Hyoungshick Kim, Sung Ju Lee

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Vishing, or voice phishing, is a growing global threat exploiting calls to steal sensitive information or money. While on-device AI apps offer promising solutions for real-time vishing detection by analyzing the content of phone conversations, little is known about user perspectives on these tools. To address this gap, we conducted a study with 30 participants using a prototype app featuring on-device AI for speech recognition and vishing detection. We found negligible impacts of on-device AI vishing detection models on smartphone usage satisfaction, but user interviews revealed persistent privacy concerns. Despite the system’s use of on-device AI to ensure data security, some participants reported feeling “being wiretapped.” These findings highlight the need to design privacy-preserving on-device AI solutions and improve user understanding to encourage widespread adoption.

Original languageEnglish
Title of host publicationCHI EA 2025 - Extended Abstracts of the 2025 CHI Conference on Human Factors in Computing Systems
PublisherAssociation for Computing Machinery
ISBN (Electronic)9798400713958
DOIs
StatePublished - 26 Apr 2025
Event2025 CHI Conference on Human Factors in Computing Systems, CHI EA 2025 - Yokohama, Japan
Duration: 26 Apr 20251 May 2025

Publication series

NameConference on Human Factors in Computing Systems - Proceedings

Conference

Conference2025 CHI Conference on Human Factors in Computing Systems, CHI EA 2025
Country/TerritoryJapan
CityYokohama
Period26/04/251/05/25

Keywords

  • On-Device AI
  • Usable Security
  • User Perceptions
  • Vishing

Fingerprint

Dive into the research topics of '"I know my data doesn’t leave my phone, but still feel like being wiretapped": Understanding (Mis)Perceptions of On-Device AI Vishing Detection Apps'. Together they form a unique fingerprint.

Cite this