EAI Pervasive Health paper on design requirements for conversational agents

We reviewed Amazon Skill user reviews to understand usability and design requirements for designing health-supporting conversational agents. The paper will be published at EAI Pervasive Health 2020. Here’s a link to the paper–due to COVID-19, the conference has been postponed, and the organizers allowed us to publish our camera ready version without the copyright block added.

JY. Shin, J. Huh-Yoo, Designing Everyday Conversational Agents for Managing Health and Wellness: A Study of Alexa Skills Review, in: EAI Pervasive Health, 2020. In Press

CSCW 2020 paper on IRB members’ perception of risk towards digital research data

In this paper, we discuss our interview results with Institutional Review Board (IRB) members in the U.S. on their perceptions on risks towards digital research data. The paper has been accepted with minor revision for ACM CSCW 2020 to be held this September. More detail will follow later.

J. Huh-Yoo, E. Rader, It’s the Wild, Wild, West: Lessons Learned From IRB Members’ Risk Perceptions Toward Digital Research Data, in: ACM CSCW, 2020. 

A book chapter on ‘Design for improved workflow’

Mustafa, Blaine, Sunyoung, and I wrote a chapter on Design for Improved Workflow as part of Design for Health: Applications of Human Factors, published by Elsevier.


Workflow is a commonly used term in human factors and informatics literature. We embraced a broad definition and used it as a concept to examine various work phenomena. This chapter aims to discuss how design can improve workflow in health settings and eventually make care delivery patient-centered and safer. In general, design studies can improve workflow in two different ways: (1) the overall workflow and (2) interventions that would improve workflow. We highlighted two design approaches: user-centered design and participatory. These are two closely related approaches that engage (to varying degrees) targeted users along a continuum of participation to improve usability. For each of the three informatics subfields (clinical, public health, and consumer health), we provide relevant examples from studies, where users were engaged in the design process. We have identified whether the notion of workflow was formally addressed and gave examples of how workflow methodology might complement user-centered and participatory design efforts in clinical, public health, and consumer health informatics research. Although user-centered design includes a variety of methods, we introduced contextual inquiry and participatory design. These designs demonstrated two key distinctive features of user-centered design: the importance of understanding the holistic context of users’ social, technical, and cultural environments; and engaging users as codesigners. We deepen our discussion through a case that focuses on supporting patient engagement for improved intra- and cross-institutional workflow in an emergency department. Design studies that involve multidisciplinary perspectives are necessary to improve workflow that contributes to safer, higher quality, and more accessible care delivery.


Paper accepted at JMIR Formative Research

Our interview study of students’ mental wellbeing challenges and brainstorming design solutions has been accepted at JMIR Formative Research.

S. Park, N. Andalibi, Y. Zou, S. Ambulkar,  J. Huh-Yoo.  Understanding Students’ Mental Wellbeing Challenges on University Campus: An Interview Study. Journal of Medical Internet Research Formative Research (25% acceptance rate). (2020). In Press.

FamilyLog: Monitoring Family Mealtime Activities by Mobile Devices

Paper Presents empirical evaluation of using lightweight signal features from a set of complex activities during the meal (e.g., clattering sound, arm gestures of eating, human voice, TV sound) and fusing built-in sensor data of multiple mobile devices available in a family with a CRFs-based classifier.

Abstract. Monitoring the family mealtime activities enables the analysis of the previous daily routine, hence the positive changes can be made towards better relationships among family members and better physical/mental health. Moreover, the details of family mealtime activities provide important information for study in sociology and culture. This paper presents FamilyLog — a practical system to log family mealtime activities using smartphones and smartwatches. FamilyLog automatically detects and logs details of activities during the mealtime, including occurrence and duration of meal, conversations, participants, TV viewing etc., in an unobtrusive manner. Based on the sensor data collected from real families, we carefully design robust yet lightweight signal features from a set of complex activities during the meal, including clattering sound, arm gestures of eating, human voice, TV sound, etc. Moreover, FamilyLog opportunistically fuses data from built-in sensors of multiple mobile devices available in a family with a CRFs-based classifier. To evaluate the real-world performance of FamilyLog, we perform extensive experiments that consist of 77 days of sensor data from 37 subjects in 8 families with children. FamilyLog can detect those events with high accuracy across different families and home environments.

Bi C, Xing G, Hao T, Huh J, Peng W, Ma M, Chang X. FamilyLog: Monitoring Family Mealtime Activities by Mobile Devices. IEEE Transactions on Mobile Computing. 2019 May 14.