Lessons learned for online health community moderator roles: A mixed methods study of moderators resigning from WebMD communities

Our mixed methods paper on examining what happened when all staff moderators left WebMD online health communities in 2013 has been accepted to the Journal of Medical Internet Research!

Jina Huh, Rebecca Marmor, and Xiaoqian Jiang. 2016. Lessons Learned for Online Health Community Moderator Roles: A Mixed-Methods Study of Moderators Resigning From WebMD Communities. Journal of medical Internet research 18, 9: e247. http://doi.org/10.2196/jmir.6331 [pdf]

Abstract:

Background: Online health community (OHC) moderators help facilitate conversations and provide information to members. However, the necessity of the moderator in helping members achieve goals in receiving the support they need remains unclear, with some prior research suggesting that moderation is unnecessary or even harmful for close-knit OHCs. Similarly, members’ perceptions of moderator roles are underexplored. Starting January of 2013, WebMD moderators stopped working for WebMD communities. This event provided an opportunity for us to study the perceived role of moderators in OHCs.

Objective: We examine OHC members’ perception of OHC moderators by studying their reactions towards the departure of moderators in their communities. We also analyzed the relative posting activity on OHCs before and after the departure of moderators from the communities among all members and those who discussed moderators’ departures.

Methods: We applied mixed methods to studying all 55 moderated WebMD communities’ posts by querying terms relating to discussions surrounding moderators’ disappearance from the WebMD community. We performed open and axial coding and affinity diagramming to thematically analyze patients’ reactions to disappeared moderators. We analyzed the number of posts and poster groups (members and moderators) over time to understand posting patterns around moderators’ departure.

Results: From 821 posts under 95 threads retrieved, a total of 166 open codes were generated. The codes were then grouped into two main themes with six total sub-themes. First, patients attempted to understand why moderators had left and what could be done to fill the void of the missing moderators. During these discussions, the posts revealed that patients believed moderators played critical roles in the communities by: making the communities vibrant and healthy, finding solutions, and giving medical information. Some patients felt personally tied with moderators, expressing they would cease their community participation. Patients also indicated that moderators were not useful or sometimes even harmful for peer interactions. The overall community’s posting activity analysis showed no significant difference before and after the moderators’ departure. The overall posting activities of the communities were declining well before the moderators’ departure. This declining posting activities might be the reason WebMD removed the moderators.

Conclusion: Compassionate moderators who provide medical expertise, control destructive member posts, and help answer questions can provide important support for patient engagement in OHCs. Moderators are in general received positively by community members and do not appear to interfere with peer interactions. Members are well aware of the possibility of misinformation spreading in OHCs. Further investigation into the attitudes of less vocal community members should be conducted.