Classification of helpful comments on online suicide watch forums

Ramakanth Kavuluru, Amanda G. Williams, María Ramos-Morales, Laura Haye, Tara Holaday, Julie Cerel

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

33 Scopus citations

Abstract

Among social media websites, Reddit has emerged as a widely used online message board for focused mental health topics including depression, addiction, and suicide watch (SW). In particular, the SW community/subreddit has nearly 40,000 subscribers and 13 human moderators who monitor for abusive comments among other things. Given comments on posts from users expressing suicidal thoughts can be written from any part of the world at any time, moderating in a timely manner can be tedious. Furthermore, Reddit's default comment ranking does not involve aspects that relate to the "helpfulness" of a comment from a suicide prevention (SP) perspective. Being able to automatically identify and score helpful comments from such a perspective can assist moderators, help SW posters to have immediate feedback on the SP relevance of a comment, and also provide insights to SP researchers for dealing with online aspects of SP. In this paper, we report what we believe is the first effort in automatic identification of helpful comments on online posts in SW forums with the SW subreddit as the use-case. We use a dataset of 3000 real SW comments and obtain SP researcher judgments regarding their helpfulness in the contexts of the corresponding original posts. We conduct supervised learning experiments with content based features including n-grams, word psychometric scores, and discourse relation graphs and report encouraging F-scores (≈ 80-90%) for the helpful comment classes. Our results indicate that machine learning approaches can offer complementary moderating functionality for SW posts. Furthermore, we realize assessing the helpfulness of comments on mental health related online posts is a nuanced topic and needs further attention from the SP research community.

Original languageEnglish
Title of host publicationACM-BCB 2016 - 7th ACM Conference on Bioinformatics, Computational Biology, and Health Informatics
Pages32-40
Number of pages9
ISBN (Electronic)9781450342254
DOIs
StatePublished - Oct 2 2016
Event7th ACM Conference on Bioinformatics, Computational Biology, and Health Informatics, ACM-BCB 2016 - Seattle, United States
Duration: Oct 2 2016Oct 5 2016

Publication series

NameACM-BCB 2016 - 7th ACM Conference on Bioinformatics, Computational Biology, and Health Informatics

Conference

Conference7th ACM Conference on Bioinformatics, Computational Biology, and Health Informatics, ACM-BCB 2016
Country/TerritoryUnited States
CitySeattle
Period10/2/1610/5/16

Bibliographical note

Publisher Copyright:
Copyright 2016 ACM.

ASJC Scopus subject areas

  • Software
  • Health Informatics
  • Biomedical Engineering
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'Classification of helpful comments on online suicide watch forums'. Together they form a unique fingerprint.

Cite this