Sizing Up the Troll: A Quantitative Characterization of Moderator-Identified Trolling in an Online Forum

  title={Sizing Up the Troll: A Quantitative Characterization of Moderator-Identified Trolling in an Online Forum},
  author={Mattia Samory and Enoch Peserico},
  journal={Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems},
  • Mattia Samory, E. Peserico
  • Published 2 May 2017
  • Computer Science
  • Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
A few troublemakers often spoil online environments for everyone else. An extremely disruptive type of abuser is the troll, whose malicious activities are relatively non-obvious, and thus difficult to detect and contain -- particularly by automated systems. A growing corpus of qualitative research focuses on trolling, and differentiates it from other forms of abuse; however, its findings are not directly actionable into automated systems. On the other hand, quantitative research uses… 

Figures and Tables from this paper

From Royals to Vegans: Characterizing Question Trolling on a Community Question Answering Website
This paper identifies a set of over 400,000 troll questions on Yahoo Answers aimed to inflame, upset, and draw attention from others on the community, and reveals unique characteristics of troll questions when compared to "regular" questions, with regards to their metadata, text, and askers.
Automatic Identification of Harmful, Aggressive, Abusive, and Offensive Language on the Web: A Survey of Technical Biases Informed by Psychology Literature
This survey aims both at systematically characterizing the conceptual properties of online conflictual languages, and at investigating the extent to which they are reflected in state-of-the-art automatic detection systems.
TrollHunter [Evader]: Automated Detection [Evasion] of Twitter Trolls During the COVID-19 Pandemic
The TrollHunter leverages a unique linguistic analysis of a multi-dimensional set of Twitter content features to detect whether or not a tweet was meant to troll, and employs a Test Time Evasion approach in a combination with a Markov chain-based mechanism to recycle originally trolling tweets.
Anonymity, User Engagement, Quality, and Trolling on Q&A Sites
It is found that highly sensitive questions are more likely to be asked anonymously and allowing anonymity does not affect answer quality and only has a weak, negative indirect effect on engagement.
Mobilizing the Trump Train: Understanding Collective Action in a Political Trolling Community
A quantitative longitudinal analysis of more than 16 million comments from one of the most popular and disruptive political trolling communities, the subreddit /r/The\_Donald (T\D), reveals that the most active employed distinct discursive strategies to mobilize participation, and deployed technical tools like bots to create a shared identity and sustain engagement.
Rethinking Engagement with Online News through Social and Visual Co-Annotation
A mobile app is built that supports co-annotation, in the form of graffiti, on online news articles, which is evaluated in-the-wild for one month and highlights how the re-design of interactive online news experiences can facilitate more directed, "in themoment" critique of online news stories as well as encourage readers to expand the range of news content they read.
Soften the Pain, Increase the Gain
An online experiment to investigate the efficacy of three coping activities for mitigating the influence of negative feedback: self-affirmation, expressive writing, and distraction found that expressive writing encouraged essay revision, distraction improved affective states and feedback provider perception, and self-Affirmation had no significant effects on the measures.


Hunting for Troll Comments in News Community Forums
In this work, two classifiers are built that can distinguish a post by such a paid troll from one by a non-troll with 81-82% accuracy; the same classifier achieves 81- 82% accuracy on so called mentioned troll vs. non-Troll posts.
Do Not Feel The Trolls
The aim of this work is to use sentic computing, a new paradigm for the affective analysis of natural language text, to detect trolls and hence prevent web-users from being emotionally hurt by malicious posts.
“I refuse to respond to this obvious troll":an overview of responses to (perceived) trolling
Computer-mediated communication (CMC) provides many benefits, including quick, efficient communication over time and space. At the same time, however, the anonymity it offers can give a sense of
Beyond vandalism: Wikipedia trolls
It is concluded that Wikipedia trolls are one type of hacker, and boredom, attention seeking, and revenge motivate trolls; they regard Wikipedia as an entertainment venue, and find pleasure from causing damage to the community and other people.
Trolls Identification within an Uncertain Framework
This work proposes a new approach for detecting malicious people also called 'Trolls' in order to allow community managers to take their ability to post online and tries to detect the presence of such malicious users.
“Uh. . . . not to be nitpicky,,,,,but…the past tense of drag is dragged, not drug.”: An overview of trolling strategies
Initial findings suggest that trolling is perceived to broadly fall across a cline with covert strategies and overt strategies at each pole, and a working taxonomy of perceived strategies that occur at different points along this cline is created.
Trolling in asynchronous computer-mediated communication: From user discussions to academic definitions
Abstract Whilst computer-mediated communication (CMC) can benefit users by providing quick and easy communication between those separated by time and space, it can also provide varying degrees of
Antisocial Behavior in Online Discussion Communities
This paper characterize antisocial behavior in three large online discussion communities by analyzing users who were banned from these communities, finding that such users tend to concentrate their efforts in a small number of threads, are more likely to post irrelevantly, and are more successful at garnering responses from other users.
Content attribution ignoring content
This work tackles authorship analysis through features that ignore the explicit content of a contribution -- informally, those that can be computed even if every character in the body of a message (but not metadata such as timing or "likes") is replaced by an X.
Searching for Safety Online: Managing "Trolling" in a Feminist Forum
The analysis suggests that feminist and other nonmainstream online forums are especially vulnerable, in that they must balance inclusive ideals against the need for protection and safety, a tension that can be exploited by disruptive elements to generate intragroup conflict.