The YouTube Lens: Crowdsourced Personality Impressions and Audiovisual Analysis of Vlogs

  title={The YouTube Lens: Crowdsourced Personality Impressions and Audiovisual Analysis of Vlogs},
  author={Joan-Isaac Biel and Daniel G{\'a}tica-P{\'e}rez},
  journal={IEEE Transactions on Multimedia},
Despite an increasing interest in understanding human perception in social media through the automatic analysis of users' personality, existing attempts have explored user profiles and text blog data only. [] Key Result In addition, it constitutes a first attempt to address the task of automatic vlogger personality impression prediction using nonverbal cues, with promising results.

Vlogging Over Time: Longitudinal Impressions and Behavior in YouTube

This study uses online crowdsourcing to collect a rich set of 21 impression variables for each video, including perceived personality, mood, skills, and expertise, and shows that the use of longitudinal data helps to improve the automatic inference of impressions for several of the impression variables.

Hi YouTube!: personality impressions and verbal content in social video

The results show that the analysis of error-free verbal content is useful to predict four of the Big-Five traits, three of them better than using nonverbal cues, and that the errors caused by the ASR system decrease the performance significantly.

What Your Face Vlogs About: Expressions of Emotion and Big-Five Traits Impressions in YouTube

It is shown that while multiple facial expression cues have significant correlation with several of the Big-Five traits, they are only able to significantly predict Extraversion impressions with moderate values of R2.

Hirability in the Wild: Analysis of Online Conversational Video Resumes

A computational framework for the prediction of organizational first impressions was developed, where the inference and nonverbal cue extraction steps were fully automated and results demonstrate automatic prediction of first impressions of up to 27% of the variance explained for extraversion, and up to 20% for social and communication skills.

Inferring mood in ubiquitous conversational video

This paper presents an automatic approach to infer 11 natural mood categories in conversational social video using single and multimodal nonverbal cues extracted from video blogs (vlogs) from YouTube.

Happy and agreeable?: multi-label classification of impressions in social video

Under a multi-label classification framework, it is shown that for both mood and personality trait binary label sets, not only the simultaneous inference of multiple labels is feasible, but also that classification accuracy increases moderately for several labels, compared to a single-label approach.

A Multivariate Regression Approach to Personality Impression Recognition of Vloggers

This paper focuses on predicting how the personality of YouTube video bloggers is perceived by their viewers, and uses audio-video features, as well as textual features extracted from the transcripts of vlogs, to predict the extent to which the video blogger is perceived to exhibit each of the traits of the Big Five personality model.

BookTubing Across Regions: Examining Differences Based on Nonverbal and Verbal Cues

The analysis shows that cultural context and popularity can be inferred to some degree using multimodal fusion of these features of BookTube videos, comparing non-western (Indian) and Western populations.

An Estimation of Online Video User Engagement from Features of Continuous Emotions

It is demonstrated that smaller boundary ranges and fluctuations for arousal lead to an increase in user engagement, and an effective combination of features is outlined for approaches aiming to automatically predict several user engagement indicators.

Hide and Seek: Choices of Virtual Backgrounds in Video Chats and Their Effects on Perception

It is found that virtual background use of any kind results in a consistent "muting effect" that mitigates very high or low ratings compared to the ratings of the video with the original background.



You Are Known by How You Vlog: Personality Impressions and Nonverbal Behavior in YouTube

This paper analyzes one facet of YouTube as a repository of brief behavioral slices in the form of personal conversational vlogs, which are a unique medium for selfpresentation and interpersonal perception and finds significant associations between automatically extracted nonverbal cues for several personality judgments.

VlogSense: Conversational behavior and social attention in YouTube

An original study on the automatic characterization of vloggers' audiovisual nonverbal behavior is presented, grounded in work from social psychology and behavioral computing.

Crowdsourcing for Affective Annotation of Video: Development of a Viewer-reported Boredom Corpus

A new corpus to be used to evaluate algorithms for prediction of viewer-reported boredom and a use of crowdsourcing to address two shortcomings of previous affective video corpora are reported on.

What Are They Blogging About? Personality, Topic and Motivation in Blogs

The content of blogs is examined to provide insight into the role of personality in motivation for blogging, and it is found that highly Neurotic authors use blogs to serve a cathartic or auto-therapeutic function, and reflect mainly upon themselves and negative emotions.

YouTube: Online Video and Participatory Culture

This session discusses work in the forthcoming Polity title YouTube: Online Video and Participatory Culture by Joshua Green and Jean Burgess, which discusses the ways that it relates to wider transformations in culture, society and the economy.

Publicly Private and Privately Public: Social Networking on YouTube

This article analyzes how YouTube participants developed and maintained social networks by manipulating physical and interpretive access to their videos, and reveals how circulating and sharing videos reflects different social relationships among youth.

Is Your Profile Picture Worth 1000 Words? Photo Characteristics Associated with Personality Impression Agreement

Social-Networking Websites (SNWs) are rapidly becoming a central media for social exchange. A basic question is how well are people able to get to know each other through these websites? In this

Personality Impressions Based on Facebook Profiles

Ind impressions based on 133 Facebook profiles are examined, comparing them with how the targets see themselves and are seen by close acquaintances, and results show generally strong patterns of convergence, although the accuracy correlations vary considerably across traits.

Using Linguistic Cues for the Automatic Recognition of Personality in Conversation and Text

Experimental results for recognition of all Big Five personality traits, in both conversation and text, utilising both self and observer ratings of personality are reported, confirming previous findings linking language and personality, while revealing many new linguistic markers.