The YouTube Lens: Crowdsourced Personality Impressions and Audiovisual Analysis of Vlogs

@article{Biel2013TheYL,
  title={The YouTube Lens: Crowdsourced Personality Impressions and Audiovisual Analysis of Vlogs},
  author={Joan-Isaac Biel and D. Gatica-Perez},
  journal={IEEE Transactions on Multimedia},
  year={2013},
  volume={15},
  pages={41-55}
}
Despite an increasing interest in understanding human perception in social media through the automatic analysis of users' personality, existing attempts have explored user profiles and text blog data only. [...] Key Result In addition, it constitutes a first attempt to address the task of automatic vlogger personality impression prediction using nonverbal cues, with promising results.Expand
Vlogging Over Time: Longitudinal Impressions and Behavior in YouTube
TLDR
This study uses online crowdsourcing to collect a rich set of 21 impression variables for each video, including perceived personality, mood, skills, and expertise, and shows that the use of longitudinal data helps to improve the automatic inference of impressions for several of the impression variables. Expand
Mining Crowdsourced First Impressions in Online Social Video
TLDR
The study of 442 YouTube vlogs and 2,210 annotations collected in Mechanical Turk supports recent literature showing the feasibility to crowdsource interpersonal human impression with comparable quality to what is reported in social psychology research, and provides insights on the interplay among human first impressions. Expand
Hi YouTube!: personality impressions and verbal content in social video
TLDR
The results show that the analysis of error-free verbal content is useful to predict four of the Big-Five traits, three of them better than using nonverbal cues, and that the errors caused by the ASR system decrease the performance significantly. Expand
What Your Face Vlogs About: Expressions of Emotion and Big-Five Traits Impressions in YouTube
TLDR
It is shown that while multiple facial expression cues have significant correlation with several of the Big-Five traits, they are only able to significantly predict Extraversion impressions with moderate values of R2. Expand
In the Mood for Vlog
TLDR
This study presents a systematic study of classification and ranking of mood impressions in social video, using vlogs from YouTube and shows that addressing mood as a ranking problem is a promising practical direction for several of the mood categories studied. Expand
Hirability in the Wild: Analysis of Online Conversational Video Resumes
TLDR
A computational framework for the prediction of organizational first impressions was developed, where the inference and nonverbal cue extraction steps were fully automated and results demonstrate automatic prediction of first impressions of up to 27% of the variance explained for extraversion, and up to 20% for social and communication skills. Expand
Inferring mood in ubiquitous conversational video
TLDR
This paper presents an automatic approach to infer 11 natural mood categories in conversational social video using single and multimodal nonverbal cues extracted from video blogs (vlogs) from YouTube. Expand
Happy and agreeable?: multi-label classification of impressions in social video
TLDR
Under a multi-label classification framework, it is shown that for both mood and personality trait binary label sets, not only the simultaneous inference of multiple labels is feasible, but also that classification accuracy increases moderately for several labels, compared to a single-label approach. Expand
A Multivariate Regression Approach to Personality Impression Recognition of Vloggers
TLDR
This paper focuses on predicting how the personality of YouTube video bloggers is perceived by their viewers, and uses audio-video features, as well as textual features extracted from the transcripts of vlogs, to predict the extent to which the video blogger is perceived to exhibit each of the traits of the Big Five personality model. Expand
BookTubing Across Regions: Examining Differences Based on Nonverbal and Verbal Cues
TLDR
The analysis shows that cultural context and popularity can be inferred to some degree using multimodal fusion of these features of BookTube videos, comparing non-western (Indian) and Western populations. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 67 REFERENCES
You Are Known by How You Vlog: Personality Impressions and Nonverbal Behavior in YouTube
TLDR
This paper analyzes one facet of YouTube as a repository of brief behavioral slices in the form of personal conversational vlogs, which are a unique medium for selfpresentation and interpersonal perception and finds significant associations between automatically extracted nonverbal cues for several personality judgments. Expand
VlogSense: Conversational behavior and social attention in YouTube
TLDR
An original study on the automatic characterization of vloggers' audiovisual nonverbal behavior is presented, grounded in work from social psychology and behavioral computing. Expand
Crowdsourcing for Affective Annotation of Video: Development of a Viewer-reported Boredom Corpus
TLDR
A new corpus to be used to evaluate algorithms for prediction of viewer-reported boredom and a use of crowdsourcing to address two shortcomings of previous affective video corpora are reported on. Expand
Automatic nonverbal analysis of social interaction in small groups: A review
TLDR
This paper reviews the existing literature on automatic analysis of small group conversations using nonverbal communication, and aims at bridging the current fragmentation of the work in this domain, currently split among half a dozen technical communities. Expand
What Are They Blogging About? Personality, Topic and Motivation in Blogs
TLDR
The content of blogs is examined to provide insight into the role of personality in motivation for blogging, and it is found that highly Neurotic authors use blogs to serve a cathartic or auto-therapeutic function, and reflect mainly upon themselves and negative emotions. Expand
YouTube: Online Video and Participatory Culture
TLDR
This session discusses work in the forthcoming Polity title YouTube: Online Video and Participatory Culture by Joshua Green and Jean Burgess, which discusses the ways that it relates to wider transformations in culture, society and the economy. Expand
Publicly Private and Privately Public: Social Networking on YouTube
TLDR
This article analyzes how YouTube participants developed and maintained social networks by manipulating physical and interpretive access to their videos, and reveals how circulating and sharing videos reflects different social relationships among youth. Expand
Is Your Profile Picture Worth 1000 Words? Photo Characteristics Associated with Personality Impression Agreement
Social-Networking Websites (SNWs) are rapidly becoming a central media for social exchange. A basic question is how well are people able to get to know each other through these websites? In thisExpand
Personality Impressions Based on Facebook Profiles
TLDR
Ind impressions based on 133 Facebook profiles are examined, comparing them with how the targets see themselves and are seen by close acquaintances, and results show generally strong patterns of convergence, although the accuracy correlations vary considerably across traits. Expand
Using Linguistic Cues for the Automatic Recognition of Personality in Conversation and Text
TLDR
Experimental results for recognition of all Big Five personality traits, in both conversation and text, utilising both self and observer ratings of personality are reported, confirming previous findings linking language and personality, while revealing many new linguistic markers. Expand
...
1
2
3
4
5
...