Grand challenges in altmetrics: heterogeneity, data quality and dependencies

@article{Haustein2016GrandCI,
  title={Grand challenges in altmetrics: heterogeneity, data quality and dependencies},
  author={Stefanie Haustein},
  journal={Scientometrics},
  year={2016},
  volume={108},
  pages={413-423}
}
  • S. Haustein
  • Published 16 March 2016
  • Computer Science
  • Scientometrics
With increasing uptake among researchers, social media are finding their way into scholarly communication and, under the umbrella term altmetrics, are starting to be utilized in research evaluation. Fueled by technological possibilities and an increasing demand to demonstrate impact beyond the scientific community, altmetrics have received great attention as potential democratizers of the scientific reward system and indicators of societal impact. This paper focuses on the current challenges… 
Coping with Altmetrics' Heterogeneity - A Survey on Social Media Platforms' Usage Purposes and Target Groups for Researchers
TLDR
This work surveys researchers about the usage purposes that 18 popular social media platforms serve for them, and performs hierarchical clustering on basis of the response data to reveal similarities and differences between the examined platforms regarding the goals they help to fulfil and the communication partners they are used to address.
General discussion of data quality challenges in social media metrics: Extensive comparison of four major altmetric data aggregators
TLDR
The results show that different forms of accessing the data from diverse social media platforms, together with different approaches of collecting, processing, summarizing, and updating social media metrics cause substantial differences in the data and metrics offered by these aggregators.
Altmetrics: State of the Art and a Look into the Future
TLDR
This chapter deals with the current state of the art of altmetrics, focusing on the present discussion about the informative value of alt Metrics, and investigates to what extent altmetric can be used in scientific evaluations.
Chapter 8 Altmetrics : State of the Art and a Look into the Future
TLDR
This chapter deals with the current state of the art of altmetrics, focusing on the present discussion about the informative value of alt Metrics, and investigates to what extent altmetric can be used in scientific evaluations.
Peer review, bibliometrics and altmetrics ‐ Do we need them all?
This panel will present views and critical reflections on peer review, bibliometrics and altmetrics against the background of the latest developments and critique of the scientific system (e.g.,
Using Altmetrics for Contextualised Mapping of Societal Impact: From Hits to Networks
TLDR
A method that uses altmetric data to analyse researchers' interactions, as a way of mapping the contexts of potential societal impact, and suggests that this mapping method can be used as an input within broader methodologies in case studies of societal impact assessment.
An extensive analysis of the presence of altmetric data for Web of Science publications across subject fields and research topics
TLDR
A state-of-the-art analysis of the presence of 12 kinds of altmetric events for nearly 12.3 million Web of Science publications published between 2012 and 2018 shows that even though an upward trend of data presence can be observed over time, except for Mendeley readers and Twitter mentions, the overall presence of most altmetrics data is still low.
Can We Count on Social Media Metrics?: First Insights into the Active Scholarly Use of Social Media
TLDR
Based on a survey among 3,430 scientists, previously unknown and significant differences between social media services are uncovered and have direct implications for the future design of altmetrics for scientific impact prediction.
Are there different types of online research impact?
While web‐based indicators for scientific impact – so‐called altmetrics – have an increasing uptake as means for research evaluation, many questions regarding their actual meanings remain unanswered.
...
...

References

SHOWING 1-10 OF 59 REFERENCES
Altmetrics in the wild: Using social media to explore scholarly impact
TLDR
This study explores the properties of these social media-based metrics or "altmetrics", sampling 24,331 articles published by the Public Library of Science and finds that that different indicators vary greatly in activity.
Altmetrics for large, multidisciplinary research groups : Comparison of current tools
TLDR
It is revealed that for several data sources the coverage of findable publications on social media platforms and metric counts (impact) can vary across altmetric data providers.
Interpreting "altmetrics": viewing acts on social media through the lens of citation and social theories
TLDR
A framework is presented that describes acts leading to (online) events on which the metrics are based, and select citation and social theories are used to interpret the phenomena being measured.
Consistency among altmetrics data provider/aggregators : What are the challenges? Altmetrics workshop, 9 October 2015, Amsterdam Science Park, Amsterdam
TLDR
Investigating consistency of data across three altmetrics providers or aggregators: Altmetric.com, Mendeley and the Open Source software Lagotto to explore if metrics for a same set of publications are consistent across them and if not, what are possible reasons that explain these differences.
How consistent are altmetrics providers? Study of 1000 PLOS ONE publications using the PLOS ALM, Mendeley and Altmetric.com APIs
TLDR
This study targets to investigate 3 main altmetrics providers (PLOS ALM, Altmetric.com and Mendeley) and to test the accuracy and quality of their metrics for a same set of publications and to assess the quality, reliability and consistency of altmetric data obtained.
Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective
TLDR
The results confirm that the presence and density of social media altmetrics counts are still very low and not very frequent among scientific publications, with 15%–24% of the publications presenting some altmetric activity and concentrated on the most recent publications, although their presence is increasing over time.
Characterizing Social Media Metrics of Scholarly Papers: The Effect of Document Properties and Collaboration Patterns
TLDR
Findings suggest that factors driving social media and citations are different and social media metrics cannot actually be seen as alternatives to citations; at most, they may function as complements to other type of indicators.
Social media use in the research workflow
TLDR
The paper reports on a major international questionnaire survey that investigated the use of social media in the research workflow, showing that social media impact on all points of the research lifecycle, from identifying research opportunities to disseminating findings at the end.
Guest editorial: social media in scholarly communication
TLDR
This editorial provides an overview of terminology and definitions of altmetrics and summarizes current research regarding social media use in academia, social media metrics as well as data reliability and validity.
The Use of Bibliometrics for Assessing Research: Possibilities, Limitations and Adverse Effects
TLDR
This chapter provides an overview of bibliometric methods, from the development of citation indexing as a tool for information retrieval to its application in research evaluation, and discusses their misuse and effects on researchers’ scholarly communication behavior.
...
...