Usefulness of altmetrics for measuring the broader impact of research: A case study using data from PLOS and F1000Prime

@article{Bornmann2015UsefulnessOA,
  title={Usefulness of altmetrics for measuring the broader impact of research: A case study using data from PLOS and F1000Prime},
  author={Lutz Bornmann},
  journal={Aslib J. Inf. Manag.},
  year={2015},
  volume={67},
  pages={305-319}
}
  • L. Bornmann
  • Published 9 September 2014
  • Computer Science
  • Aslib J. Inf. Manag.
Purpose – The purpose of this case study is to investigate the usefulness of altmetrics for measuring the broader impact of research. Design/methodology/approach – This case study is based on a sample of 1,082 the Public Library of Science (PLOS) journal articles recommended in F1000. The data set includes altmetrics which were provided by PLOS. The F1000 data set contains tags on papers which were assigned by experts to characterise them. Findings – The most relevant tag for altmetric research… Expand
What Can Altmetric.com Tell Us About Policy Citations of Research? An Analysis of Altmetric.com Data for Research Articles from the University of Sheffield
TLDR
Within the limitations of the current text-mining system, Altmetrics can offer important and highly-accessible data on the policy impact of an organization’s published research articles. Expand
Do altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime data
TLDR
The results of the regression analysis indicate that citation-based metrics and readership counts are significantly more related to quality, than tweets, which questions the use of Twitter counts for research evaluation purposes and indicates potential use of Mendeley reader counts. Expand
Evaluating the impact of research using the altmetrics approach (case study: the field of scientometrics)
This paper aims to assess the impact of research in the field of scientometrics by using the altmetrics (social media metrics) approach.,This is an applied study which uses scientometric andExpand
Altmetrics data providers: A meta-analysis review of the coverage of metrics and publication
TLDR
The article is the most comprehensive analysis of altmetric data providers and explores the coverage of publications, social media and events from a longitudinal view and shows that most of the studies are based on Altmetric.com data. Expand
Altmetrics: an analysis of the state-of-the-art in measuring research impact on social media
TLDR
An overview of the altmetrics landscape is provided, comparing tool features, social media data sources, and social media events provided by altmetric aggregators, and a meta-analysis across more than 40 cross-metric validation studies shows overall a weak correlation. Expand
Do bibliometrics and altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime, altmetrics, and citation data.
TLDR
The results of the regression analysis indicate that citation-based metrics and readership counts are significantly more related to quality, than tweets and the Altmetric Attention Score. Expand
Do altmetrics assess societal impact in a comparable way to case studies? An empirical test of the convergent validity of altmetrics based on data from the UK research excellence framework (REF)
TLDR
It is suggested that altmetrics may capture a different aspect of societal impact to that seen by reviewers (who are interested in the causal link between research and action in society). Expand
Measuring field-normalized impact of papers on specific societal groups: An altmetrics study based on Mendeley data
TLDR
It is deemed appropriate that not only the impact measurement using citations is target-oriented (citations measure the impact of papers on scientists) but also the measurement of impact using altmetrics, which is based on Mendeley data is extended. Expand
Context of altmetrics data matters: an investigation of count type and user category
TLDR
Analysis of twitter user category shows the general tweet distribution is strongly influenced by the public user and tweets from research user are more correlated with citations than any other user categories. Expand
An extensive analysis of the presence of altmetric data for Web of Science publications across subject fields and research topics
TLDR
A state-of-the-art analysis of the presence of 12 kinds of altmetric events for nearly 12.3 million Web of Science publications published between 2012 and 2018 shows that even though an upward trend of data presence can be observed over time, except for Mendeley readers and Twitter mentions, the overall presence of most altmetrics data is still low. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 61 REFERENCES
Do altmetrics point to the broader impact of research? An overview of benefits and disadvantages of altmetrics
  • L. Bornmann
  • Sociology, Computer Science
  • J. Informetrics
  • 2014
TLDR
An overview of studies explores the potential of altmetrics for measuring societal impact, which is a term to describe web-based metrics for the impact of publications and other scholarly material by using data from social media platforms. Expand
Validity of altmetrics data for measuring societal impact: A study using data from Altmetric and F1000Prime
  • L. Bornmann
  • Computer Science, Physics
  • J. Informetrics
  • 2014
TLDR
The results show that papers with the tag "good for teaching" do achieve higher altmetric counts than papers without this tag - if the quality of the papers is controlled and a higher citation count is shown especially by papers with a tag that is specifically scientifically oriented ("new finding"). Expand
How well developed are altmetrics? A cross-disciplinary analysis of the presence of ‘alternative metrics’ in scientific publications
TLDR
The main result of the study is that the altmetrics source that provides the most metrics is Mendeley, with metrics on readerships for 62.6 % of all the publications studied, other sources only provide marginal information. Expand
Alternative metrics in scientometrics: a meta-analysis of research into three altmetrics
TLDR
An overview of research into three of the most important altmetrics: microblogging (Twitter), online reference managers (Mendeley and CiteULike) and blogging is provided and the correlation between altmetric counts and citation counts is focused on. Expand
New data, new possibilities: Exploring the insides of Altmetric.com
TLDR
It is concluded that Altmetric.com is a transparent, rich and accurate tool for altmetric data, Nevertheless, there are still potential limitations on its exhaustiveness as well as on the selection of social media sources that need further research. Expand
Coverage and adoption of altmetrics sources in the bibliometric community
TLDR
Findings suggest that some online tools are seeing substantial use by bibliometricians, and that they present a potentially valuable source of impact data. Expand
How to evaluate individual researchers working in the natural and life sciences meaningfully? A proposal of methods based on percentiles of citations
TLDR
This study aims to set up proposals how to evaluate individual researchers working in the natural and life sciences, and includes recommendations for a set of indicators to be used for evaluating researchers. Expand
Validating online reference managers for scholarly impact measurement
This paper investigates whether CiteULike and Mendeley are useful for measuring scholarly influence, using a sample of 1,613 papers published in Nature and Science in 2007. Traditional citationExpand
Users, narcissism and control – tracking the impact of scholarly publications in the 21st century
This report explores the explosion of tracking tools that have accompanied the surge of web based information instruments. Is it possible to monitor ‘real-time’ how new research findings are beingExpand
The effects of research level and article type on the differences between citation metrics and F1000 recommendations
TLDR
It is recommended that the application of bibliometric approaches in research evaluation should consider the proportion of 3 types of publications: evidence‐based research, transformative research, and translational research, which are more suitable for assessment through peer review. Expand
...
1
2
3
4
5
...