Benchmarking scientific output in the social sciences and humanities: The limits of existing databases

  title={Benchmarking scientific output in the social sciences and humanities: The limits of existing databases},
  author={{\'E}ric Archambault and {\'E}tienne Vignola-Gagn{\'e} and Gr{\'e}goire C{\^o}t{\'e} and Vincent Larivi{\`e}re and Yves Gingras},
SummaryThe goal of this paper is to examine the impact of linguistic coverage of databases used by bibliometricians on the capacity to effectively benchmark the work of researchers in social sciences and humanities. We examine the strong link between bibliometrics and the Thomson Scientific's database and review the differences in the production and diffusion of knowledge in the social sciences and humanities (SSH) and the natural sciences and engineering (NSE). This leads to a re-examination… 

Improving the coverage of social science and humanities researchers' output: The case of the Érudit journal platform

The results show that, while the addition of papers published in local journals to bibliometric measures has little effect when all disciplines are considered and for anglophone universities, it increases the output of researchers from francophone universities in the social sciences and humanities by almost a third.

Toward a classification of Spanish scholarly journals in social sciences and humanities considering their impact and visibility

A model with two dimensions (impact and visibility) based on quantitative criteria has been carried out in order to classify the Spanish journals of social science and humanities and the implementation of this evaluation methodology in various disciplines is announced.

The journal coverage of Web of Science and Scopus: a comparative analysis

Results indicate that the use of either WoS or Scopus for research evaluation may introduce biases that favor Natural Sciences and Engineering as well as Biomedical Research to the detriment of Social Sciences and Arts and Humanities.

The representation of the social sciences and humanities in the Web of Science—a comparison of publication patterns and incentive structures in Flanders and Norway (2005–9)

This article studies publication patterns in the social sciences and humanities (SSH) in Flanders and Norway using two databases that both cover all SSH peer-reviewed journal articles by university

Integrating metrics to measure research performance in social sciences and humanities: The case of the Spanish CSIC

This paper aims at laying the foundations for a comprehensive study of the research performance of SSH CSIC researchers from a micro-level perspective and recommends to consider output beyond the boundaries of WoS articles and develop more accurate indicators for assessing the prestige of publications channels.

How robust is journal rating in Humanities and Social Sciences? Evidence from a large-scale, multi-method exercise

This article reports on a large-scale exercise of classification of journals in the fields of Humanities and Social Sciences, carried out by the Italian Agency for the Evaluation of Universities and

Performance of citations and altmetrics in the social sciences and humanities

It has always been argued that social sciences and humanities (SSH) impact evaluation calls for a broader range of indicators than only bibliometric indicators. This study analyzes the performance of

Web of Science and Scopus: a journal title overlap study

Calculations of the overlaps between the journal lists of Web of Science and Scopus and some other major scientific databases are presented, providing some measures of the overall title coverage as well as the amount of unique material in the sources studied.

Science and its significant other: Representing the humanities in bibliometric scholarship

The conceptual frameworks, methods, and data sources used in bibliometrics to study the nature of the humanities, and its differences and similarities in comparison with other scientific domains are explored.

Outlining the Scientific Activity Profile of Researchers in the Social Sciences and Humanities in Spain: The Case of CSIC

Differences in the publication pattern of researchers in SSH were explored, and the relationship between their research performance and personal features such as age, gender and professional rank were analysed.



The place of serials in referencing practices: Comparing natural sciences and engineering with social sciences and humanities

The results show that journal literature is increasingly important in the natural and social sciences, but that its role in the humanities is stagnant and has even tended to diminish slightly in the 1990s.

Assessing the usefulness of bibliometric indicators for the humanities and the social and beha vioural sciences: A comparative study

Although many publications were written in English, only experimental psychology, general linguistics, anthropology, and genrral literature were internationally oriented regarding output media.

The International Visibility and Citation Impact of Scandinavian Research Articles in Selected Social Science Fields: The Decay of a Myth

The conclusion is that SSCI, although biased towards Anglo-American publications, actually makes room for valid bibliometric and scientometric analyses of research published by Scandinavian and other smaller countries with English as the second language in journals regarded international by ISI.

The difficulty of achieving full coverage of international social science literature and the bibliometric consequences

The paper examines the main reasons why social science bibliometrics are problematic, namely: the centrality of books in social science literature and their high citation rate; and the national orientation of social science literatures.

International Comparison of Departments' Research Performance in the Humanities

Methods are developed to compare the research performance of departments in two humanities disciplines, general linguistics and general literature. Departments from an Anglo‐Saxon country were

The Four Literatures of Social Science

This chapter reviews bibliometric studies of the social sciences and humanities. SSCI bibliometrics will work reasonably well in economics and psychology, whose literatures share many characteristics

Influence and reputation in the social sciences - how much do researchers agree?

Results from a survey of 788 Danish researchers concerning their assessments of the most influential researchers and most important journals indicate a pluralistic picture and only a moderate degree of consensus among researchers.

The use of bibliometric analysis in research performance assessment and monitoring of interdisciplinary scientific developments

This paper presents an overview of advanced bibliometric methods for (1) objective and transparent assessment of strengths and weaknesses in research performance, and (2) monitoring interdisciplinary

Correcting glasses help fair comparisons in international science landscape: Country indicators as a function of ISI database delineation

This article shows that when the perimeter of journal inclusion within ISI databases will determine variations in the classic bibliometric indicators used for international comparison, such as world shares of publications or relative impacts, the variation of the most common country indicators depends on two phenomena.