Assessing evaluation procedures for individual researchers: The case of the Italian National Scientific Qualification

@article{Marzolla2016AssessingEP,
  title={Assessing evaluation procedures for individual researchers: The case of the Italian National Scientific Qualification},
  author={Moreno Marzolla},
  journal={J. Informetrics},
  year={2016},
  volume={10},
  pages={408-438}
}
  • M. Marzolla
  • Published 16 July 2015
  • Medicine
  • J. Informetrics
View PDF on arXiv
12 Citations
Highly Influential Citations
2
Background Citations
3
Methods Citations
6

12 Citations

The impact of the national assessment exercises on self-citation rate and publication venue: an empirical investigation on the engineering academic sector in Italy
TLDR
An overview of the research activity of the Italian public universities and their academic staff in the engineering sector (EngSec), that is about seven thousand researchers, is provided to give a more comprehensive view of this important cultural segment of the academia.
On bibliometrics in academic promotions: a case study in computer science and engineering in Italy
TLDR
Evidence is reported that up to 30% of Italian faculty members of certain sub-communities would see their indicators drop below the threshold, thus becoming not eligible for promotion, if the ASN were conducted on a more accurate, fine-grained classification.
The practice of self-citations: a longitudinal study
TLDR
The analysis showed an overall increment in author self-citations in several of the 24 academic disciplines considered, but depicted a stronger causal relation between such increment and the rules introduced by the 2012 Italian Scientific Habilitation in 10 out of 24 disciplines analysed.
Open data to evaluate academic researchers: an experiment with the Italian Scientific Habilitation
TLDR
This paper investigates the growth of open citations with an experiment on the Italian Scientific Habilitation, the National process for University Professor qualification which instead uses data from commercial indexes, and simulates the procedure by only using open data.
The impact of a national research assessment on the publications of sociologists in Italy
This article investigates the impact of the second national research assessment (VQR 2004–10), which was performed in 2011 by the Italian National Agency for the Evaluation of Universities and…
The trench warfare of gender discrimination: evidence from academic promotions to full professor in Italy
TLDR
Investigating gender inequality in Italian universities using a binary variable controlling by scientific productivity, normalised number of available vacancies, result of national research evaluation, age, current rank-and-file position demonstrates that among those who obtained the ASN, men have around 24% more probability to be promoted at parity of scientific production, which reveals a relevant gender discrimination.
Comprehensive Researcher Achievement Model (CRAM): a framework for measuring researcher achievement, impact and influence derived from a systematic literature review of metrics and models
TLDR
A new composite design, the Comprehensive Researcher Achievement Model (CRAM), is presented, which supersedes past anachronistic models and is modifiable to a range of applications.
Can we assess research using open scientific knowledge graphs? A case study within the Italian National Scientific Qualification
TLDR
The outcomes of the experiment show that the amount of open bibliographic metadata and open citation data currently available in the two scientific knowledge graphs adopted is not yet enough for obtaining results similar to those provided using commercial databases.
Google Scholar and Web of Science: Examining gender differences in citation coverage across five scientific disciplines
Dynamising the Dynamics of Funding and Investment Conditions: Coaching Emerging Researchers for Publishing in Intercultural Settings
Universities are highly interested to introduce emerging researchers into new strategies of publishing. Coaching emerging researchers counts as a strategic investment not only into emerging scholars,…
...
...

References

SHOWING 1-10 OF 45 REFERENCES
Quantitative analysis of the Italian National Scientific Qualification
Competition for academic promotion in Italy
Appropriate use of bibliometric indicators for the assessment of journals, research proposals, and individuals.
  • Environmental Science
    IEEE computer graphics and applications
  • 2014
TLDR
The field has now reached a sufficiently high level of maturity to recognize that the scientific impact of journals as evaluated by bibliometrics is a complex, multi-dimensional construct and therefore more than one indicator is needed for such evaluation.
An evaluation of the Australian Research Council's journal ranking
ON THE PROPER USE OF BIBLIOMETRICS TO EVALUATE INDIVIDUAL RESEARCHERS
[ENG]- Individual evaluation of researchers is still a subjective process that suffers from numerous potential biases. The Academie has examined the use of quantitative bibliometrics, which are…
Quality Versus Quantity: Assessing Individual Research Performance
  • J. Sahel
  • Business
    Science Translational Medicine
  • 2011
TLDR
Comment is drawn on key issues raised by the French Academy of Sciences report on bibliometric methods for evaluating individual researchers, as well as recommendations for the integration of quality assessment.
An assessment of the first “scientific habilitation” for university appointments in Italy
TLDR
The objective of this work is to analyze the relationship of the recent habilitation procedure outcomes to the actual scientific merit of the various candidates, as well as to other variables that are explicative of possible practices of favoritism and discrimination.
Towards a European Academic Labour Market? Some Lessons Drawn from Empirical Studies on Academic Mobility
In Europe, academic mobility has a long tradition which began with the birth of the European universities in the middle ages. Recently, European policies were strongly oriented towards the promotion…
Approaches to understanding and measuring interdisciplinary scientific research (IDR): A review of the literature
The Early Career Paths and Employment Conditions of the Academic Profession in 17 Countries
The expansion of higher education systems, new demands on institutions and growing pressures on resources have become common trends across most developed countries. They bring increased expectations…
...
...