Assessing evaluation procedures for individual researchers: The case of the Italian National Scientific Qualification
@article{Marzolla2016AssessingEP, title={Assessing evaluation procedures for individual researchers: The case of the Italian National Scientific Qualification}, author={Moreno Marzolla}, journal={J. Informetrics}, year={2016}, volume={10}, pages={408-438} }
Figures and Tables from this paper
12 Citations
The impact of the national assessment exercises on self-citation rate and publication venue: an empirical investigation on the engineering academic sector in Italy
- EducationScientometrics
- 2018
An overview of the research activity of the Italian public universities and their academic staff in the engineering sector (EngSec), that is about seven thousand researchers, is provided to give a more comprehensive view of this important cultural segment of the academia.
On bibliometrics in academic promotions: a case study in computer science and engineering in Italy
- EducationScientometrics
- 2020
Evidence is reported that up to 30% of Italian faculty members of certain sub-communities would see their indicators drop below the threshold, thus becoming not eligible for promotion, if the ASN were conducted on a more accurate, fine-grained classification.
The practice of self-citations: a longitudinal study
- PsychologyScientometrics
- 2020
The analysis showed an overall increment in author self-citations in several of the 24 academic disciplines considered, but depicted a stronger causal relation between such increment and the rules introduced by the 2012 Italian Scientific Habilitation in 10 out of 24 disciplines analysed.
Open data to evaluate academic researchers: an experiment with the Italian Scientific Habilitation
- Computer ScienceISSI
- 2019
This paper investigates the growth of open citations with an experiment on the Italian Scientific Habilitation, the National process for University Professor qualification which instead uses data from commercial indexes, and simulates the procedure by only using open data.
The impact of a national research assessment on the publications of sociologists in Italy
- SociologyScience and Public Policy
- 2021
This article investigates the impact of the second national research assessment (VQR 2004–10), which was performed in 2011 by the Italian National Agency for the Evaluation of Universities and…
The trench warfare of gender discrimination: evidence from academic promotions to full professor in Italy
- SociologyScientometrics
- 2018
Investigating gender inequality in Italian universities using a binary variable controlling by scientific productivity, normalised number of available vacancies, result of national research evaluation, age, current rank-and-file position demonstrates that among those who obtained the ASN, men have around 24% more probability to be promoted at parity of scientific production, which reveals a relevant gender discrimination.
Comprehensive Researcher Achievement Model (CRAM): a framework for measuring researcher achievement, impact and influence derived from a systematic literature review of metrics and models
- MedicineBMJ Open
- 2019
A new composite design, the Comprehensive Researcher Achievement Model (CRAM), is presented, which supersedes past anachronistic models and is modifiable to a range of applications.
Can we assess research using open scientific knowledge graphs? A case study within the Italian National Scientific Qualification
- Computer ScienceArXiv
- 2021
The outcomes of the experiment show that the amount of open bibliographic metadata and open citation data currently available in the two scientific knowledge graphs adopted is not yet enough for obtaining results similar to those provided using commercial databases.
Google Scholar and Web of Science: Examining gender differences in citation coverage across five scientific disciplines
- SociologyJ. Informetrics
- 2018
Dynamising the Dynamics of Funding and Investment Conditions: Coaching Emerging Researchers for Publishing in Intercultural Settings
- Education
- 2018
Universities are highly interested to introduce emerging researchers into new strategies of publishing. Coaching emerging researchers counts as a strategic investment not only into emerging scholars,…
References
SHOWING 1-10 OF 45 REFERENCES
Quantitative analysis of the Italian National Scientific Qualification
- Computer ScienceJ. Informetrics
- 2015
Appropriate use of bibliometric indicators for the assessment of journals, research proposals, and individuals.
- Environmental ScienceIEEE computer graphics and applications
- 2014
The field has now reached a sufficiently high level of maturity to recognize that the scientific impact of journals as evaluated by bibliometrics is a complex, multi-dimensional construct and therefore more than one indicator is needed for such evaluation.
An evaluation of the Australian Research Council's journal ranking
- Political ScienceJ. Informetrics
- 2011
ON THE PROPER USE OF BIBLIOMETRICS TO EVALUATE INDIVIDUAL RESEARCHERS
- Art
- 2011
[ENG]- Individual evaluation of researchers is still a subjective process that suffers from numerous potential biases. The Academie has examined the use of quantitative bibliometrics, which are…
Quality Versus Quantity: Assessing Individual Research Performance
- BusinessScience Translational Medicine
- 2011
Comment is drawn on key issues raised by the French Academy of Sciences report on bibliometric methods for evaluating individual researchers, as well as recommendations for the integration of quality assessment.
An assessment of the first “scientific habilitation” for university appointments in Italy
- Education
- 2015
The objective of this work is to analyze the relationship of the recent habilitation procedure outcomes to the actual scientific merit of the various candidates, as well as to other variables that are explicative of possible practices of favoritism and discrimination.
Towards a European Academic Labour Market? Some Lessons Drawn from Empirical Studies on Academic Mobility
- Political Science
- 2004
In Europe, academic mobility has a long tradition which began with the birth of the European universities in the middle ages. Recently, European policies were strongly oriented towards the promotion…
Approaches to understanding and measuring interdisciplinary scientific research (IDR): A review of the literature
- MedicineJ. Informetrics
- 2011
The Early Career Paths and Employment Conditions of the Academic Profession in 17 Countries
- EducationEuropean Review
- 2010
The expansion of higher education systems, new demands on institutions and growing pressures on resources have become common trends across most developed countries. They bring increased expectations…