Promoting Transparency in Social Science Research

@article{Miguel2014PromotingTI,
  title={Promoting Transparency in Social Science Research},
  author={E. Miguel and Colin Camerer and K. Casey and J. Cohen and K. Esterling and A. Gerber and R. Glennerster and D. P. Green and M. Humphreys and G. Imbens and D. Laitin and T. Madon and L. Nelson and Brian A. Nosek and M. Petersen and R. Sedlmayr and J. Simmons and U. Simonsohn and M. V. D. Laan},
  journal={Science},
  year={2014},
  volume={343},
  pages={30 - 31}
}
Social scientists should adopt higher transparency standards to improve the quality and credibility of research. There is growing appreciation for the advantages of experimentation in the social sciences. Policy-relevant claims that in the past were backed by theoretical arguments and inconclusive correlations are now being investigated using more credible methods. Changes have been particularly pronounced in development economics, where hundreds of randomized trials have been carried out over… Expand
Increasing the Credibility of Political Science Research: A Proposal for Journal Reforms
  • B. Nyhan
  • Political Science
  • PS: Political Science & Politics
  • 2015
In this white paper, I propose a series of reforms intended to improve the rigor, timeliness, and replicability of published political science research. These changes could be proposed as part of theExpand
Transparency in Practice in Qualitative Research
The discipline of political science has been engaged in discussion about when, why, and how to make scholarship more transparent for at least three decades. This piece argues that qualitativeExpand
How Transparency and Reproducibility Can Increase Credibility in Policy Analysis: A Case Study of the Minimum Wage Policy Estimate
The analysis of public policies, even when performed by the best non-partisan agencies, often lacks credibility (Manski, 2013). This allows policy makers to cherrypick between reports, or within aExpand
Transparency, Reproducibility, and the Credibility of Economics Research
There is growing interest in enhancing research transparency and reproducibility in economics and other scientific fields. We survey existing work on these topics within economics, and discuss theExpand
A framework for open policy analysis
The evidence-based policy movement promotes the use of empirical evidence to inform policy decision-making. While several social science disciplines are undergoing a ‘credibility revolution’Expand
Trust, Transparency, and Replication in Political Science
ABSTRACT Striving better to uncover causal effects, political science is amid a revolution in micro-empirical research designs and experimental methods. This methodological development—although quiteExpand
Improving Transparency in Observational Social Science Research: A Pre-Analysis Plan Approach
Social science research has undergone a credibility revolution, but these gains are at risk due to problematic research practices. Existing research on transparency has centered around randomizedExpand
Generalization in the Tropics: Development policy, randomized controlled trials, and external validity
TLDR
It is found that the majority of published RCTs does not discuss these hazards and many do not provide the necessary information to assess potential problems, and calls for including external validity dimensions in a more systematic reporting on the results of R CTs. Expand
Palgrave Communications’ Commitment to Promoting Transparency and Reproducibility in Research
There is increasing recognition among academics - particularly those engaged in quantitative and experimental research - that sharing of research data and reproducibility of results should be aExpand
Openness in Practice in Qualitative Research
The discipline of political science has been engaged in discussion about when, why, and how to make scholarship more open for at least three decades.This piece argues that the best way to resolve ourExpand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 17 REFERENCES
Scientific Utopia: II. Restructuring incentives and practices to promote truth over publishability
An academic scientist's professional success depends on publishing. Publishing norms emphasize novel, positive results. As such, disciplinary incentives encourage design, analysis, and reportingExpand
Testing for Publication Bias in Political Science
If the publication decisions of journals are a function of the statistical significance of research findings, the published literature may suffer from “publication bias.” This paper describes aExpand
Mexico's M&E system : scaling up from the sectoral to the national level
This paper provides a brief review of Mexico's progressive movement from a sectoral to a government-wide Monitoring and Evaluation (M&E) system. It highlights the critical institutional reformsExpand
An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science
  • Brian A. Nosek, D. Lakens
  • Medicine, Psychology
  • Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2012
TLDR
The Reproducibility Project is an open, large-scale, collaborative effort to systematically examine the rate and predictors of reproducibility in psychological science. Expand
Reshaping Institutions: Evidence on Aid Impacts Using a Pre-Analysis Plan
This brief summarizes the results of a gender impact evaluation study, entitled Reshaping institutions : evidence on aid impacts using a pre analysis plan, conducted between 2005 and 2009 in SierraExpand
Why Most Published Research Findings Are False
TLDR
Simulations show that for most study designs and settings, it is more likely for a research claim to be false than true. Expand
Fishing, Commitment, and Communication: A Proposal for Comprehensive Nonbinding Research Registration
TLDR
It is demonstrated here that even with this level of advanced specification, the scope for fishing is considerable when there is latitude over selection of covariates, subgroups, and other elements of an analysis plan. Expand
For objective causal inference, design trumps analysis
For obtaining causal inferences that are objective, and therefore have the best chance of revealing scientific truths, carefully designed and executed randomized experiments are generally consideredExpand
Scientific Misconduct and the Myth of Self-Correction in Science
  • W. Stroebe, T. Postmes, R. Spears
  • Psychology, Medicine
  • Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2012
TLDR
The authors analyze a convenience sample of fraud cases to see whether (social) psychology is more susceptible to fraud than other disciplines and suggest a number of strategies that might reduce the risk of scientific fraud. Expand
Estimating effect size: Bias resulting from the significance criterion in editorial decisions
Experiments that find larger differences between groups than actually exist in the population are more likely to pass stringent tests of significance and be published than experiments that findExpand
...
1
2
...