The Myriad Forms of p-Hacking

Abstract

In the present chapter, we are going to discuss several p-hacking practices as part of the broader category of questionable research practices. It has become clear that p-hacking can have detrimental consequences—particularly an increase in false-positive rates—that ultimately damage the trustworthiness and robustness of psychological science. What can any researchers do to confirm that they did not engage in questionable research practices? The solution is surprisingly simple. It lies in the transparent distinction between a priori planned, confirmatory steps of data analysis and exploratory, additional steps. The line between the two can be drawn easily by adhering to the open science practices outlined in this chapter, particularly the detailed preregistration of all measures, manipulations, hypotheses, and planned analysis steps. Open science practices are surely not the solution to all challenges psychological science currently faces, but they are a pretty good and easy-to-implement solution to prevent p-hacking. Let’s do it.