Perspectives on psychological science : a journal of the Association for Psychological Science
-
Perspect Psychol Sci · Sep 2020
The Multiverse of Methods: Extending the Multiverse Analysis to Address Data-Collection Decisions.
When analyzing data, researchers may have multiple reasonable options for the many decisions they must make about the data-for example, how to code a variable or which participants to exclude. Therefore, there exists a multiverse of possible data sets. ⋯ I propose an adaptation of the multiverse method in which the multiverse of data sets is composed of real data sets from studies varying in data-collection methods of interest. I walk through an example analysis applying the approach to 19 studies on shooting decisions to demonstrate the usefulness of this approach and conclude with a further discussion of the limitations and applications of this method.