Skip to Main content Skip to Navigation
Journal articles

Consensus-based guidance for conducting and reporting multi-analyst studies

Balazs Aczel 1 Barnabas Szaszi 1 Gustav Nilsonne 2 Olmo van den Akker 3 Casper Albers 4 Marcel Alm van Assen 3 Jojanneke Bastiaansen 4 Daniel Benjamin 5 Udo Boehm 6 Rotem Botvinik-Nezer 7 Laura Bringmann 4 Niko Busch 8 Emmanuel Caruyer 9 Andrea Cataldo 10 Nelson Cowan 11 Andrew Delios 12 Noah van Dongen 6 Chris Donkin 13 Johnny van Doorn 6 Ann Dreber 14 Gilles Dutilh 15 Gary Egan 16 Morton Ann Gernsbacher 17 Rink Hoekstra 4 Sabine Hoffmann 18 Felix Holzmeister 19 Juergen Huber 19 Magnus Johannesson 14 Kai Jonas 20 Alexander Kindel 21 Michael Kirchler 19 Yoram Kunkels 4 D Stephen Lindsay 22 Jean-Francois Mangin 23 Dora Matzke 6 Marcus Munafò 24 Ben Newell 13 Brian Nosek 25 Russell Poldrack 26 Don van Ravenzwaaij 4 Jörg Rieskamp 27 Matthew Salganik 21 Alexandra Sarafoglou 6 Tom Schonberg 28 Martin Schweinsberg 29 David Shanks 30 Raphael Silberzahn 31 Daniel Simons 32 Barbara Spellman 25 Samuel St-Jean 33 Jeffrey Starns 34 Eric Luis Uhlmann 35 Jelte Wicherts 3 Eric-Jan Wagenmakers 6 
1 ELTE - Eötvös Loránd University
2 Karolinska Institutet [Stockholm]
3 Tilburg University [Tilburg]
4 University of Groningen [Groningen]
5 USC - University of Southern California
6 UvA - University of Amsterdam [Amsterdam]
7 Dartmouth College [Hanover]
8 WWU - Westfälische Wilhelms-Universität Münster = University of Münster
9 Empenn
INSERM - Institut National de la Santé et de la Recherche Médicale, Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
10 McLean Hospital [Belmont, Ma.]
11 Mizzou - University of Missouri [Columbia]
12 NUS - National University of Singapore
13 UNSW - University of New South Wales [Sydney]
14 SSE - Stockholm School of Economics
15 University Hospital Basel [Basel]
16 Monash University [Melbourne]
17 University of Wisconsin-Madison
18 LMU - Ludwig-Maximilians-Universität München
19 University of Innsbruck
20 Maastricht University [Maastricht]
21 Princeton University
22 UVIC - University of Victoria [Canada]
23 Université Paris-Saclay
24 University of Bristol [Bristol]
25 University of Virginia [Charlottesville]
26 Stanford University
27 Unibas - University of Basel
28 Tel Aviv University [Tel Aviv]
29 ESMT - European School of Management and Technology [Berlin, Germany]
30 UCL - University College of London [London]
31 University of Sussex
32 University of Illinois at Urbana-Champaign [Urbana]
33 University of Alberta
34 UMass Amherst - University of Massachusetts [Amherst]
35 INSEAD - Institut européen d'administration des affaires [Singapour, Singapour]
Abstract : Any large dataset can be analyzed in a number of ways, and it is possible that the use of different analysis strategies will lead to different results and conclusions. One way to assess whether the results obtained depend on the analysis strategy chosen is to employ multiple analysts and leave each of them free to follow their own approach. Here, we present consensus-based guidance for conducting and reporting such multi-analyst studies, and we discuss how broader adoption of the multi-analyst approach has the potential to strengthen the robustness of results and conclusions obtained from analyses of datasets in basic and applied research.
Keywords : medicine neuroscience none
Document type :
Journal articles
Complete list of metadata
https://www.hal.inserm.fr/inserm-03431812
Contributor : Emmanuel Caruyer Connect in order to contact the contributor
Submitted on : Thursday, June 2, 2022 - 11:55:07 AM
Last modification on : Thursday, September 1, 2022 - 3:58:45 AM
Long-term archiving on: : Saturday, September 3, 2022 - 7:02:00 PM

File

Vignette du document
Aczel.pdf
Publisher files allowed on an open archive

Licence

Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Collections

INSERM | UNIV-RENNES1 | CNRS | INRIA | INSA-RENNES | IRISA | CENTRALESUPELEC | INRIA2 | UR1-MATH-STIC | UNIV-PARIS-SACLAY | UR1-UFR-ISTIC | UNIV-RENNES | UR1-MATH-NUM | UR1-BIO-SA | DEESSE

Citation

Balazs Aczel, Barnabas Szaszi, Gustav Nilsonne, Olmo van den Akker, Casper Albers, et al.. Consensus-based guidance for conducting and reporting multi-analyst studies. eLife, eLife Sciences Publication, 2021, 10, pp.e72185. ⟨10.7554/eLife.72185⟩. ⟨inserm-03431812⟩

Export

BibTeX TEI DC DCterms EndNote Datacite

Share

Metrics

Record views

50

Files downloads

13