Consensus-based guidance for conducting and reporting multi-analyst studies - Inserm - Institut national de la santé et de la recherche médicale Access content directly
Journal Articles eLife Year : 2021

Consensus-based guidance for conducting and reporting multi-analyst studies

Balazs Aczel (1) , Barnabas Szaszi (1) , Gustav Nilsonne (2) , Olmo van den Akker (3) , Casper Albers (4) , Marcel Alm van Assen (3) , Jojanneke Bastiaansen (4) , Daniel Benjamin (5) , Udo Boehm (6) , Rotem Botvinik-Nezer (7) , Laura Bringmann (4) , Niko Busch (8) , Emmanuel Caruyer (9) , Andrea Cataldo (10) , Nelson Cowan (11) , Andrew Delios (12) , Noah van Dongen (6) , Chris Donkin (13) , Johnny van Doorn (6) , Ann Dreber (14) , Gilles Dutilh (15) , Gary Egan (16) , Morton Ann Gernsbacher (17) , Rink Hoekstra (4) , Sabine Hoffmann (18) , Felix Holzmeister (19) , Juergen Huber (19) , Magnus Johannesson (14) , Kai Jonas (20) , Alexander Kindel (21) , Michael Kirchler (19) , Yoram Kunkels (4) , D Stephen Lindsay (22) , Jean-Francois Mangin (23) , Dora Matzke (6) , Marcus Munafò (24) , Ben Newell (13) , Brian Nosek (25) , Russell Poldrack (26) , Don van Ravenzwaaij (4) , Jörg Rieskamp (27) , Matthew Salganik (21) , Alexandra Sarafoglou (6) , Tom Schonberg (28) , Martin Schweinsberg (29) , David Shanks (30) , Raphael Silberzahn (31) , Daniel Simons (32) , Barbara Spellman (25) , Samuel St-Jean (33) , Jeffrey Starns (34) , Eric Luis Uhlmann (35) , Jelte Wicherts (3) , Eric-Jan Wagenmakers (6)
1 ELTE - Eötvös Loránd University
2 Karolinska Institutet [Stockholm]
3 Tilburg University [Tilburg]
4 University of Groningen [Groningen]
5 USC - University of Southern California
6 UvA - University of Amsterdam [Amsterdam]
7 Dartmouth College [Hanover]
8 WWU - Westfälische Wilhelms-Universität Münster = University of Münster
9 Empenn - Neuroimagerie: méthodes et applications
10 McLean Hospital [Belmont, Ma.]
11 Mizzou - University of Missouri [Columbia]
12 NUS - National University of Singapore
13 UNSW - University of New South Wales [Sydney]
14 SSE - Stockholm School of Economics
15 University Hospital Basel [Basel]
16 Monash University [Melbourne]
17 University of Wisconsin-Madison
18 LMU - Ludwig-Maximilians-Universität München
19 Leopold Franzens Universität Innsbruck - University of Innsbruck
20 Maastricht University [Maastricht]
21 Princeton University
22 UVIC - University of Victoria [Canada]
23 Université Paris-Saclay
24 University of Bristol [Bristol]
25 University of Virginia
26 Stanford University
27 Unibas - University of Basel
28 TAU - Tel Aviv University
29 ESMT - European School of Management and Technology [Berlin, Germany]
30 UCL - University College of London [London]
31 University of Sussex
32 University of Illinois at Urbana-Champaign [Urbana]
33 University of Alberta
34 UMass Amherst - University of Massachusetts [Amherst]
35 INSEAD - Institut européen d'administration des affaires [Singapour, Singapour]
Balazs Aczel
Eötvös Loránd University
Barnabas Szaszi
Eötvös Loránd University
Gustav Nilsonne
Karolinska Institutet [Stockholm]
Olmo van den Akker
  • Function : Author
Tilburg University [Tilburg]
Casper Albers
  • Function : Author
University of Groningen [Groningen]
Marcel Alm van Assen
  • Function : Author
Tilburg University [Tilburg]
Jojanneke Bastiaansen
University of Groningen [Groningen]
Daniel Benjamin
University of Southern California
Udo Boehm
University of Amsterdam [Amsterdam]
Rotem Botvinik-Nezer
Dartmouth College [Hanover]
Laura Bringmann
University of Groningen [Groningen]
Niko Busch
Westfälische Wilhelms-Universität Münster = University of Münster
Emmanuel Caruyer
Neuroimagerie: méthodes et applications
Andrea Cataldo
McLean Hospital [Belmont, Ma.]
Nelson Cowan
University of Missouri [Columbia]
Andrew Delios
National University of Singapore
Noah van Dongen
University of Amsterdam [Amsterdam]
Chris Donkin
  • Function : Author
University of New South Wales [Sydney]
Johnny van Doorn
University of Amsterdam [Amsterdam]
Ann Dreber
Stockholm School of Economics
Gilles Dutilh
  • Function : Author
University Hospital Basel [Basel]
Gary Egan
Monash University [Melbourne]
Morton Ann Gernsbacher
University of Wisconsin-Madison
Rink Hoekstra
University of Groningen [Groningen]
Sabine Hoffmann
Ludwig-Maximilians-Universität München
Felix Holzmeister
Leopold Franzens Universität Innsbruck - University of Innsbruck
Juergen Huber
Leopold Franzens Universität Innsbruck - University of Innsbruck
Magnus Johannesson
Stockholm School of Economics
Kai Jonas
  • Function : Author
Maastricht University [Maastricht]
Alexander Kindel
  • Function : Author
Princeton University
Michael Kirchler
Leopold Franzens Universität Innsbruck - University of Innsbruck
Yoram Kunkels
  • Function : Author
University of Groningen [Groningen]
D Stephen Lindsay
  • Function : Author
University of Victoria [Canada]
Jean-Francois Mangin
Université Paris-Saclay
Dora Matzke
  • Function : Author
University of Amsterdam [Amsterdam]
Marcus Munafò
  • Function : Author
University of Bristol [Bristol]
Ben Newell
University of New South Wales [Sydney]
Brian Nosek
  • Function : Author
University of Virginia
Russell Poldrack
Stanford University
Don van Ravenzwaaij
University of Groningen [Groningen]
Jörg Rieskamp
University of Basel
Matthew Salganik
  • Function : Author
Princeton University
Alexandra Sarafoglou
  • Function : Author
University of Amsterdam [Amsterdam]
Tom Schonberg
Tel Aviv University
Martin Schweinsberg
European School of Management and Technology [Berlin, Germany]
David Shanks
University College of London [London]
Raphael Silberzahn
  • Function : Author
University of Sussex
Daniel Simons
  • Function : Author
University of Illinois at Urbana-Champaign [Urbana]
Barbara Spellman
  • Function : Author
University of Virginia
Samuel St-Jean
University of Alberta
Jeffrey Starns
  • Function : Author
University of Massachusetts [Amherst]
Eric Luis Uhlmann
  • Function : Author
Institut européen d'administration des affaires [Singapour, Singapour]
Jelte Wicherts
Tilburg University [Tilburg]
Eric-Jan Wagenmakers
  • Function : Author
University of Amsterdam [Amsterdam]

Abstract

Any large dataset can be analyzed in a number of ways, and it is possible that the use of different analysis strategies will lead to different results and conclusions. One way to assess whether the results obtained depend on the analysis strategy chosen is to employ multiple analysts and leave each of them free to follow their own approach. Here, we present consensus-based guidance for conducting and reporting such multi-analyst studies, and we discuss how broader adoption of the multi-analyst approach has the potential to strengthen the robustness of results and conclusions obtained from analyses of datasets in basic and applied research.

Keywords

medicine neuroscience none

Domains

Neuroscience
Fichier principal
Vignette du fichier
Aczel.pdf (467.78 Ko) Télécharger le fichier
Origin : Publisher files allowed on an open archive

Emmanuel Caruyer  : Connect in order to contact the contributor

https://www.hal.inserm.fr/inserm-03431812

Submitted on : Thursday, June 2, 2022-11:55:07 AM

Last modification on : Wednesday, April 19, 2023-4:21:22 AM

Long-term archiving on: Saturday, September 3, 2022-7:02:00 PM

Download

Dates and versions

inserm-03431812 , version 1 (02-06-2022)

Licence

Attribution

Identifiers

Cite

Balazs Aczel, Barnabas Szaszi, Gustav Nilsonne, Olmo van den Akker, Casper Albers, et al.. Consensus-based guidance for conducting and reporting multi-analyst studies. eLife, 2021, 10, pp.e72185. ⟨10.7554/eLife.72185⟩. ⟨inserm-03431812⟩

Export

BibTeX TEI Dublin Core DC Terms EndNote Datacite

Collections

INSERM UNIV-RENNES1 CNRS INRIA INSA-RENNES IRISA CENTRALESUPELEC INRIA2 UR1-MATH-STIC UNIV-PARIS-SACLAY UR1-UFR-ISTIC UNIV-RENNES UR1-MATH-NUM UR1-BIO-SA
65 View
41 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More