Consensus-based guidance for conducting and reporting multi-analyst studies - Archive ouverte HAL Access content directly
Journal Articles eLife Year : 2021

Consensus-based guidance for conducting and reporting multi-analyst studies

(1) , (1) , (2) , (3) , (4) , (3) , (4) , (5) , (6) , (7) , (4) , (8) , (9) , (10) , (11) , (12) , (6) , (13) , (6) , (14) , (15) , (16) , (17) , (4) , (18) , (19) , (19) , (14) , (20) , (21) , (19) , (4) , (22) , (23) , (6) , (24) , (13) , (25) , (26) , (4) , (27) , (21) , (6) , (28) , (29) , (30) , (31) , (32) , (25) , (33) , (34) , (35) , (3) , (6)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
Balazs Aczel
Eötvös Loránd University
Barnabas Szaszi
Eötvös Loránd University
Gustav Nilsonne
Karolinska Institutet [Stockholm]
Olmo van den Akker
  • Function : Author
Tilburg University [Tilburg]
Casper Albers
  • Function : Author
University of Groningen [Groningen]
Marcel Alm van Assen
  • Function : Author
Tilburg University [Tilburg]
Jojanneke Bastiaansen
University of Groningen [Groningen]
Daniel Benjamin
University of Southern California
Udo Boehm
University of Amsterdam [Amsterdam]
Rotem Botvinik-Nezer
Dartmouth College [Hanover]
Laura Bringmann
University of Groningen [Groningen]
Niko Busch
Westfälische Wilhelms-Universität Münster = University of Münster
Emmanuel Caruyer
Neuroimagerie: méthodes et applications
Andrea Cataldo
McLean Hospital [Belmont, Ma.]
Nelson Cowan
University of Missouri [Columbia]
Andrew Delios
National University of Singapore
Noah van Dongen
University of Amsterdam [Amsterdam]
Chris Donkin
  • Function : Author
University of New South Wales [Sydney]
Johnny van Doorn
University of Amsterdam [Amsterdam]
Ann Dreber
Stockholm School of Economics
Gilles Dutilh
  • Function : Author
University Hospital Basel [Basel]
Gary Egan
Monash University [Melbourne]
Morton Ann Gernsbacher
University of Wisconsin-Madison
Rink Hoekstra
University of Groningen [Groningen]
Sabine Hoffmann
Ludwig-Maximilians-Universität München
Felix Holzmeister
Leopold Franzens Universität Innsbruck - University of Innsbruck
Juergen Huber
Leopold Franzens Universität Innsbruck - University of Innsbruck
Magnus Johannesson
Stockholm School of Economics
Kai Jonas
  • Function : Author
Maastricht University [Maastricht]
Alexander Kindel
  • Function : Author
Princeton University
Michael Kirchler
Leopold Franzens Universität Innsbruck - University of Innsbruck
Yoram Kunkels
  • Function : Author
University of Groningen [Groningen]
D Stephen Lindsay
  • Function : Author
University of Victoria [Canada]
Jean-Francois Mangin
Université Paris-Saclay
Dora Matzke
  • Function : Author
University of Amsterdam [Amsterdam]
Marcus Munafò
  • Function : Author
University of Bristol [Bristol]
Ben Newell
University of New South Wales [Sydney]
Brian Nosek
  • Function : Author
University of Virginia [Charlottesville]
Russell Poldrack
Stanford University
Don van Ravenzwaaij
University of Groningen [Groningen]
Jörg Rieskamp
University of Basel
Matthew Salganik
  • Function : Author
Princeton University
Alexandra Sarafoglou
  • Function : Author
University of Amsterdam [Amsterdam]
Tom Schonberg
Tel Aviv University
Martin Schweinsberg
European School of Management and Technology [Berlin, Germany]
David Shanks
University College of London [London]
Raphael Silberzahn
  • Function : Author
University of Sussex
Daniel Simons
  • Function : Author
University of Illinois at Urbana-Champaign [Urbana]
Barbara Spellman
  • Function : Author
University of Virginia [Charlottesville]
Samuel St-Jean
University of Alberta
Jeffrey Starns
  • Function : Author
University of Massachusetts [Amherst]
Eric Luis Uhlmann
  • Function : Author
Institut européen d'administration des affaires [Singapour, Singapour]
Jelte Wicherts
Tilburg University [Tilburg]
Eric-Jan Wagenmakers
  • Function : Author
University of Amsterdam [Amsterdam]

Abstract

Any large dataset can be analyzed in a number of ways, and it is possible that the use of different analysis strategies will lead to different results and conclusions. One way to assess whether the results obtained depend on the analysis strategy chosen is to employ multiple analysts and leave each of them free to follow their own approach. Here, we present consensus-based guidance for conducting and reporting such multi-analyst studies, and we discuss how broader adoption of the multi-analyst approach has the potential to strengthen the robustness of results and conclusions obtained from analyses of datasets in basic and applied research.

Keywords

medicine neuroscience none

Domains

Cognitive science Neuroscience
Fichier principal
Vignette du fichier
Aczel.pdf (467.78 Ko) Télécharger le fichier
Origin : Publisher files allowed on an open archive

Emmanuel Caruyer  : Connect in order to contact the contributor

https://www.hal.inserm.fr/inserm-03431812

Submitted on : Thursday, June 2, 2022-11:55:07 AM

Last modification on : Thursday, January 26, 2023-4:01:39 AM

Long-term archiving on: Saturday, September 3, 2022-7:02:00 PM

Download

Dates and versions

inserm-03431812 , version 1 (02-06-2022)

Licence

Attribution - CC BY 4.0

Identifiers

Cite

Balazs Aczel, Barnabas Szaszi, Gustav Nilsonne, Olmo van den Akker, Casper Albers, et al.. Consensus-based guidance for conducting and reporting multi-analyst studies. eLife, 2021, 10, pp.e72185. ⟨10.7554/eLife.72185⟩. ⟨inserm-03431812⟩

Export

BibTeX TEI Dublin Core DC Terms EndNote Datacite

Collections

INSERM UNIV-RENNES1 CNRS INRIA INSA-RENNES IRISA CENTRALESUPELEC INRIA2 UR1-MATH-STIC UNIV-PARIS-SACLAY UR1-UFR-ISTIC UNIV-RENNES UR1-MATH-NUM UR1-BIO-SA
54 View
18 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More