Skip to Main content Skip to Navigation
Journal articles

Exploring the Impact of Analysis Software on Task fMRI Results

Alexander Bowring 1 Camille Maumet 2 Thomas E. Nichols 3, 1, 4, * 
* Corresponding author
2 Empenn
INSERM - Institut National de la Santé et de la Recherche Médicale, Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : A wealth of analysis tools are available to fMRI researchers in order to extract patterns of task variation and, ultimately, understand cognitive function. However, this 'methodological plurality' comes with a drawback. While conceptually similar, two different analysis pipelines applied on the same dataset may not produce the same scientific results. Differences in methods, implementations across software packages, and even operating systems or software versions all contribute to this variability. Consequently, attention in the field has recently been directed to reproducibility and data sharing. Neuroimaging is currently experiencing a surge in initiatives to improve research practices and ensure that all conclusions inferred from an fMRI study are replicable. In this work, our goal is to understand how choice of software package impacts on analysis results. We use publically shared data from three published task fMRI neuroimaging studies, reanalyzing each study using the three main neuroimaging software packages, AFNI, FSL and SPM, using parametric and nonparametric inference. We obtain all information on how to process, analyze, and model each dataset from the publications. We make quantitative and qualitative comparisons between our replications to gauge the scale of variability in our results and assess the fundamental differences between each software package. While qualitatively we find broad similarities between packages, we also discover marked differences, such as Dice similarity coefficients ranging from 0.000-0.743 in comparisons of thresholded statistic maps between software. We discuss the challenges involved in trying to reanalyse the published studies, and highlight our own efforts to make this research reproducible.
Document type :
Journal articles
Complete list of metadata

Cited literature [40 references]  Display  Hide  Download
Contributor : Camille Maumet Connect in order to contact the contributor
Submitted on : Tuesday, September 25, 2018 - 3:11:55 PM
Last modification on : Friday, April 8, 2022 - 4:04:03 PM


Files produced by the author(s)


Distributed under a Creative Commons Attribution 4.0 International License



Alexander Bowring, Camille Maumet, Thomas E. Nichols. Exploring the Impact of Analysis Software on Task fMRI Results. Human Brain Mapping, Wiley, 2019, 40 (11), pp.3362-3384. ⟨10.1002/hbm.24603⟩. ⟨inserm-01760535v2⟩



Record views


Files downloads