Skip to Main content Skip to Navigation
Journal articles

Evaluation of registration methods on thoracic CT: the EMPIRE10 challenge.

Keelin Murphy 1 Bram van Ginneken 1, * Joseph M. Reinhardt 2 Sven Kabus 3 Kai Ding 2 Xiang Deng 4 Kunlin Cao 2, 5 Kaifang Du 2 Gary E. Christensen 2 Vincent Garcia 6 Tom Vercauteren 7 Nicholas Ayache 8 Olivier Commowick 9 Grégoire Malandain 8 Ben Glocker 10 Nikolaos Paragios 11, 12 Nassir Navab 10 Vladlena Gorbunova 13 Jon Sporring 13 Marleen de Bruijne 13, 14 Xiao Han 15 Mattias P. Heinrich 16, 17 Julia A. Schnabel 16 Mark Jenkinson 17 Cristian Lorenz 3 Marc Modat 18 Jamie R. Mcclelland 18 Sébastien Ourselin 18 Sacha Ea Muenzing 1 Max A. Viergever 1 Dante de Nigris 19 Louis D. Collins 20, 21 Tal Arbel 19 Marta Peroni 22 Rui Li 22 Gregory C. Sharp 22 Alexander Schmidt-Richberg 23 Jan Ehrhardt 23 René Werner 23 Dirk Smeets 24 Dirk Loeckx 24 Gang Song 25 Nicholas Tustison 26 Brian Avants 25 James C. Gee 25 Marius Staring 27 Stefan Klein 14 Berend C. Stoel 27 Martin Urschler 28 Manuel Werlberger 28 Jef Vandemeulebroucke 29 Simon Rit 30 David Sarrut 30 Josien Pw Pluim 1 
* Corresponding author
8 ASCLEPIOS - Analysis and Simulation of Biomedical Images
CRISAM - Inria Sophia Antipolis - Méditerranée
9 VisAGeS - Vision, Action et Gestion d'informations en Santé
INSERM - Institut National de la Santé et de la Recherche Médicale : U746, Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
30 Imagerie Tomographique et Radiothérapie
CREATIS - Centre de Recherche en Acquisition et Traitement de l'Image pour la Santé
Abstract : EMPIRE10 (Evaluation of Methods for Pulmonary Image REgistration 2010) is a public platform for fair and meaningful comparison of registration algorithms which are applied to a database of intrapatient thoracic CT image pairs. Evaluation of nonrigid registration techniques is a nontrivial task. This is compounded by the fact that researchers typically test only on their own data, which varies widely. For this reason, reliable assessment and comparison of different registration algorithms has been virtually impossible in the past. In this work we present the results of the launch phase of EMPIRE10, which comprised the comprehensive evaluation and comparison of 20 individual algorithms from leading academic and industrial research groups. All algorithms are applied to the same set of 30 thoracic CT pairs. Algorithm settings and parameters are chosen by researchers expert in the configuration of their own method and the evaluation is independent, using the same criteria for all participants. All results are published on the EMPIRE10 website ( The challenge remains ongoing and open to new participants. Full results from 24 algorithms have been published at the time of writing. This paper details the organization of the challenge, the data and evaluation methods and the outcome of the initial launch with 20 algorithms. The gain in knowledge and future work are discussed.
Document type :
Journal articles
Complete list of metadata

Cited literature [59 references]  Display  Hide  Download
Contributor : Olivier Commowick Connect in order to contact the contributor
Submitted on : Monday, July 11, 2011 - 12:46:19 PM
Last modification on : Saturday, September 24, 2022 - 2:44:04 PM
Long-term archiving on: : Thursday, March 30, 2017 - 12:59:29 PM


 Restricted access
To satisfy the distribution rights of the publisher, the document is embargoed until : jamais

Please log in to resquest access to the document



Keelin Murphy, Bram van Ginneken, Joseph M. Reinhardt, Sven Kabus, Kai Ding, et al.. Evaluation of registration methods on thoracic CT: the EMPIRE10 challenge.. IEEE Transactions on Medical Imaging, Institute of Electrical and Electronics Engineers, 2011, 30 (11), pp.1901-20. ⟨10.1109/TMI.2011.2158349⟩. ⟨inserm-00607794⟩



Record views