An application-dependent framework for the recognition of high-level surgical tasks in the OR

Florent Lalys 1, * Laurent Riffaud 2 David Bouget 1 Pierre Jannin 1
* Auteur correspondant
1 VisAGeS - Vision, Action et Gestion d'informations en Santé
INSERM - Institut National de la Santé et de la Recherche Médicale : U746, Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : Surgical process analysis and modeling is a recent and important topic aiming at introducing a new generation of computer-assisted surgical systems. Among all of the techniques already in use for extracting data from the Operating Room, the use of image videos allows automating the surgeons' assistance without altering the surgical routine. We proposed in this paper an application-dependent framework able to automatically extract the phases of the surgery only by using microscope videos as input data and that can be adaptable to different surgical specialties. First, four distinct types of classifiers based on image processing were implemented to extract visual cues from video frames. Each of these classifiers was related to one kind of visual cue: visual cues recognizable through color were detected with a color histogram approach, for shape-oriented visual cues we trained a Haar classifier, for texture-oriented visual cues we used a bag-of-word approach with SIFT descriptors, and for all other visual cues we used a classical image classification approach including a feature extraction, selection, and a supervised classification. The extraction of this semantic vector for each video frame then permitted to classify time series using either Hidden Markov Model or Dynamic Time Warping algorithms. The framework was validated on cataract surgeries, obtaining accuracies of 95%.
Type de document :
Communication dans un congrès
14th International Conference on Medical Image Computing and Computer Assisted Intervention, Sep 2011, Toronto, Canada. 1, pp.331-338, 2011
Liste complète des métadonnées

Littérature citée [20 références]  Voir  Masquer  Télécharger

http://www.hal.inserm.fr/inserm-00617015
Contributeur : Florent Lalys <>
Soumis le : jeudi 25 août 2011 - 14:38:34
Dernière modification le : mercredi 16 mai 2018 - 11:23:18
Document(s) archivé(s) le : samedi 26 novembre 2011 - 02:21:45

Fichier

paper_630_Lalys.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inserm-00617015, version 1

Citation

Florent Lalys, Laurent Riffaud, David Bouget, Pierre Jannin. An application-dependent framework for the recognition of high-level surgical tasks in the OR. 14th International Conference on Medical Image Computing and Computer Assisted Intervention, Sep 2011, Toronto, Canada. 1, pp.331-338, 2011. 〈inserm-00617015〉

Partager

Métriques

Consultations de la notice

891

Téléchargements de fichiers

471