A hybrid method for real-time bronchoscope tracking using contour registration and synchronous EMT data

Mehdi Samavati, Alireza Ahmadian, Hamidreza Abtahi, Amir Golnabi, Reza Arjmandi Asl

Research output: Contribution to journalArticle

Abstract

Background: Bronchoscopy is a difficult procedure for physicians to relate CT slices to bronchoscopic video images and maneuver the bronchoscope inside the airway tree. CT-guided bronchoscopy systems have been developed in the last decades to help physicians maneuver the bronchoscope inside the airway tree in a fast and precise way. Objectives: We aimed to develop a continuous guiding method for bronchoscopy with high tracking accuracy by matching bronchoscopy image contours with CT contours, and speed it up by using synchronous electromagnetic tracker (EMT) data, and to evaluate it on airway phantom with simulated respiratory motion. Materials and Methods: This method works based on two approaches combined together: 1) Contours detected in real bronchoscopy images and finding their equivalents in CT space. Contours are detected by a fast algorithm and CT contours are mapped by them in a perspective scheme. 2) EMT data which is used in a frame by frame approach to approximate the position of bronchoscope compared to its previous position. This differential approach causes a small search space and as a result higher tracking speed. The novelty of this work is using bronchoscopy image contours instead of the whole image combined with synchronous EMT data. This approach causes faster tracking and there is no need for landmark selection or centerline consideration before performing the main bronchoscopy. Results: The experimental results of implementing the proposed method show that this method can track the bronchoscope continuously. For evaluating the accuracy and robustness of tracking, virtual bronchoscopy images were generated at each frame position reported by the method and compared to corresponding real bronchoscopy image using mutual information. The experimental results present that this method can track a bronchoscope accurately and robustly in 96.3% of frames. Conclusion: Using contours instead of the whole image for registration can provide a continuous real-time bronchoscopy tracking procedure. Using EMT data in differential mode makes the proposed method robust to simulated respiratory motion.

Original languageEnglish
Article numbere66994
JournalIranian Journal of Radiology
Volume16
Issue number2
DOIs
StatePublished - 1 Apr 2019

Fingerprint

Bronchoscopes
Electromagnetic Phenomena
Bronchoscopy
Physicians

Keywords

  • Bronchoscopy navigation
  • Contour-based 2D/3D image registration
  • CT-guided bronchoscopy
  • Hybrid tracking

Cite this

Samavati, Mehdi ; Ahmadian, Alireza ; Abtahi, Hamidreza ; Golnabi, Amir ; Asl, Reza Arjmandi. / A hybrid method for real-time bronchoscope tracking using contour registration and synchronous EMT data. In: Iranian Journal of Radiology. 2019 ; Vol. 16, No. 2.
@article{dafd53673ce346a5ade6b6ba29b05328,
title = "A hybrid method for real-time bronchoscope tracking using contour registration and synchronous EMT data",
abstract = "Background: Bronchoscopy is a difficult procedure for physicians to relate CT slices to bronchoscopic video images and maneuver the bronchoscope inside the airway tree. CT-guided bronchoscopy systems have been developed in the last decades to help physicians maneuver the bronchoscope inside the airway tree in a fast and precise way. Objectives: We aimed to develop a continuous guiding method for bronchoscopy with high tracking accuracy by matching bronchoscopy image contours with CT contours, and speed it up by using synchronous electromagnetic tracker (EMT) data, and to evaluate it on airway phantom with simulated respiratory motion. Materials and Methods: This method works based on two approaches combined together: 1) Contours detected in real bronchoscopy images and finding their equivalents in CT space. Contours are detected by a fast algorithm and CT contours are mapped by them in a perspective scheme. 2) EMT data which is used in a frame by frame approach to approximate the position of bronchoscope compared to its previous position. This differential approach causes a small search space and as a result higher tracking speed. The novelty of this work is using bronchoscopy image contours instead of the whole image combined with synchronous EMT data. This approach causes faster tracking and there is no need for landmark selection or centerline consideration before performing the main bronchoscopy. Results: The experimental results of implementing the proposed method show that this method can track the bronchoscope continuously. For evaluating the accuracy and robustness of tracking, virtual bronchoscopy images were generated at each frame position reported by the method and compared to corresponding real bronchoscopy image using mutual information. The experimental results present that this method can track a bronchoscope accurately and robustly in 96.3{\%} of frames. Conclusion: Using contours instead of the whole image for registration can provide a continuous real-time bronchoscopy tracking procedure. Using EMT data in differential mode makes the proposed method robust to simulated respiratory motion.",
keywords = "Bronchoscopy navigation, Contour-based 2D/3D image registration, CT-guided bronchoscopy, Hybrid tracking",
author = "Mehdi Samavati and Alireza Ahmadian and Hamidreza Abtahi and Amir Golnabi and Asl, {Reza Arjmandi}",
year = "2019",
month = "4",
day = "1",
doi = "10.5812/iranjradiol.66994",
language = "English",
volume = "16",
journal = "Iranian Journal of Radiology",
issn = "1735-1065",
number = "2",

}

A hybrid method for real-time bronchoscope tracking using contour registration and synchronous EMT data. / Samavati, Mehdi; Ahmadian, Alireza; Abtahi, Hamidreza; Golnabi, Amir; Asl, Reza Arjmandi.

In: Iranian Journal of Radiology, Vol. 16, No. 2, e66994, 01.04.2019.

Research output: Contribution to journalArticle

TY - JOUR

T1 - A hybrid method for real-time bronchoscope tracking using contour registration and synchronous EMT data

AU - Samavati, Mehdi

AU - Ahmadian, Alireza

AU - Abtahi, Hamidreza

AU - Golnabi, Amir

AU - Asl, Reza Arjmandi

PY - 2019/4/1

Y1 - 2019/4/1

N2 - Background: Bronchoscopy is a difficult procedure for physicians to relate CT slices to bronchoscopic video images and maneuver the bronchoscope inside the airway tree. CT-guided bronchoscopy systems have been developed in the last decades to help physicians maneuver the bronchoscope inside the airway tree in a fast and precise way. Objectives: We aimed to develop a continuous guiding method for bronchoscopy with high tracking accuracy by matching bronchoscopy image contours with CT contours, and speed it up by using synchronous electromagnetic tracker (EMT) data, and to evaluate it on airway phantom with simulated respiratory motion. Materials and Methods: This method works based on two approaches combined together: 1) Contours detected in real bronchoscopy images and finding their equivalents in CT space. Contours are detected by a fast algorithm and CT contours are mapped by them in a perspective scheme. 2) EMT data which is used in a frame by frame approach to approximate the position of bronchoscope compared to its previous position. This differential approach causes a small search space and as a result higher tracking speed. The novelty of this work is using bronchoscopy image contours instead of the whole image combined with synchronous EMT data. This approach causes faster tracking and there is no need for landmark selection or centerline consideration before performing the main bronchoscopy. Results: The experimental results of implementing the proposed method show that this method can track the bronchoscope continuously. For evaluating the accuracy and robustness of tracking, virtual bronchoscopy images were generated at each frame position reported by the method and compared to corresponding real bronchoscopy image using mutual information. The experimental results present that this method can track a bronchoscope accurately and robustly in 96.3% of frames. Conclusion: Using contours instead of the whole image for registration can provide a continuous real-time bronchoscopy tracking procedure. Using EMT data in differential mode makes the proposed method robust to simulated respiratory motion.

AB - Background: Bronchoscopy is a difficult procedure for physicians to relate CT slices to bronchoscopic video images and maneuver the bronchoscope inside the airway tree. CT-guided bronchoscopy systems have been developed in the last decades to help physicians maneuver the bronchoscope inside the airway tree in a fast and precise way. Objectives: We aimed to develop a continuous guiding method for bronchoscopy with high tracking accuracy by matching bronchoscopy image contours with CT contours, and speed it up by using synchronous electromagnetic tracker (EMT) data, and to evaluate it on airway phantom with simulated respiratory motion. Materials and Methods: This method works based on two approaches combined together: 1) Contours detected in real bronchoscopy images and finding their equivalents in CT space. Contours are detected by a fast algorithm and CT contours are mapped by them in a perspective scheme. 2) EMT data which is used in a frame by frame approach to approximate the position of bronchoscope compared to its previous position. This differential approach causes a small search space and as a result higher tracking speed. The novelty of this work is using bronchoscopy image contours instead of the whole image combined with synchronous EMT data. This approach causes faster tracking and there is no need for landmark selection or centerline consideration before performing the main bronchoscopy. Results: The experimental results of implementing the proposed method show that this method can track the bronchoscope continuously. For evaluating the accuracy and robustness of tracking, virtual bronchoscopy images were generated at each frame position reported by the method and compared to corresponding real bronchoscopy image using mutual information. The experimental results present that this method can track a bronchoscope accurately and robustly in 96.3% of frames. Conclusion: Using contours instead of the whole image for registration can provide a continuous real-time bronchoscopy tracking procedure. Using EMT data in differential mode makes the proposed method robust to simulated respiratory motion.

KW - Bronchoscopy navigation

KW - Contour-based 2D/3D image registration

KW - CT-guided bronchoscopy

KW - Hybrid tracking

UR - http://www.scopus.com/inward/record.url?scp=85068690617&partnerID=8YFLogxK

U2 - 10.5812/iranjradiol.66994

DO - 10.5812/iranjradiol.66994

M3 - Article

AN - SCOPUS:85068690617

VL - 16

JO - Iranian Journal of Radiology

JF - Iranian Journal of Radiology

SN - 1735-1065

IS - 2

M1 - e66994

ER -