Exploring Operators's Natural Behaviors to Predict Catheterization Trial Outcomes in Robot assisted Intravascular Interventions

Wenjing Du, Olatunji Mumini Omisore, Wenke Duan, Lu Gan, Toluwanimi Oluwadra Akinyemi, Boon giin Lee, Jiang Liu, Lei Wang

Research output: Journal PublicationArticlepeer-review

5 Citations (Scopus)


Recently, robotic catheterization has enhanced the outcomes of cardiovascular interventions. Meanwhile, the roles of operator's natural behavior in the robot-assisted intravascular procedures need more attention. In this paper, operators' hand activities related to endovascular tool manipulation are studied to explore how operators' hand motions aid robotic catheterization. Controlled in-vivo studies were set up to acquire four types of operators' natural behaviors during 60 robotic catheterization trials, and activity signals were recorded to proxy operators' skills. A multi-layer recognition model is developed for predicting trial outcomes and recognizing the hand motions made during the procedures. The model operates convolution and dense layers to multiplex features extracted in single to multiple data modalities. Starting with an initial-decision layer, the model is built to train and classify catheterization trials recorded from nine interventionists as successful and unsuccessful. Next, a motion-decision layer is built to recognize interventionists' hand motions using features from different data modalities. Lastly, a mixed-decision layer is integrated to recognize the motion patterns of the successful and unsuccessful trials. Results show that the initial-decision layer has an accuracy of 99.44% in predicting the catheterization trials as successful and unsuccessful, while the motion-decision layer shows accuracies of 98.55% and 98.44% in classifying the seven types of hand motions that operators engage during successful and unsuccessful trials, respectively. Also, the mixed-decision layer has an accuracy of 93.96% in recognizing 14 mixed patterns from both trial classes. This study provides an objective template for skill training and evaluation in robot-assisted catheterization.

Original languageEnglish
Pages (from-to)1
Number of pages1
JournalIEEE Transactions on Medical Robotics and Bionics
Issue number3
Publication statusPublished - 12 Jul 2022


  • Behavioral sciences
  • biomedical signal processing
  • Catheterization
  • Navigation
  • Rabbits
  • recognition framework
  • Robot kinematics
  • Robot sensing systems
  • Robot-assisted catheterization
  • Robots
  • technical skill assessment

ASJC Scopus subject areas

  • Biomedical Engineering
  • Human-Computer Interaction
  • Computer Science Applications
  • Control and Optimization
  • Artificial Intelligence


Dive into the research topics of 'Exploring Operators's Natural Behaviors to Predict Catheterization Trial Outcomes in Robot assisted Intravascular Interventions'. Together they form a unique fingerprint.

Cite this