Interactive Keypoint Estimation


Jinhee Kim*
Taesung Kim*
Taewoo Kim
Jaegul Choo
Dong-Wook Kim
Korea University Anam Hospital
Byungduk Ahn
Papa's dental clinic
In-Seok Song**
Korea University Anam Hospital
Yoon-Ji Kim**
Asan Medical Center, Ulsan University School of Medicine
*Both authors contributed equally. **Both authors are the co-corresponding authors.
Responsive image
Overview of the proposed approach.


Diagnosis based on medical images, such as X-ray images, often involves manual annotation of anatomical keypoints. However, this process involves significant human efforts and can thus be a bottleneck in the diagnostic process. To fully automate this procedure, deep-learningbased methods have been widely proposed and have achieved high performance in detecting keypoints in medical images. However, these methods still have clinical limitations: accuracy cannot be guaranteed for all cases, and it is necessary for doctors to double-check all predictions of models. In response, we propose a novel deep neural network that, given an Xray image, automatically detects and refines the anatomical keypoints through a user-interactive system in which doctors can fix mispredicted keypoints with fewer clicks than needed during manual revision. Using our own collected data and the publicly available AASCE dataset, we demonstrate the effectiveness of the proposed method in reducing the annotation costs via extensive quantitative and qualitative results.

Paper and Supplementary Material

[Arxiv] [Code] [Video]

MICCAI, 2022.
Jinhee Kim*, Taeusng Kim*, Taewoo Kim, Jaegul Choo,
Dong-Wook Kim, Byungduk Ahn, In-Seok Song**, and Yoon-Ji Kim**
"Morphology-Aware Interactive Keypoint Estimation"

Method overview

Responsive image
Figure: Overview of proposed interactive keypoint estimation model.
Responsive image
Figure: Illustration of Morphology-aware loss.


Responsive image