How to deal with the keypoints which out of the image size

[HansonXia]

Hi,
in MPII dataset, some keypoints are out of the image size, or the coordinates of some points are (0, 0), how to deal with these keypoints when generate heatmaps and calculate loss?

[anewell]

If coordinates are outside of the image frame, the ground truth heatmap consists of all zeros, the same loss (mean squared error) is applied.

[ethanyanjiali]

but if it's just one or two pixels off the border, we will still have a little bit gaussian remaining for that joint right? because the gaussian patch itself is at least 7x7.

[HansonXia]

but if it's just one or two pixels off the border, we will still have a little bit gaussian remaining for that joint right? because the gaussian patch itself is at least 7x7.

My approach is to set the heatmap to 0, and do not calculate the loss