W dniach 16 - 19 października 2022, w Bordeaux, odbyła się The 29th IEEE International Conference on Image Processing (https://2022.ieeeicip.org/). W trakcie konferencji przedstawiono pracę zrealizowaną w ramach zadania 4 projektu RID: Tomasz Kapuściński, Mateusz Miś: Differential Pseudo-Image for Skeleton-Based Dynamic Gesture Recognition, https://doi.org/10.1109/ICIP46576.2022.9897220. Artykuł został opublikowany w IEEE Xplore. Konferencja znajduje się na liście MEiN (70 pkt).
Abstract:
The approach described in this paper uses the potential of deep convolutional neural networks (DCNN), pre-trained to recognize images, to classify dynamic gestures. For this purpose, the sequences of articulated human poses, obtained with RGB-D imaging devices, and called skeletons, are replaced by space-time images. Since such images, observed by humans, do not have a clear physical interpretation, they are called pseudo-images. This paper reviews the existing mapping techniques and proposes a new one called Differential Pseudo-Image (DPI). The developed method is compared with approaches using other types of pseudo-images and with other methods of recognizing human actions available in the literature. It turns out, that for the Polish Sign Language (PSL) dataset and the publicly available UTD Multimodal Human Action Dataset (UTD-MHAD), DPI outperforms other forms of mapping the skeleton sequence. The method based on pseudo-images and convolutional neural networks have the potential that justifies further research in this direction.
