Journal Article

An enhanced spatial-temporal graph convolution network with high order features for skeleton-based action recognition

Quradaa, Fahmi H., Almoqbily, Rashad S., Haseeb, Muhammad, Al-Hakimi, Mohammed H., Ahmed, Ibrar, Rassem, Taha H.

2025

Overview

Skeleton-based action recognition has emerged as a promising field within computer vision, offering structured representations of human motion. While existing Graph Convolutional Network (GCN)-based approaches primarily rely on raw 3D joint coordinates, these representations fail to capture higher-order spatial and temporal dependencies critical for distinguishing fine-grained actions. In this study, we introduce novel geometric features for joints, bones, and motion streams, including multi-level spatial normalization, higher-order temporal derivatives, and bone-structure encoding through lengths, angles, and anatomical distances. These enriched features explicitly model kinematic and structural relationships, enabling the capture of subtle motion dynamics and discriminative patterns. Building on this, we propose two architectures: (i) an Enhanced Multi-Stream AGCN (EMS-AGCN) that integrates joint, bone, and motion features via a weighted fusion at the final layer, and (ii) a Multi-Branch AGCN (MB-AGCN) where features are processed in independent branches and fused adaptively at an early layer. Comprehensive experiments on the NTU-RGB+D 60 benchmark demonstrate the effectiveness of our approach: EMS-AGCN achieves 96.2% accuracy and MB-AGCN attains 95.5%, both surpassing state-of-the-art methods. These findings confirm that incorporating higher-order geometric features alongside adaptive fusion mechanisms substantially improves skeleton-based action recognition.

• Publisher: Public Library of Science,Public Library of Science (PLoS)
• Subject: Accuracy / Activity recognition / Algorithms / Artificial neural networks / Biomechanical Phenomena / Bone and Bones - physiology / Bones / Computer vision / Deep learning / Human mechanics / Human motion / Humans / Innovations / Joints (anatomy) / Joints - anatomy & histology / Joints - physiology / Kinematics / Machine vision / Methods / Neural networks / Neural Networks, Computer / Representations / Skeleton