Journal Article

Group-in-Group Relation-Based Transformer for 3D Point Cloud Learning

Song, Zhijian, Liu, Shaolei, Fu, Kexue, Wang, Manning

2022

Overview

Deep point cloud neural networks have achieved promising performance in remote sensing applications, and the prevalence of Transformer in natural language processing and computer vision is in stark contrast to underexplored point-based methods. In this paper, we propose an effective transformer-based network for point cloud learning. To better learn global and local information, we propose a group-in-group relation-based transformer architecture to learn the relationships between point groups to model global information and between points within each group to model local semantic information. To further enhance the local feature representation, we propose a Radius Feature Abstraction (RFA) module to extract radius-based density features characterizing the sparsity of local point clouds. Extensive evaluation on public benchmark datasets demonstrate the effectiveness and competitive performance of our proposed method on point cloud classification and part segmentation.

• Publisher: MDPI AG
• Subject: 3D point clouds / Cloud computing / Computer vision / Deep learning / Feature extraction / Image segmentation / Learning / Natural language / Natural language processing / Neural networks / point cloud classification / point cloud segmentation / Queries / Remote sensing / Semantics / Sparsity / Three dimensional models / transformer