Abstract:
Objectives Carrier aircraft deck space is limited, the layout is complex, the carrier aircraft deck operation is subject to environmental factors constraints, and the number of individuals involved in different operations and operating time is different, and the degree of close spatial and temporal interaction between individuals dynamically changes. To this end, a multi-dimensional feature-based recognition method for carrier aircraft deck operation is proposed. Methods Firstly, key points such as channel boundaries and static obstacles are accurately selected to represent the environmental information, and the interactions between dynamic individuals and static environmental objects are modelled by graph convolutional networks, to deeply explore the potential connections of operational object interactions. Then, a multi-scale spatio-temporal feature extraction module is designed to introduce the dilated attention mechanism, which focuses on the key individual interactions in global and local space by setting different dilation rates; at the same time, temporal sequential convolutional networks (TCN) and the attention mechanism are used to extract the interaction features between individuals in the temporal dimension, so as to efficiently capture the dynamic relationships between individuals in the long and short sequences; finally, multiple designed multi-scale spatio-temporal feature extraction modules are stacked to adaptively extract multi-dimensional feature to improve the recognition accuracy of carrier aircraft deck operations. Results Experimental results show that, on a self-built dataset of heterogeneous object carrier aircraft deck operation recognition from different perspectives, the proposed method significantly outperforms group activity recognition methods such as ARG, DIN, AT, and GroupFormer in terms of accuracy, achieving a recognition precision of 97.83%.Conclusions The proposed method achieves high precision in carrier aircraft deck operation recognition and provides important support for enhancing aircraft carrier operational effectiveness.