Login | Request Account (DAF staff only)

LiDAR-Guided Cross-Attention Fusion for Hyperspectral Band Selection and Image Classification

View Altmetrics

Yang, J. X., Zhou, J., Wang, J., Tian, H. and Liew, A. W.-C. (2024) LiDAR-Guided Cross-Attention Fusion for Hyperspectral Band Selection and Image Classification. IEEE Transactions on Geoscience and Remote Sensing, 62 . pp. 1-15. ISSN 1558-0644


Article Link: https://doi.org/10.1109/TGRS.2024.3389651

Publisher URL: https://arxiv.org/pdf/2404.03883


The fusion of hyperspectral and light detection and range (LiDAR) data has been an active research topic. Existing fusion methods have ignored the high-dimensionality and redundancy challenges in hyperspectral images (HSIs), despite that band selection methods have been intensively studied for HSI processing. This article addresses this significant gap by introducing a cross-attention mechanism from the transformer architecture for the selection of HSI bands guided by LiDAR data. LiDAR provides high-resolution vertical structural information, which can be useful in distinguishing different types of land cover that may have similar spectral signatures but different structural profiles. In our approach, the LiDAR data are used as the “query” to search and identify the “key” from the HSI to choose the most pertinent bands for LiDAR. This method ensures that the selected HSI bands drastically reduce redundancy and computational requirements while working optimally with the LiDAR data. Extensive experiments have been undertaken on three paired HSI and LiDAR datasets: Houston 2013, Trento, and MUUFL. The results highlight the superiority of the cross-attention mechanism, underlining the enhanced classification accuracy of the identified HSI bands when fused with the LiDAR features. The results also show that the use of fewer bands combined with LiDAR surpasses the performance of state-of-the-art fusion models.

Item Type:Article
Corporate Creators:Department of Agriculture and Fisheries, Queensland
Business groups:Animal Science
Keywords:AgTech, AgriTech, Remote sensing, multimodal data fusion, hyperspectral images, LiDAR data, band selection, cross-attention.
Subjects:Agriculture > Agriculture (General) > Special aspects of agriculture as a whole > Remote sensing
Live Archive:07 May 2024 00:08
Last Modified:07 May 2024 00:08

Repository Staff Only: item control page


Downloads per month over past year

View more statistics