Published 2024
| Version v3
Dataset
Open
SpectralGPT: The first remote sensing foundation model customized for spectral data
Authors/Creators
Authors/Creators
- 1. Aerospace Information Research Institute, Chinese Academy of Sciences
- 2. Southeast University
- 3. The University of Tokyo
- 4. Technical University of Munich
-
5.
Helmholtz-Zentrum Dresden-Rossendorf
- 6. University of New South Wales
- 7. University of Extremadura
- 8. University of Pavia
- 9. University of Iceland
- 10. Univ. Grenoble Alpes
Description
SpectralGPT is the first purpose-built foundation model designed explicitly for spectral RS data. It considers unique characteristics of spectral data, i.e., spatial-spectral coupling and spectral sequentiality, in the MAE framework with a simple yet effective 3D GPT network.
We will gradually release the trained models (SpectralGPT, SpectralGPT+), the new benchmark dataset (SegMunich) for the downstream task of semantic segmentation, original code, and implementation instructions.