Published April 3, 2024 | Version v4
Dataset Open

SpectralGPT: The first remote sensing foundation model customized for spectral data

  • 1. Aerospace Information Research Institute, Chinese Academy of Sciences
  • 2. Southeast University
  • 3. The University of Tokyo
  • 4. Technical University of Munich
  • 5. ROR icon Helmholtz-Zentrum Dresden-Rossendorf
  • 6. University of New South Wales
  • 7. University of Extremadura
  • 8. University of Pavia
  • 9. University of Iceland
  • 10. Univ. Grenoble Alpes

Description

SpectralGPT is the first purpose-built foundation model designed explicitly for spectral RS data. It considers unique characteristics of spectral data, i.e., spatial-spectral coupling and spectral sequentiality, in the MAE framework with a simple yet effective 3D GPT network.

We will gradually release the trained models (SpectralGPT, SpectralGPT+), the new benchmark dataset (SegMunich) for the downstream task of semantic segmentation, original code, and implementation instructions.

Files

Guide_for_SpectralGPT_v1.pdf

Files (5.5 GB)

Name Size Download all
md5:de3a57c6cb1057f14c4b87fcdb59dbba
133.4 kB Preview Download
md5:8d66bc0c2b90e7a3f31d35bfadf39b82
1.3 GB Download
md5:59aeb5d227a320ec148900a4bf7833e7
1.4 GB Preview Download
md5:aeaa08388f0937e3f07ecbd7757f20dc
1.2 GB Download
md5:4dc924fa4b4f391cf1019cf2b4ea20d7
437.0 MB Download
md5:0464b11758bc309b02ee6616b58f0bed
1.2 GB Download