INSPECTION_DATASET_RGBD_HS

The dataset consists of multiple sessions, each with a unique variety or a combination of varieties and captured using a specific set of technical specifications. The data were collected at a vineyard in the summer of 2023. The distance between the camera and RGBD images ranges from 60 to 80 centimeters, while Hyperspectral images range from 80 to 100 centimeters. The RGBD images have a resolution of 2208 x 1242 pixels, which provides detailed visual data for analysis. Simultaneously, in the hyperspectral camera the grayscale (panchromatic) images have a resolution of 1000 x 1000 pixels, with the respective co-registered cube files having a spatial resolution of 50 x 50 pixels. The spectral dimension spans 138 bands, with a spectral range from 450 to 998 nms, i.e., a spectral resolution of 4 nm, allowing for a more detailed analysis of the spectral information. The hyperspectral data was captured in "RAW" mode, with the grabbed values corresponding to digital numbers (DN).

The data acquisition process uses specific sensors, with RGB and depth images captured by the ZED2 stereo camera. For the Hyperspectral component, the FireflEYE 185 camera by Cubert Gmbh is employed, ensuring precision and accuracy in capturing spectral data across different varieties and sessions within the dataset. All of the data were collected at Gerovassiliou Field in Epanomi, Thessaloniki. 

The dataset includes 12 sessions of Malagouzia variety, 3 sessions of Priknadi variety, 2 sessions of Chardonnay variety, 1 session of Monemvasia variety, 2 sessions of consecutive Malagouzia and Monemvasia varieties and 3 sessions of consecutive Priknadi and Monemvasia varieties.

It is worth noting that the two cameras are registered between them using matrices R and T, which are included in the dataset to achieve exact alignment. Both RGB and Hyperspectral images are used exclusively for detection purposes, specifically to identify grapes within their respective fields of view. 

CERTH/ITI coordinated the setup and collection of RGBD data, while AUTH/RSSGIS guided the collection of Hyperspectral data, demonstrating a collaborative effort in compiling this comprehensive dataset for grapevine analysis.

Below, there is a sample of the dataset structure due to the big size of the dataset. We uploaded a complete sample of the Malagouzia variety since the remaining data has a similar form.  For the full dataset with all the varieties please contact Stefanos Papadam (sgpapadam@iti.gr), Ioannis Mariolis (ymariolis@iti.gr), Georgia Peleka (gpeleka@iti.gr)