Published July 29, 2024 | Version 1.2
Dataset Open

Near-infrared (NIR) soil spectral library using the NeoSpectra Handheld NIR Analyzer by Si-Ware

  • 1. Woodwell Climate Research Center
  • 2. University of Nebraska - Lincoln
  • 3. Innovative Solutions for Decision Agriculture

Description

Up-to-date information on soil properties and the ability to track changes in soil properties over time are critical for improving multiple decisions on soil security at various scales, ranging from global climate change modeling and policy to national level environmental and development planning, to farm and field level resource management. Diffuse reflectance infrared spectroscopy has become an indispensable laboratory tool for the rapid estimation of numerous soil properties to support various soil mapping, soil monitoring, and soil testing applications. Recent advances in hardware technology have enabled the development of handheld sensors with similar performance specifications as laboratory-grade near-infrared (NIR) spectrometers.

Here, we've compiled a hand-held NIR spectral library (1350-2550 nm) using the NeoSpectra Handheld NIR Analyzer developed by Si-Ware. Each scanner is fitted with Fourier-Transform technology based on the semiconductor Micro Electromechanical Systems (MEMS) manufacturing technique, promising accuracy, and consistency between devices.

This library includes 2,106 distinct mineral soil samples scanned across 9 of these portable low-cost NIR spectrometers (indicated by serial no). 2,016 of these soil samples were selected to represent the diversity of mineral soils found in the United States, and 90 samples were selected across Ghana, Kenya, and Nigeria. 519 of the US samples were selected and scanned by Woodwell Climate Research Center. These samples were queried from the USDA NRCS NSSC-KSSL Soil Archives as having a complete set of eight measured properties (TC, OC, TN, CEC, pH, clay, sand, and silt). They were stratified based on the major horizon and taxonomic order, omitting the categories with less than 500 samples. Three percent of each stratum (i.e., a combination of major horizon and taxonomic order) was then randomly selected as the final subset retrieved from KSSL's physical soil archive as 2-mm sieved samples. The remaining 1,604 US samples were queried from the USDA NRCS NSSC-KSSL Soil Archives by the University of Nebraska - Lincoln to meet the following criteria: Lower depth <= 30 cm, pH range 4.0 to 9.5, Organic carbon <10%, Greater than lower detection limits, Actual physical samples available in the archive, Samples collected and analyzed from 2001 onwards, Samples having complete analyses for high-priority properties (Sand, Silt, Clay, CEC, Exchangeable Ca, Exchangeable Mg, Exchangeable K, Exchangeable Na, CaCO3, OC, TN), & MIR scanned.

All samples were scanned dry 2mm sieved. ~20g of sample was added to a plastic weighing boat where the NeoSpectra scanner would be placed down to make direct contact with the soil surface. The scanner was gently moved across the surface of the sample as 6 replicate scans were taken. These replicates were then averaged so that there is one spectra per sample per scanner in the resulting database.

A subset of 1,976 US topsoil samples was used to create Cubist models for 8 soil properties including bulk density (BD, <2mm fraction, 1/3 Bar, units in grams per cubic centimeter), calcium carbonate (CaCO3, <2mm fraction, units in weight percent), clay content (percent), buffered ammonium-acetate exchangeable potassium (Ex. K, units in centimoles of charge per kilogram of soil), pH, sand content (percent), silt content (percent), and estimated organic carbon (SOC, estimated after inorganic carbon removal, units in weight percent). Two strategies were evaluated for handling scanner-to-scanner variability: averaging scans per sample (avg) versus retaining replicate scans across all scanners (reps) during model building. Cubist avg models and cubist reps models are provided here for the 8 soil properties outlined in “.qs” file format and can be opened and worked with in the R programming language. The subset of 1,976 samples has also been provided here for reproducibility (1976_NSlibrary_withmetadata.csv).

The repository contains:

  • Neospectra_database_column_names.csv: describes the variables (columns) of site and soil data, and the range of near-infrared (NIR, 1350-2550 nm) and mid-infrared (MIR, 600-4000 cm-1) spectra. The CSV is composed of the file name, column name, type, example, and description with measurement unit.
  • Neospectra_WoodwellKSSL_MIR.csv: the equivalent MIR spectra of neospectra samples fetched from the KSSL database and formatted to the OSSL specifications.
  • Neospectra_WoodwellKSSL_soil+site+NIR.csv: soil, site, and Neospectra's NIR. Each row contains one replicated spectra of a given scanner (6 repeats per scanner per soil sample). Soil and site info is filled within the same soil sample.
  • 1976_NSlibrary_withmetadata.csv: data matrix for reproducible model calibration.
  • Models:
    • log..bd_model_nir.neospectra_cubist_AVG_ossl_na_v1.2.qs: Cubist average NIR model for log(1+BD).
    • log..caco3_model_nir.neospectra_cubist_AVG_ossl_na_v1.2.qs: Cubist average NIR model for log(1+CaCO3).

    • clay_model_nir.neospectra_cubist_AVG_ossl_na_v1.2.qs: Cubist average NIR model for clay.

    • log..k.ex_model_nir.neospectra_cubist_AVG_ossl_na_v1.2.qs: Cubist average NIR model for log(1+Ex. K).

    • ph.h2o_model_nir.neospectra_cubist_AVG_ossl_na_v1.2.qs: Cubist average NIR model for pH.

    • sand_model_nir.neospectra_cubist_AVG_ossl_na_v1.2.qs: Cubist average NIR model for sand.

    • silt_model_nir.neospectra_cubist_AVG_ossl_na_v1.2.qs: Cubist average NIR model for silt.

    • log..soc_model_nir.neospectra_cubist_AVG_ossl_na_v1.2.qs: Cubist average NIR model for log(1+SOC).

    • log..bd_model_nir.neospectra_cubist_REPS_ossl_na_v1.2.qs:  Cubist replicates NIR model for log(1+BD).

    • log..caco3_model_nir.neospectra_cubist_REPS_ossl_na_v1.2.qs: Cubist replicates NIR model for log(1+CaCO3).

    • clay_model_nir.neospectra_cubist_REPS_ossl_na_v1.2.qs: Cubist replicates NIR model for clay.

    • log..k.ex_model_nir.neospectra_cubist_REPS_ossl_na_v1.2.qs: Cubist replicates NIR model for log(1+Ex. K).

    • ph.h2o_model_nir.neospectra_cubist_REPS_ossl_na_v1.2.qs: Cubist replicates NIR model for pH.

    • sand_model_nir.neospectra_cubist_REPS_ossl_na_v1.2.qs: Cubist replicates NIR model for sand.

    • silt_model_nir.neospectra_cubist_REPS_ossl_na_v1.2.qs: Cubist replicates NIR model for silt.

    • log..soc_model_nir.neospectra_cubist_REPS_ossl_na_v1.2.qs: Cubist replicates NIR model for log(1+SOC).

Notes (English)

We thank the USDA NRCS National Soil Survey Center for providing access to their soil archives and for continuing to promote the use of soil spectroscopy. This project was funded by USDA National Institute of Food and Agriculture Award #2020-67021-32467; USDA National Institute of Food and Agriculture Award #2018-67007-28529; Woodwell Fund for Climate Solutions; and Foodshot Global.

Files

00_neospectra_map.png

Files (327.9 MB)

Name Size Download all
md5:2a18f405e44cdc9cdfec43d5c3b13fbc
529.1 kB Preview Download
md5:f410ffccdda867ec181900a0d2f31db8
1.3 MB Preview Download
md5:8cb55e45af554a69bf2b818c9ff31492
37.8 MB Preview Download
md5:e53e1b09e4e435d3e432e90d39a9efcc
2.6 MB Download
md5:fc2be346470bfcb4d43af64984194740
10.9 MB Download
md5:30c608be370cec5f3371690b92ad0724
1.4 MB Download
md5:c335c65f4c8ead47f9b1244bc44d8aa5
5.8 MB Download
md5:dc87d7fc3f0ab2b658db0898bb27cbd5
905.6 kB Download
md5:af730e516408dc04e49240dcc175cc83
3.8 MB Download
md5:6e9bc823ed31e5cdf75b05861a2e9adc
10.3 MB Download
md5:82f78abe2f04ae7057fee34f9263837b
2.6 MB Download
md5:da906f578489e5cca13a00f1a891205b
2.6 MB Download
md5:1407112c991e78ef700dec08d5417c96
10.8 MB Download
md5:9e7bcda869f38d466c030e2e40461f59
6.5 kB Preview Download
md5:4cdfde936aaaaf363d5ea193577de86f
26.4 MB Preview Download
md5:ce131d7796de557b7f55ccb8a0b1f0e8
169.3 MB Preview Download
md5:48b562adbd3f2d60812e36936c64f1fe
2.6 MB Download
md5:75049ca3e9c981d70015234bf72796f6
10.9 MB Download
md5:b8ee11b2bfa77012786a1e3f60042de3
2.7 MB Download
md5:dd337cd44233010c09883675bd749d3d
10.9 MB Download
md5:e24023e46b260e49c4783c1f78aaf400
2.7 MB Download
md5:52938da0d4c00aa1041e5649f306aef0
10.9 MB Download

Additional details

Dates

Available
2024-07-29

Software