Dataset Information

Predicting Soil Salinity with Vis-NIR Spectra after Removing the Effects of Soil Moisture Using External Parameter Orthogonalization.

ABSTRACT: Robust models for predicting soil salinity that use visible and near-infrared (vis-NIR) reflectance spectroscopy are needed to better quantify soil salinity in agricultural fields. Currently available models are not sufficiently robust for variable soil moisture contents. Thus, we used external parameter orthogonalization (EPO), which effectively projects spectra onto the subspace orthogonal to unwanted variation, to remove the variations caused by an external factor, e.g., the influences of soil moisture on spectral reflectance. In this study, 570 spectra between 380 and 2400 nm were obtained from soils with various soil moisture contents and salt concentrations in the laboratory; 3 soil types × 10 salt concentrations × 19 soil moisture levels were used. To examine the effectiveness of EPO, we compared the partial least squares regression (PLSR) results established from spectra with and without EPO correction. The EPO method effectively removed the effects of moisture, and the accuracy and robustness of the soil salt contents (SSCs) prediction model, which was built using the EPO-corrected spectra under various soil moisture conditions, were significantly improved relative to the spectra without EPO correction. This study contributes to the removal of soil moisture effects from soil salinity estimations when using vis-NIR reflectance spectroscopy and can assist others in quantifying soil salinity in the future.

SUBMITTER: Liu Y

PROVIDER: S-EPMC4607364 | biostudies-literature | 2015

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Predicting Soil Salinity with Vis-NIR Spectra after Removing the Effects of Soil Moisture Using External Parameter Orthogonalization.

Liu Ya Y Pan Xianzhang X Wang Changkun C Li Yanli Y Shi Rongjie R

PloS one 20151015 10

Robust models for predicting soil salinity that use visible and near-infrared (vis-NIR) reflectance spectroscopy are needed to better quantify soil salinity in agricultural fields. Currently available models are not sufficiently robust for variable soil moisture contents. Thus, we used external parameter orthogonalization (EPO), which effectively projects spectra onto the subspace orthogonal to unwanted variation, to remove the variations caused by an external factor, e.g., the influences of soi ...[more]

PMID: 26468645

Similar Datasets

Project description:Coal mining has led to increasingly serious land subsidence, and the reclamation of the subsided land has become a hot topic of concern for governments and scholars. Soil quality of reclaimed land is the key indicator to the evaluation of the reclamation effect; hence, rapid monitoring and evaluation of reclaimed land is of great significance. Visible-near infrared (Vis-NIR) spectroscopy has been shown to be a rapid, timely and efficient tool for the prediction of soil organic carbon (SOC). In this study, 104 soil samples were collected from the Baodian mining area of Shandong province. Vis-NIR reflectance spectra and soil organic carbon content were then measured under laboratory conditions. The spectral data were first denoised using the Savitzky-Golay (SG) convolution smoothing method or the multiple scattering correction (MSC) method, after which the spectral reflectance (R) was subjected to reciprocal, reciprocal logarithm and differential transformations to improve spectral sensitivity. Finally, regression models for estimating the SOC content by the spectral data were constructed using partial least squares regression (PLSR). The results showed that: (1) The SOC content in the mining area was generally low (at the below-average level) and exhibited great variability. (2) The spectral reflectance increased with the decrease of soil organic carbon content. In addition, the sensitivity of the spectrum to the change in SOC content, especially that in the near-infrared band of the original reflectance, decreased when the SOC content was low. (3) The modeling results performed best when the spectral reflectance was preprocessed by Savitzky-Golay (SG) smoothing coupled with multiple scattering correction (MSC) and first-order differential transformation (modeling R2 = 0.86, RMSE = 2.00 g/kg, verification R2 = 0.78, RMSE = 1.81 g/kg, and RPD = 2.69). In addition, the first-order differential of R combined with SG, MSC with R, SG together with MSC and R also produced better modeling results than other pretreatment combinations. Vis-NIR modeling with specific spectral preprocessing methods could predict SOC content effectively.

Project description:A methodological survey of density functional theory (DFT) methods for the prediction of UV-visible (vis)-near-infrared (NIR) spectra of phthalocyanines is reported. Four methods, namely, full time-dependent (TD)-DFT and its Tamm-Dancoff approximation (TDA), together with their simplified modifications (sTD-DFT and sTDA, respectively), were tested by using the examples of unsubstituted and alkoxy-substituted metal-free ligands and zinc complexes. The theoretical results were compared with experimental data derived from UV-visible absorption and magnetic circular dichroism spectroscopy. Seven popular exchange-correlation functionals (BP86, B3LYP, TPSSh, M06, CAM-B3LYP, LC-BLYP, and ωB97X) were tested within these four approaches starting at a relatively modest level using 6-31G(d) basis sets and gas-phase BP86/def2-SVP optimized geometries. A gradual augmentation of the computational levels was used to identify the influence of starting geometry, solvation effects, and basis sets on the results of TD-DFT and sTD-DFT calculations. It was found that although these factors do influence the predicted energies of the vertical excitations, they do not affect the trends predicted in the spectral properties across series of structurally related substituted free bases and metallophthalocyanines. The best accuracy for the gas-phase vertical excitations was observed in the lower-energy Q-band region for calculations that made use of range-separated hybrids for both full and simplified TD-DFT approaches. The CAM-B3LYP functional provided particularly accurate results in the context of the sTD-DFT approach. The description of the higher-energy B-band region is considerably less accurate, and this demonstrates the need for further advances in the accuracy of theoretical calculations. Together with a general increase in accuracy, the application of simplified TD-DFT methods affords a 2-3 orders of magnitude speedup of the calculations in comparison to the full TD-DFT approach. It is anticipated that this approach will be widely used on desktop computers during the interpretation of UV-vis-NIR spectra of phthalocyanines and related macrocycles in the years ahead.

Project description:Assessment and monitoring of soil organic matter (SOM) quality are important for understanding SOM dynamics and developing management practices that will enhance and maintain the productivity of agricultural soils. Visible and near-infrared (Vis-NIR) diffuse reflectance spectroscopy (350-2500 nm) has received increasing attention over the recent decades as a promising technique for SOM analysis. While heterogeneity of sample sets is one critical factor that complicates the prediction of soil properties from Vis-NIR spectra, a spectral library representing the local soil diversity needs to be constructed. The study area, covering a surface of 927 km2 and located in Yujiang County of Jiangsu Province, is characterized by a hilly area with different soil parent materials (e.g., red sandstone, shale, Quaternary red clay, and river alluvium). In total, 232 topsoil (0-20 cm) samples were collected for SOM analysis and scanned with a Vis-NIR spectrometer in the laboratory. Reflectance data were related to surface SOM content by means of a partial least square regression (PLSR) method and several data pre-processing techniques, such as first and second derivatives with a smoothing filter. The performance of the PLSR model was tested under different combinations of calibration/validation sets (global and local calibrations stratified according to parent materials). The results showed that the models based on the global calibrations can only make approximate predictions for SOM content (RMSE (root mean squared error) = 4.23-4.69 g kg-1; R2 (coefficient of determination) = 0.80-0.84; RPD (ratio of standard deviation to RMSE) = 2.19-2.44; RPIQ (ratio of performance to inter-quartile distance) = 2.88-3.08). Under the local calibrations, the individual PLSR models for each parent material improved SOM predictions (RMSE = 2.55-3.49 g kg-1; R2 = 0.87-0.93; RPD = 2.67-3.12; RPIQ = 3.15-4.02). Among the four different parent materials, the largest R2 and the smallest RMSE were observed for the shale soils, which had the lowest coefficient of variation (CV) values for clay (18.95%), free iron oxides (15.93%), and pH (1.04%). This demonstrates the importance of a practical subsetting strategy for the continued improvement of SOM prediction with Vis-NIR spectroscopy.

Dataset Information

Predicting Soil Salinity with Vis-NIR Spectra after Removing the Effects of Soil Moisture Using External Parameter Orthogonalization.

Publications

Predicting Soil Salinity with Vis-NIR Spectra after Removing the Effects of Soil Moisture Using External Parameter Orthogonalization.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets