MATLAB algorithm to implement soil water data assimilation with the Ensemble Kalman Filter using HYDRUS.
Ontology highlight
ABSTRACT:
SUBMITTER: Valdes-Abellan J
PROVIDER: S-EPMC5945924 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Using the climate model CLIMBER-X, we present an efficient method for assimilating the temporal evolution of surface temperatures for the last deglaciation covering the period 22000 to 6500 years before the present. The data assimilation methodology combines the data and the underlying dynamical principles governing the climate system to provide a state estimate of the system, which is better than that which could be obtained using just the data or the model alone. In applying an ensemble Kalman filter approach, we make use of the advances in the parallel data assimilation framework (PDAF), which provides parallel data assimilation functionality with a relatively small increase in computation time. We find that the data assimilation solution depends strongly on the background evolution of the decaying ice sheets rather than the assimilated temperatures. Two different ice sheet reconstructions result in a different deglacial meltwater history, affecting the large-scale ocean circulation and, consequently, the surface temperature. We find that the influence of data assimilation is more pronounced on regional scales than on the global mean. In particular, data assimilation has a stronger effect during millennial warming and cooling phases, such as the Bølling-Allerød and Younger Dryas, especially at high latitudes with heterogeneous temperature patterns. Our approach is a step toward a comprehensive paleo-reanalysis on multi-millennial time scales, including incorporating available paleoclimate data and accounting for their uncertainties in representing regional climates.
| S-EPMC10994341 | biostudies-literature
Project description:Inference for high-dimensional, large scale and long series dynamic systems is a challenging task in modern data science. The existing algorithms, such as particle filter or sequential importance sampler, do not scale well to the dimension of the system and the sample size of the dataset, and often suffers from the sample degeneracy issue for long series data. The recently proposed Langevinized ensemble Kalman filter (LEnKF) addresses these difficulties in a coherent way. However, it cannot be applied to the case that the dynamic system contains unknown parameters. This article proposes the so-called stochastic approximation-LEnKF for jointly estimating the states and unknown parameters of the dynamic system, where the parameters are estimated on the fly based on the state variables simulated by the LEnKF under the framework of stochastic approximation Markov chain Monte Carlo (MCMC). Under mild conditions, we prove its consistency in parameter estimation and ergodicity in state variable simulations. The proposed algorithm can be used in uncertainty quantification for long series, large scale, and high-dimensional dynamic systems. Numerical results indicate its superiority over the existing algorithms. We employ the proposed algorithm in state-space modeling of the sea surface temperature with a long short term memory (LSTM) network, which indicates its great potential in statistical analysis of complex dynamic systems encountered in modern data science. Supplementary materials for this article are available online.
| S-EPMC10795543 | biostudies-literature
Project description:The ensemble Kalman filter and ensemble square root filters are data assimilation methods used to combine high-dimensional, nonlinear dynamical models with observed data. Ensemble methods are indispensable tools in science and engineering and have enjoyed great success in geophysical sciences, because they allow for computationally cheap low-ensemble-state approximation for extremely high-dimensional turbulent forecast models. From a theoretical perspective, the dynamical properties of these methods are poorly understood. One of the central mysteries is the numerical phenomenon known as catastrophic filter divergence, whereby ensemble-state estimates explode to machine infinity, despite the true state remaining in a bounded region. In this article we provide a breakthrough insight into the phenomenon, by introducing a simple and natural forecast model that transparently exhibits catastrophic filter divergence under all ensemble methods and a large set of initializations. For this model, catastrophic filter divergence is not an artifact of numerical instability, but rather a true dynamical property of the filter. The divergence is not only validated numerically but also proven rigorously. The model cleanly illustrates mechanisms that give rise to catastrophic divergence and confirms intuitive accounts of the phenomena given in past literature.
| S-EPMC4553757 | biostudies-literature
Project description:It is a promising method to identify structural damage using bridge dynamic response under moving vehicle excitation, but the lack of accurate information about road roughness and vehicle parameters will lead to the failure of this method. The paper proposed a step-by-step EKF damage identification method, which transforms the inversion problem of unknown structural parameters under unknown loads (vehicle and road roughness) into two separate inversion problems: moving contact force identification and damage parameters identification. Firstly, the VBI model is converted into bridge vibration model under a moving contact force, and the moving contact force covering the information of road roughness and vehicle parameters can be calculated by EKF iteration. Secondly, the moving contact force identified in the first step is loaded on the bridge as a known condition, and the bridge damage problem is also solved by the EKF method. Numerical analyses of a simply-supported bridge under the moving vehicle are conducted to investigate the accuracy and efficiency of the proposed method. Effects of the vehicle speed, the damage cases, the measurement noise, and the roughness levels on the accuracy of the identification results are investigated. The results demonstrate the proposed algorithm is efficient and robust, and the algorithm can be developed into an effective tool for structural health monitoring of bridges.
| S-EPMC9763337 | biostudies-literature
Project description:This paper studies Kalman filtering applied to Reynolds-Averaged Navier⁻Stokes (RANS) equations for turbulent flow. The integration of the Kalman estimator is extended to an implicit segregated method and to the thermodynamic analysis of turbulent flow, adding a sub-stepping procedure that ensures mass conservation at each time step and the compatibility among the unknowns involved. The accuracy of the algorithm is verified with respect to the heated lid-driven cavity benchmark, incorporating also temperature observations, comparing the augmented prediction of the Kalman filter with the Computational Fluid-Dynamic solution found on a fine grid.
| S-EPMC6267179 | biostudies-literature
Project description:Knowledge of irrigation is essential to support food security, manage depleting water resources, and comprehensively understand the global water and energy cycles. Despite the importance of understanding irrigation, little consistent information exists on the amount of water that is applied for irrigation. In this study, we develop and evaluate a new method to predict daily to seasonal irrigation magnitude using a particle batch smoother data assimilation approach, where land surface model soil moisture is applied in different configurations to understand how characteristics of remotely sensed soil moisture may impact the performance of the method. The study employs a suite of synthetic data assimilation experiments, allowing for systematic diagnosis of known error sources. Assimilation of daily synthetic soil moisture observations with zero noise produces irrigation estimates with a seasonal bias of 0.66% and a correlation of 0.95 relative to a known truth irrigation. When synthetic observations were subjected to an irregular overpass interval and random noise similar to the Soil Moisture Active Passive satellite (0.04 cm3 cm-3), irrigation estimates produced a median seasonal bias of <1% and a correlation of 0.69. When systematic biases commensurate with those between NLDAS-2 land surface models and Soil Moisture Active Passive are imposed, irrigation estimates show larger biases. In this application, the particle batch smoother outperformed the particle filter. The presented framework has the potential to provide new information into irrigation magnitude over spatially continuous domains, yet its broad applicability is contingent upon identifying new method(s) of determining irrigation schedule and correcting biases between observed and simulated soil moisture, as these errors markedly degraded performance.
| S-EPMC6988458 | biostudies-literature
Project description:: Pre-harvest fruit yield estimation is useful to guide harvesting and marketing resourcing, but machine vision estimates based on a single view from each side of the tree ("dual-view") underestimates the fruit yield as fruit can be hidden from view. A method is proposed involving deep learning, Kalman filter, and Hungarian algorithm for on-tree mango fruit detection, tracking, and counting from 10 frame-per-second videos captured of trees from a platform moving along the inter row at 5 km/h. The deep learning based mango fruit detection algorithm, MangoYOLO, was used to detect fruit in each frame. The Hungarian algorithm was used to correlate fruit between neighbouring frames, with the improvement of enabling multiple-to-one assignment. The Kalman filter was used to predict the position of fruit in following frames, to avoid multiple counts of a single fruit that is obscured or otherwise not detected with a frame series. A "borrow" concept was added to the Kalman filter to predict fruit position when its precise prediction model was absent, by borrowing the horizontal and vertical speed from neighbouring fruit. By comparison with human count for a video with 110 frames and 192 (human count) fruit, the method produced 9.9% double counts and 7.3% missing count errors, resulting in around 2.6% over count. In another test, a video (of 1162 frames, with 42 images centred on the tree trunk) was acquired of both sides of a row of 21 trees, for which the harvest fruit count was 3286 (i.e., average of 156 fruit/tree). The trees had thick canopies, such that the proportion of fruit hidden from view from any given perspective was high. The proposed method recorded 2050 fruit (62% of harvest) with a bias corrected Root Mean Square Error (RMSE) = 18.0 fruit/tree while the dual-view image method (also using MangoYOLO) recorded 1322 fruit (40%) with a bias corrected RMSE = 21.7 fruit/tree. The video tracking system is recommended over the dual-view imaging system for mango orchard fruit count.
| S-EPMC6631562 | biostudies-literature
Project description:This paper evaluates the performance of an integrity monitoring algorithm of global navigation satellite systems (GNSS) for the Kalman filter (KF), termed KF receiver autonomous integrity monitoring (RAIM). The algorithm checks measurement inconsistencies in the range domain and requires Schmidt KF (SKF) as the navigation processor. First, realistic carrier-smoothed pseudorange measurement error models of GNSS are integrated into KF RAIM, overcoming an important limitation of prior work. More precisely, the error covariance matrix for fault detection is modified to capture the temporal variations of individual errors with different time constants. Uncertainties of the model parameters are also taken into account. Performance of the modified KF RAIM is then analyzed with the simulated signals of the global positioning system and navigation with Indian constellation for different phases of aircraft flight. Weighted least squares (WLS) RAIM used for comparison purposes is shown to have lower protection levels. This work, however, is important because KF-based integrity monitors are required to ensure the reliability of advanced navigation methods, such as multi-sensor integration and vector receivers. A key finding of the performance analyses is as follows. Innovation-based tests with an extended KF navigation processor confuse slow ramp faults with residual measurement errors that the filter estimates, leading to missed detection. RAIM with SKF, on the other hand, can successfully detect such faults. Thus, it offers a promising solution to developing KF integrity monitoring algorithms in the range domain. The modified KF RAIM completes processing in time on a low-end computer. Some salient features are also studied to gain insights into its working principles.
| S-EPMC8708194 | biostudies-literature
Project description:Advanced marine ecosystem models can contain more than 100 biogeochemical variables, making data assimilation for these models a challenging prospect. Traditional variational data assimilation techniques like 4dVar rely on tangent linear and adjoint code, which can be difficult to create for complex ecosystem models with more than a few dozen variables. More recent hybrid ensemble-variational data assimilation techniques use ensembles of model forecasts to produce model statistics and can thus avoid the need for tangent linear or adjoint code. We present a new implementation of a four-dimensional ensemble optimal interpolation (4dEnOI) technique for use with coupled physical-ecosystem models. Our 4dEnOI implementation uses a small ensemble, and spatial and variable covariance localization to create reliable flow-dependent statistics. The technique is easy to implement, requires no tangent linear or adjoint code, and is computationally suitable for advanced ecosystem models. We test the 4dEnOI implementation in comparison to a 4dVar technique for a simple marine ecosystem model with 4 biogeochemical variables, coupled to a physical circulation model for the California Current System. In these tests, our 4dEnOI reference implementation performs similarly well to the 4dVar benchmark in lowering the model observation misfit. We show that the 4dEnOI results depend heavily on covariance localization generally, and benefit from variable localization in particular, when it is applied to reduce the coupling strength between the physical and biogeochemical model and the biogeochemical variables. The 4dEnOI results can be further improved by small modifications to the algorithm, such as multiple 4dEnOI iterations, albeit at additional computational cost.
| S-EPMC10479889 | biostudies-literature
Project description:In the field of visual tracking, discriminative correlation filter (DCF)-based trackers have made remarkable achievements with their high computational efficiency. The crucial challenge that still remains is how to construct qualified samples without boundary effects and redetect occluded targets. In this paper a feature-enhanced discriminative correlation filter (FEDCF) tracker is proposed, which utilizes the color statistical model to strengthen the texture features (like the histograms of oriented gradient of HOG) and uses the spatial-prior function to suppress the boundary effects. Then, improved correlation filters using the enhanced features are built, the optimal functions of which can be effectively solved by Gauss-Seidel iteration. In addition, the average peak-response difference (APRD) is proposed to reflect the degree of target-occlusion according to the target response, and an adaptive Kalman filter is established to support the target redetection. The proposed tracker achieved a success plot performance of 67.8% with 5.1 fps on the standard datasets OTB2013.
| S-EPMC6479297 | biostudies-literature