Application of empirical mode decomposition with local linear quantile regression in financial time series forecasting.
Ontology highlight
ABSTRACT:
SUBMITTER: Jaber AM
PROVIDER: S-EPMC4130315 | biostudies-other | 2014
REPOSITORIES: biostudies-other
Similar Datasets
Project description:In this article we forecast daily closing price series of Bitcoin, Litecoin and Ethereum cryptocurrencies, using data on prices and volumes of prior days. Cryptocurrencies price behaviour is still largely unexplored, presenting new opportunities for researchers and economists to highlight similarities and differences with standard financial prices. We compared our results with various benchmarks: one recent work on Bitcoin prices forecasting that follows different approaches, a well-known paper that uses Intel, National Bank shares and Microsoft daily NASDAQ closing prices spanning a 3-year interval and another, more recent paper which gives quantitative results on stock market index predictions. We followed different approaches in parallel, implementing both statistical techniques and machine learning algorithms: the Simple Linear Regression (SLR) model for uni-variate series forecast using only closing prices, and the Multiple Linear Regression (MLR) model for multivariate series using both price and volume data. We used two artificial neural networks as well: Multilayer Perceptron (MLP) and Long short-term memory (LSTM). While the entire time series resulted to be indistinguishable from a random walk, the partitioning of datasets into shorter sequences, representing different price "regimes", allows to obtain precise forecast as evaluated in terms of Mean Absolute Percentage Error(MAPE) and relative Root Mean Square Error (relativeRMSE). In this case the best results are obtained using more than one previous price, thus confirming the existence of time regimes different from random walks. Our models perform well also in terms of time complexity, and provide overall results better than those obtained in the benchmark studies, improving the state-of-the-art.
| S-EPMC7924725 | biostudies-literature
Project description:Skin cancer is the most common type of cancer in many parts of the world. As skin cancers start as skin lesions, it is important to identify precancerous skin lesions early. In this paper we propose an image based skin lesion identification to classify seven different classes of skin lesions. First, Multi Resolution Empirical Mode Decomposition (MREMD) is used to decompose each skin lesion image into a few Bidimensional intrinsic mode functions (BIMF). MREMD is a simplified bidimensional empirical mode decomposition (BEMD) that employs downsampling and upsampling (interpolation) in the upper and lower envelope formation to speed up the decomposition process. A few BIMFs are extracted from the image using MREMD. The next step is to locate the lesion or the region of interest (ROI) in the image using active contour. Then Local Binary Pattern (LBP) is applied to the ROI of the image and its first BIMF to extract a total of 512 texture features from the lesion area. In the training phase, texture features of seven different classes of skin lesions are used to train an Artificial Neural Network (ANN) classifier. Altogether, 490 images from HAM10000 dataset are used to train the ANN. Then the accuracy of the approach is evaluated using 315 test images that are different from the training images. The test images are taken from the same dataset and each test image contains one type of lesion from the seven types that are classified. From each test image, 512 texture features are extracted from the lesion area and introduced to the classifier to determine its class. The proposed method achieves an overall classification rate of 98.9%.
| S-EPMC9488768 | biostudies-literature
Project description:BackgroundThe novel coronavirus pneumonia that began to spread in 2019 is still raging and has placed a burden on medical systems and governments in various countries. For policymaking and medical resource decisions, a good prediction model is necessary to monitor and evaluate the trends of the epidemic. We used a long short-term memory (LSTM) model and the improved hybrid model based on ensemble empirical mode decomposition (EEMD) to predict COVID-19 trends; Methods: The data were collected from the Harvard Dataverse. Epidemic data from 21 January 2020 to 25 April 2021 for California, the most severely affected state in the United States, were used to develop an LSTM model and an EEMD-LSTM hybrid model, which is an LSTM model combined with ensemble empirical mode decomposition. In this study, ninety percent of the data were adopted to fit the models as a training set, while the subsequent 10% were used to test the prediction effect of the models. The mean absolute percentage error, mean absolute error, and root mean square error were used to evaluate the prediction performances of the models; Results: The results indicated that the number of confirmed cases in California was increasing as of 25 April 2021, with no obvious evidence of a sharp decline. On 25 April 2021, the LSTM model predicted 3666418 confirmed cases, whereas the EEMD-LSTM predicted 3681150. The mean absolute percentage errors for the LSTM and EEMD-LSTM models were 0.0151 and 0.0051, respectively. The mean absolute and root mean square errors were 5.58 × 104 and 5.63 × 104 for the LSTM model and 1.9 × 104 and 2.43 × 104 for the EEMD-LSTM model, respectively; Conclusions: The results showed the advantage of an EEMD-LSTM model over a single LSTM model, and the established EEMD-LSTM model may be suitable for monitoring and evaluating the epidemic situation and providing quantitative analysis evidence for epidemic prevention and control.
| S-EPMC9819685 | biostudies-literature
Project description:This paper develops a new marginal testing procedure to detect the presence of significant predictors associated with the conditional quantiles of a scalar response. The idea is to fit the marginal quantile regression on each predictor one at a time, and then base the test on the t-statistics associated with the most predictive predictors. A resampling method is devised to calibrate this test statistic, which has non-regular limiting behavior due to the selection of the most predictive variables. Asymptotic validity of the procedure is established in a general quantile regression setting in which the marginal quantile regression models can be misspecified. Even though a fixed dimension is assumed to derive the asymptotic results, the proposed test is applicable and computationally feasible for large-dimensional predictors. The method is more flexible than existing marginal screening test methods based on mean regression, and has the added advantage of being robust against outliers in the response. The approach is illustrated using an application to an HIV drug resistance dataset.
| S-EPMC5863930 | biostudies-literature
Project description:A new generalized linear mixed quantile model for panel data is proposed. This proposed approach applies GEE with smoothed estimating functions, which leads to asymptotically equivalent estimation of the regression coefficients. Random effects are predicted by using the best linear unbiased predictors (BLUP) based on the Tweedie exponential dispersion distributions which cover a wide range of distributions, including those widely used ones, such as the normal distribution, Poisson distribution and gamma distribution. A Taylor expansion of the quantile estimating function is used to linearize the random effects in the quantile process. The parameter estimation is based on the Newton-Raphson iteration method. Our proposed quantile mixed model gives consistent estimates that have asymptotic normal distributions. Simulation studies are carried out to investigate the small sample performance of the proposed approach. As an illustration, the proposed method is applied to analyze the epilepsy data.
| S-EPMC7419003 | biostudies-literature
Project description:Detecting periodicity signals from time-series microarray data is commonly used to facilitate the understanding of the critical roles and underlying mechanisms of regulatory transcriptomes. However, time-series microarray data are noisy. How the temporal data structure affects the performance of periodicity detection has remained elusive. We present a novel method based on empirical mode decomposition (EMD) to examine this effect. We applied EMD to a yeast microarray dataset and extracted a series of intrinsic mode function (IMF) oscillations from the time-series data. Our analysis indicated that many periodically expressed genes might have been under-detected in the original analysis because of interference between decomposed IMF oscillations. By validating a protein complex coexpression analysis, we revealed that 56 genes were newly determined as periodic. We demonstrated that EMD can be used incorporating with existing periodicity detection methods to improve their performance. This approach can be applied to other time-series microarray studies.
| S-EPMC4221108 | biostudies-literature
Project description:Accurately predicting the trend of outpatient visits by mathematical modeling can help policy makers manage hospitals effectively, reasonably organize schedules for human resources and finances, and appropriately distribute hospital material resources. In this study, a hybrid method based on empirical mode decomposition and back-propagation artificial neural networks optimized by particle swarm optimization is developed to forecast outpatient visits on the basis of monthly numbers. The data outpatient visits are retrieved from January 2005 to December 2013 and first obtained as the original time series. Second, the original time series is decomposed into a finite and often small number of intrinsic mode functions by the empirical mode decomposition technique. Third, a three-layer back-propagation artificial neural network is constructed to forecast each intrinsic mode functions. To improve network performance and avoid falling into a local minimum, particle swarm optimization is employed to optimize the weights and thresholds of back-propagation artificial neural networks. Finally, the superposition of forecasting results of the intrinsic mode functions is regarded as the ultimate forecasting value. Simulation indicates that the proposed method attains a better performance index than the other four methods.
| S-EPMC5319685 | biostudies-literature
Project description:Short-term metro passenger flow forecasting is an essential component of intelligent transportation systems (ITS) and can be applied to optimize the passenger flow organization of a station and offer data support for metro passenger flow early warning and system management. LSTM neural networks have recently achieved remarkable recent in the field of natural language processing (NLP) because they are well suited for learning from experience to predict time series. For this purpose, we propose an empirical mode decomposition (EMD)-based long short-term memory (LSTM) neural network model for predicting short-term metro inbound passenger flow. The EMD algorithm decomposes the original sequential passenger flow into several intrinsic mode functions (IMFs) and a residual. Selected IMFs that are strongly correlated with the original data can be obtained via feature selection. The selected IMFs and the original data are integrated into inputs for LSTM neural networks, and a single LSTM prediction model and an EMD-LSTM hybrid forecasting model are developed. Finally, historical real automatic fare collection (AFC) data from metro passengers are collected from Chengdu Metro to verify the validity of the proposed EMD-LSTM prediction model. The results indicate that the proposed EMD-LSTM hybrid forecasting model outperforms the LSTM, ARIMA and BPN models.
| S-EPMC6738919 | biostudies-other
Project description:RNA degradation can significantly affect the results of gene expression profiling, with subsequent analysis failing to faithfully represent the initial gene expression level. It is urgent to have an artificial intelligence approach to better utilize the limited data to obtain meaningful and reliable analysis results in the case of data with missing destination time. In this study, we propose a method based on the signal decomposition technique and deep learning, named Multi-LSTM. It is divided into two main modules: One decomposes the collected gene expression data by an empirical mode decomposition (EMD) algorithm to obtain a series of sub-modules with different frequencies to improve data stability and reduce modeling complexity. The other is based on long short-term memory (LSTM) as the core predictor, aiming to deeply explore the temporal nonlinear relationships embedded in the sub-modules. Finally, the prediction results of sub-modules are reconstructed to obtain the final prediction results of time-series transcriptomic gene expression. The results show that EMD can efficiently reduce the nonlinearity of the original data, which provides reliable theoretical support to reduce the complexity and improve the robustness of LSTM models. Overall, the decomposition-combination prediction framework can effectively predict gene expression levels at unknown time points.
| S-EPMC9322773 | biostudies-literature
Project description:This paper develops a likelihood-based approach to analyze quantile regression (QR) models for continuous longitudinal data via the asymmetric Laplace distribution (ALD). Compared to the conventional mean regression approach, QR can characterize the entire conditional distribution of the outcome variable and is more robust to the presence of outliers and misspecification of the error distribution. Exploiting the nice hierarchical representation of the ALD, our classical approach follows a Stochastic Approximation of the EM (SAEM) algorithm in deriving exact maximum likelihood estimates of the fixed-effects and variance components. We evaluate the finite sample performance of the algorithm and the asymptotic properties of the ML estimates through empirical experiments and applications to two real life datasets. Our empirical results clearly indicate that the SAEM estimates outperforms the estimates obtained via the combination of Gaussian quadrature and non-smooth optimization routines of the Geraci and Bottai (2014) approach in terms of standard errors and mean square error. The proposed SAEM algorithm is implemented in the R package qrLMM().
| S-EPMC5667718 | biostudies-literature