Dataset Information

Deep learning approach to predict pain progression in knee osteoarthritis.

ABSTRACT:

Objective

To develop and evaluate deep learning (DL) risk assessment models for predicting pain progression in subjects with or at risk of knee osteoarthritis (OA).

Materials and methods

The incidence and progression cohorts of the Osteoarthritis Initiative, a multi-center longitudinal study involving 9348 knees in 4674 subjects with or at risk of knee OA that began in 2004 and is ongoing, were used to conduct this retrospective analysis. A subset of knees without and with pain progression (defined as a 9-point or greater increase in pain score between baseline and two or more follow-up time points over the first 48 months) was randomly stratified into training (4200 knees with a mean age of 61.0 years and 60% female) and hold-out testing (500 knees with a mean age of 60.8 years and 60% female) datasets. A DL model was developed to predict pain progression using baseline knee radiographs. An artificial neural network was used to develop a traditional risk assessment model to predict pain progression using demographic, clinical, and radiographic risk factors. A combined model was developed to combine demographic, clinical, and radiographic risk factors with DL analysis of baseline knee radiographs. Area under the curve (AUC) analysis was performed using the hold-out testing dataset to evaluate model performance.

Results

The traditional model had an AUC of 0.692 (66.9% sensitivity and 64.1% specificity). The DL model had an AUC of 0.770 (76.7% sensitivity and 70.5% specificity), which was significantly higher (p < 0.001) than the traditional model. The combined model had an AUC of 0.807 (72.3% sensitivity and 80.9% specificity), which was significantly higher (p < 0.05) than the traditional and DL models.

Conclusions

DL models using baseline knee radiographs had higher diagnostic performance for predicting pain progression than traditional models using demographic, clinical, and radiographic risk factors.

SUBMITTER: Guan B

PROVIDER: S-EPMC9232386 | biostudies-literature | 2022 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Deep learning approach to predict pain progression in knee osteoarthritis.

Guan Bochen B Liu Fang F Mizaian Arya Haj AH Demehri Shadpour S Samsonov Alexey A Guermazi Ali A Kijowski Richard R

Skeletal radiology 20210409 2

<h4>Objective</h4>To develop and evaluate deep learning (DL) risk assessment models for predicting pain progression in subjects with or at risk of knee osteoarthritis (OA).<h4>Materials and methods</h4>The incidence and progression cohorts of the Osteoarthritis Initiative, a multi-center longitudinal study involving 9348 knees in 4674 subjects with or at risk of knee OA that began in 2004 and is ongoing, were used to conduct this retrospective analysis. A subset of knees without and with pain pr ...[more]

PMID: 33835240

Similar Datasets

Project description:ObjectivesThe IMI-APPROACH knee osteoarthritis study used machine learning (ML) to predict structural and/or pain progression, expressed by a structural (S) and pain (P) predicted-progression score, to select patients from existing cohorts. This study evaluates the actual 2-year progression within the IMI-APPROACH, in relation to the predicted-progression scores.MethodsActual structural progression was measured using minimum joint space width (minJSW). Actual pain (progression) was evaluated using the Knee injury and Osteoarthritis Outcomes Score (KOOS) pain questionnaire. Progression was presented as actual change (Δ) after 2 years, and as progression over 2 years based on a per patient fitted regression line using 0, 0.5, 1 and 2-year values. Differences in predicted-progression scores between actual progressors and non-progressors were evaluated. Receiver operating characteristic (ROC) curves were constructed and corresponding area under the curve (AUC) reported. Using Youden's index, optimal cut-offs were chosen to enable evaluation of both predicted-progression scores to identify actual progressors.ResultsActual structural progressors were initially assigned higher S predicted-progression scores compared with structural non-progressors. Likewise, actual pain progressors were assigned higher P predicted-progression scores compared with pain non-progressors. The AUC-ROC for the S predicted-progression score to identify actual structural progressors was poor (0.612 and 0.599 for Δ and regression minJSW, respectively). The AUC-ROC for the P predicted-progression score to identify actual pain progressors were good (0.817 and 0.830 for Δ and regression KOOS pain, respectively).ConclusionThe S and P predicted-progression scores as provided by the ML models developed and used for the selection of IMI-APPROACH patients were to some degree able to distinguish between actual progressors and non-progressors.Trial registrationClinicalTrials.gov, https://clinicaltrials.gov, NCT03883568.

Project description:BackgroundNo investigations have thoroughly explored the feasibility of combining magnetic resonance (MR) images and deep-learning methods for predicting the progression of knee osteoarthritis (KOA). We thus aimed to develop a potential deep-learning model for predicting OA progression based on MR images for the clinical setting.MethodsA longitudinal case-control study was performed using data from the Foundation for the National Institutes of Health (FNIH), composed of progressive cases [182 osteoarthritis (OA) knees with both radiographic and pain progression for 24-48 months] and matched controls (182 OA knees not meeting the case definition). DeepKOA was developed through 3-dimensional (3D) DenseNet169 to predict KOA progression over 24-48 months based on sagittal intermediate-weighted turbo-spin echo sequences with fat-suppression (SAG-IW-TSE-FS), sagittal 3D dual-echo steady-state water excitation (SAG-3D-DESS-WE) and its axial and coronal multiplanar reformation, and their combined MR images with patient-level labels at baseline, 12, and 24 months to eventually determine the probability of progression. The classification performance of the DeepKOA was evaluated using 5-fold cross-validation. An X-ray-based model and traditional models that used clinical variables via multilayer perceptron were built. Combined models were also constructed, which integrated clinical variables with DeepKOA. The area under the curve (AUC) was used as the evaluation metric.ResultsThe performance of SAG-IW-TSE-FS in predicting OA progression was similar or higher to that of other single and combined sequences. The DeepKOA based on SAG-IW-TSE-FS achieved an AUC of 0.664 (95% CI: 0.585-0.743) at baseline, 0.739 (95% CI: 0.703-0.775) at 12 months, and 0.775 (95% CI: 0.686-0.865) at 24 months. The X-ray-based model achieved an AUC ranging from 0.573 to 0.613 at 3 time points. However, adding clinical variables to DeepKOA did not improve performance (P>0.05). Initial visualizations from gradient-weighted class activation mapping (Grad-CAM) indicated that the frequency with which the patellofemoral joint was highlighted increased as time progressed, which contrasted the trend observed in the tibiofemoral joint. The meniscus, the infrapatellar fat pad, and muscles posterior to the knee were highlighted to varying degrees.ConclusionsThis study initially demonstrated the feasibility of DeepKOA in the prediction of KOA progression and identified the potential responsible structures which may enlighten the future development of more clinically practical methods.

Project description:ObjectiveThis study aimed to examine the performance of machine learning models in predicting the progression of knee pain, functional decline, and incidence of knee osteoarthritis (OA) in high-risk individuals, with automated machine learning (AutoML) being used to automate the prediction process.DesignThere were four stages in the process of our AutoML-integrated prediction. Stage 1-Data preparation: The data of 3200 eligible individuals in the Osteoarthritis Initiative (OAI) study who were considered at high risk of knee OA at the baseline visit were extracted and used. Specifically, 1094 variables from the OAI study were used to predict the changes in knee pain, physical function, and incidence of knee OA (i.e. the first occurrence of frequent knee symptoms and definite tibial osteophytes (Kellgren and Lawrence grade ≥2)) over a 9-year period. Stage 2-Model training: The AutoML approach was used to automatically train nine widely used machine learning (ML) models. Stage 3-Model testing: The AutoML approach was used to automatically test the performance of the ML models. Stage 4-Selection of important input variables: The AutoML approach automated the process of computing the importance scores of all input variables and identifying the most important ones, using the technique of permutation feature importance.ResultsUsing the AutoML approach, the weighted ensemble model and the CatBoost model showed the best performance among all nine ML models. For the prediction of each outcome in each year, the five most important input variables were identified, most of which were obtained from self-reported questionnaire surveys and radiographic imaging reports.ConclusionThe AutoML approach has shown potential in automating the process of using ML models to predict long-term changes in knee OA-related outcomes. Its use could support the deployment of ML solutions, facilitating the provision of personalized interventions to prevent the deterioration of knee health and incident knee OA.

Project description:ObjectiveIn this study, we propose a novel framework that utilizes deep learning and attention mechanisms to predict the radiographic progression of patellofemoral osteoarthritis (PFOA) over a period of 7 years.Material and methodsThis study included subjects (1,832 subjects, 3,276 knees) from the baseline of the Multicenter Osteoarthritis Study (MOST). Patellofemoral joint regions of interest were identified using an automated landmark detection tool (BoneFinder) on lateral knee X-rays. An end-to-end deep learning method was developed for predicting PFOA progression based on imaging data in a five-fold cross-validation setting. To evaluate the performance of the models, a set of baselines based on known risk factors were developed and analyzed using gradient boosting machine (GBM). Risk factors included age, sex, body mass index, and Western Ontario and McMaster Universities Arthritis Index score, and the radiographic osteoarthritis stage of the tibiofemoral joint (Kellgren and Lawrence [KL] score). Finally, to increase predictive power, we trained an ensemble model using both imaging and clinical data.ResultsAmong the individual models, the performance of our deep convolutional neural network attention model achieved the best performance with an area under the receiver operating characteristic curve (AUC) of 0.856 and average precision (AP) of 0.431, slightly outperforming the deep learning approach without attention (AUC = 0.832, AP = 0.4) and the best performing reference GBM model (AUC = 0.767, AP = 0.334). The inclusion of imaging data and clinical variables in an ensemble model allowed statistically more powerful prediction of PFOA progression (AUC = 0.865, AP = 0.447), although the clinical significance of this minor performance gain remains unknown. The spatial attention module improved the predictive performance of the backbone model, and the visual interpretation of attention maps focused on the joint space and the regions where osteophytes typically occur.ConclusionThis study demonstrated the potential of machine learning models to predict the progression of PFOA using imaging and clinical variables. These models could be used to identify patients who are at high risk of progression and prioritize them for new treatments. However, even though the accuracy of the models were excellent in this study using the MOST dataset, they should be still validated using external patient cohorts in the future.

Dataset Information

Deep learning approach to predict pain progression in knee osteoarthritis.

Objective

Materials and methods

Results

Conclusions

Publications

Deep learning approach to predict pain progression in knee osteoarthritis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets