Dataset Information

Applying machine learning to smartphone based cognitive and sleep assessments in schizophrenia.

ABSTRACT:

Background

Cognitive impairment in schizophrenia remains a chief source of functional disability and impairment, despite the potential for effective interventions. This is in part related to a lack of practical and easy to administer screening strategies that can identify and help triage cognitive impairment. This study explores how smartphone-based assessments may help address this need.

Methods

In this study, data was analyzed from 25 subjects with schizophrenia and 30 controls who engaged with a gamified mobile phone version of the Trails-B cognitive assessment in their everyday life over 90 days and complete a clinical neurocognitive testing battery at the beginning and end of the study. Machine learning was applied to the resulting dataset to predict disease status and neurocognitive function and understand which features were most important for accurate prediction.

Results

The generated models predicted disease status with high accuracy using static features alone (AUC = 0.94), with the total number of items collected and the total duration of interaction with the application most predictive. The addition of temporal data statistically significantly improved performance (AUC = 0.95), with the amount of idle time a significant new predictor. Correlates of sleep dysfunction were also predicted (AUC = 0.80), with similar feature importance.

Discussion

Machine learning enabled the highly accurate identification of subjects with schizophrenia versus healthy controls, and the accurate prediction of neurocognitive function. The addition of temporal data significantly improved the performance of these models, underscoring the value of smartphone-based assessments of cognition as a practical tool for assessing cognition.

SUBMITTER: Kalinich M

PROVIDER: S-EPMC8655108 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Background:Although cognition is a core symptom of schizophrenia and associated with functional impairment, the degree of training for and time associated with its assessment makes it difficult to routinely monitor in clinic care.Smartphone based cognitive assessments could serve as a tool to measure cognition in real time as well as being easily scalable for broad use.Combined with other data gathered from smartphone sensors such as steps, sleep, and self-reported symptoms - capturing 'cognition in context' could provide a powerful new tool for assessing the functional burden of disease in schizophrenia. Methods:18 participants with schizophrenia and 17 healthy controls completed novel cognitive assessments on their personal smartphones over the course of 12 weeks while also capturing self-reported surveys and step count. No payment or incentives were offered for engaging with the smartphone app. Differing levels of difficulty in cognitive tasks were tested and the results were modeled using a modified Cox proportional hazard model. Results:On the smartphone cognitive assessments that involved on simple patterns, both controls and those with schizophrenia achieved similar scores. On the more complex assessment that added task switching in addition to pattern recognition, those with schizophrenia achieved scores lower than controls. Collecting other forms of data such as surveys and steps was also feasible using the same smartphone platform. Discussion:It is feasible for those with schizophrenia to use their own smartphones to complete cognitive assessments and other measures related to their mental health. While we did not investigate the correlations between these cognitive assessments and other smartphone captured metrics like step count or self-reported symptoms, the potential to longitudinally assess cognition in the context of patients' environments outside of the clinic presents unique opportunities for characterizing cognitive burden in schizophrenia.

Project description:Heterogeneity in the structural brain abnormalities associated with schizophrenia has made identification of reliable neuroanatomical markers of the disease difficult. The use of more homogenous clinical phenotypes may improve the accuracy of predicting psychotic disorder/s on the basis of observable brain disturbances. Here we investigate the utility of cognitive subtypes of schizophrenia - 'cognitive deficit' and 'cognitively spared' - in determining whether multivariate patterns of volumetric brain differences can accurately discriminate these clinical subtypes from healthy controls, and from each other. We applied support vector machine classification to grey- and white-matter volume data from 126 schizophrenia patients previously allocated to the cognitive spared subtype, 74 cognitive deficit schizophrenia patients, and 134 healthy controls. Using this method, cognitive subtypes were distinguished from healthy controls with up to 72% accuracy. Cross-validation analyses between subtypes achieved an accuracy of 71%, suggesting that some common neuroanatomical patterns distinguish both subtypes from healthy controls. Notably, cognitive subtypes were best distinguished from one another when the sample was stratified by sex prior to classification analysis: cognitive subtype classification accuracy was relatively low (<60%) without stratification, and increased to 83% for females with sex stratification. Distinct neuroanatomical patterns predicted cognitive subtype status in each sex: sex-specific multivariate patterns did not predict cognitive subtype status in the other sex above chance, and weight map analyses demonstrated negative correlations between the spatial patterns of weights underlying classification for each sex. These results suggest that in typical mixed-sex samples of schizophrenia patients, the volumetric brain differences between cognitive subtypes are relatively minor in contrast to the large common disease-associated changes. Volumetric differences that distinguish between cognitive subtypes on a case-by-case basis appear to occur in a sex-specific manner that is consistent with previous evidence of disrupted relationships between brain structure and cognition in male, but not female, schizophrenia patients. Consideration of sex-specific differences in brain organization is thus likely to assist future attempts to distinguish subgroups of schizophrenia patients on the basis of neuroanatomical features.