Dataset Information

A data-driven framework for selecting and validating digital health metrics: use-case in neurological sensorimotor impairments.

ABSTRACT: Digital health metrics promise to advance the understanding of impaired body functions, for example in neurological disorders. However, their clinical integration is challenged by an insufficient validation of the many existing and often abstract metrics. Here, we propose a data-driven framework to select and validate a clinically relevant core set of digital health metrics extracted from a technology-aided assessment. As an exemplary use-case, the framework is applied to the Virtual Peg Insertion Test (VPIT), a technology-aided assessment of upper limb sensorimotor impairments. The framework builds on a use-case-specific pathophysiological motivation of metrics, models demographic confounds, and evaluates the most important clinimetric properties (discriminant validity, structural validity, reliability, measurement error, learning effects). Applied to 77 metrics of the VPIT collected from 120 neurologically intact and 89 affected individuals, the framework allowed selecting 10 clinically relevant core metrics. These assessed the severity of multiple sensorimotor impairments in a valid, reliable, and informative manner. These metrics provided added clinical value by detecting impairments in neurological subjects that did not show any deficits according to conventional scales, and by covering sensorimotor impairments of the arm and hand with a single assessment. The proposed framework provides a transparent, step-by-step selection procedure based on clinically relevant evidence. This creates an interesting alternative to established selection algorithms that optimize mathematical loss functions and are not always intuitive to retrace. This could help addressing the insufficient clinical integration of digital health metrics. For the VPIT, it allowed establishing validated core metrics, paving the way for their integration into neurorehabilitation trials.

SUBMITTER: Kanzler CM

PROVIDER: S-EPMC7260375 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A data-driven framework for selecting and validating digital health metrics: use-case in neurological sensorimotor impairments.

Kanzler Christoph M CM Rinderknecht Mike D MD Schwarz Anne A Lamers Ilse I Gagnon Cynthia C Held Jeremia P O JPO Feys Peter P Luft Andreas R AR Gassert Roger R Lambercy Olivier O

NPJ digital medicine 20200529

Digital health metrics promise to advance the understanding of impaired body functions, for example in neurological disorders. However, their clinical integration is challenged by an insufficient validation of the many existing and often abstract metrics. Here, we propose a data-driven framework to select and validate a clinically relevant core set of digital health metrics extracted from a technology-aided assessment. As an exemplary use-case, the framework is applied to the Virtual Peg Inserti ...[more]

PMID: 32529042

Similar Datasets

Project description:Within One Health, research translation is a dynamic process involving collaboration and communication between the human, animal, and environmental health sectors to create and apply research findings to address health threats at the human-animal-environment interface. Research translation is essential for the creation of evidence-based policies and programs for the prevention and control of infectious diseases and other health threats, and thus is an important component of a robust national capacity to effectively prevent, control, and mitigate biological incidents. However, there is a lack of conceptual guidance and training materials for research translation in a One Health context. To address this need, we developed a novel One Health Research Translation Framework that describes an iterative process for research and policy stakeholders to collaborate to design and implement research applications addressing One Health zoonotic disease challenges. In addition, we developed accompanying training materials to validate the Framework and facilitate capacity building for understanding and applying research translation concepts to zoonotic disease threats. The training materials consist of exercises to map One Health communication pathways and literature-based case studies on research translation to address zoonotic disease concerns. The Framework and training materials were piloted with Egyptian One Health stakeholders at a workshop in Cairo in 2018. The outcomes of the workshop validated the comprehensiveness and applicability of the Framework and training materials, as participants were able to demonstrate a firm understanding of research translation processes and successfully apply research translation and One Health concepts to real-world zoonotic disease scenarios. Overall, the Framework and accompanying training materials address an important gap in capacity building for One Health stakeholders and are valuable tools for strengthening research translation networks that promote development of innovative, evidence-based solutions to One Health zoonotic disease threats.

Project description:Making complex medical decisions is becoming an increasingly challenging task due to the growing amount of available evidence to consider and the higher demand for personalized treatment and patient care. IT systems for the provision of clinical decision support (CDS) can provide sustainable relief if decisions are automatically evaluated and processed. In this paper, we propose an approach for quantifying similarity between new and previously recorded medical cases to enable significant knowledge transfer for reasoning tasks on a patient-level. Methodologically, 102 medical cases with oropharyngeal carcinoma were analyzed retrospectively. Based on independent disease characteristics, patient-specific data vectors including relevant information entities for primary and adjuvant treatment decisions were created. Utilizing the ϕK correlation coefficient as the methodological foundation of our approach, we were able to determine the predictive impact of each characteristic, thus enabling significant reduction of the feature space to allow for further analysis of the intra-variable distances between the respective feature states. The results revealed a significant feature-space reduction from initially 19 down to only 6 diagnostic variables (ϕK correlation coefficient ≥ 0.3, ϕK significance test ≥ 2.5) for the primary and 7 variables (from initially 14) for the adjuvant treatment setting. Further investigation on the resulting characteristics showed a non-linear behavior in relation to the corresponding distances on intra-variable level. Through the implementation of a 10-fold cross-validation procedure, we were further able to identify 8 (primary treatment) matching cases with an evaluation score of 1.0 and 9 (adjuvant treatment) matching cases with an evaluation score of 0.957 based on their shared treatment procedure as the endpoint for similarity definition. Based on those promising results, we conclude that our proposed method for using data-driven similarity measures for application in medical decision-making is able to offer valuable assistance for physicians. Furthermore, we consider our approach as universal in regard to other clinical use-cases, which would allow for an easy-to-implement adaptation for a range of further medical decision-making scenarios.

Project description:The analytic procedures incorporated to facilitate the delivery of projects are often referred to as project analytics. Existing techniques focus on retrospective reporting and understanding the underlying relationships to make informed decisions. Although machine learning algorithms have been widely used in addressing problems within various contexts (e.g., streamlining the design of construction projects), limited studies have evaluated pre-existing machine learning methods within the delivery of construction projects. Due to this, the current research aims to contribute further to this convergence between artificial intelligence and the execution construction project through the evaluation of a specific set of machine learning algorithms. This study proposes a machine learning-based data-driven research framework for addressing problems related to project analytics. It then illustrates an example of the application of this framework. In this illustration, existing data from an open-source data repository on construction projects and cost overrun frequencies was studied in which several machine learning models (Python's Scikit-learn package) were tested and evaluated. The data consisted of 44 independent variables (from materials to labour and contracting) and one dependent variable (project cost overrun frequency), which has been categorised for processing under several machine learning models. These models include support vector machine, logistic regression, k-nearest neighbour, random forest, stacking (ensemble) model and artificial neural network. Feature selection and evaluation methods, including the Univariate feature selection, Recursive feature elimination, SelectFromModel and confusion matrix, were applied to determine the most accurate prediction model. This study also discusses the generalisability of using the proposed research framework in other research contexts within the field of project management. The proposed framework, its illustration in the context of construction projects and its potential to be adopted in different contexts will significantly contribute to project practitioners, stakeholders and academics in addressing many project-related issues.

Dataset Information

A data-driven framework for selecting and validating digital health metrics: use-case in neurological sensorimotor impairments.

Publications

A data-driven framework for selecting and validating digital health metrics: use-case in neurological sensorimotor impairments.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets