Dataset Information

Validating Biobehavioral Technologies for Use in Clinical Psychiatry.

ABSTRACT: The last decade has witnessed the development of sophisticated biobehavioral and genetic, ambulatory, and other measures that promise unprecedented insight into psychiatric disorders. As yet, clinical sciences have struggled with implementing these objective measures and they have yet to move beyond "proof of concept." In part, this struggle reflects a traditional, and conceptually flawed, application of traditional psychometrics (i.e., reliability and validity) for evaluating them. This paper focuses on "resolution," concerning the degree to which changes in a signal can be detected and quantified, which is central to measurement evaluation in informatics, engineering, computational and biomedical sciences. We define and discuss resolution in terms of traditional reliability and validity evaluation for psychiatric measures, then highlight its importance in a study using acoustic features to predict self-injurious thoughts/behaviors (SITB). This study involved tracking natural language and self-reported symptoms in 124 psychiatric patients: (a) over 5-14 recording sessions, collected using a smart phone application, and (b) during a clinical interview. Importantly, the scope of these measures varied as a function of time (minutes, weeks) and spatial setting (i.e., smart phone vs. interview). Regarding reliability, acoustic features were temporally unstable until we specified the level of temporal/spatial resolution. Regarding validity, accuracy based on machine learning of acoustic features predicting SITB varied as a function of resolution. High accuracy was achieved (i.e., ~87%), but only when the acoustic and SITB measures were "temporally-matched" in resolution was the model generalizable to new data. Unlocking the potential of biobehavioral technologies for clinical psychiatry will require careful consideration of resolution.

SUBMITTER: Cohen AS

PROVIDER: S-EPMC8225932 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundTo ensure quality care, clinicians need skills, knowledge, and attitudes related to technology that can be measured.ObjectiveThis paper sought out competencies for mobile technologies and/or an approach to define them.MethodsA scoping review was conducted to answer the following research question, "What skills are needed for clinicians and trainees to provide quality care via mHealth, have they been published, and how can they be made measurable and reproducible to teach and assess them?" The review was conducted in accordance with the 6-stage scoping review process starting with a keyword search in PubMed/Medical Literature Analysis and Retrieval System Online, APA PsycNET, Cochrane, EMBASE, PsycINFO, Web of Science, and Scopus. The literature search focused on keywords in 4 concept areas: (1) competencies, (2) mobile technologies, (3) telemedicine mode, and (4) health. Moreover, 2 authors independently, in parallel, screened the search results for potentially relevant studies based on titles and abstracts. The authors reviewed the full-text articles for final inclusion based on inclusion/exclusion criteria. Inclusion criteria were keywords used from concept area 1 (competencies) and 2 (mobile technologies) and either 3 (telemedicine mode) or 4 (health). Exclusion criteria included, but were not limited to, keywords used from a concept area in isolation, discussion of skills abstractly, outline or listing of what clinicians need without detail, and listing immeasurable behaviors.ResultsFrom a total of 1232 results, the authors found 78 papers eligible for a full-text review and found 14 papers directly relevant to the 4 key concepts. Although few studies specifically discussed skills, the majority were clinical studies, and the literature included no lists of measurable behaviors or competency sets for mobile technology. Therefore, a framework for mobile technology competencies was built according to the review, expert consensus, and recommendations of the Institute of Medicine's Health Professions Education Summit and Accreditation Council of Graduate Medical Education framework. This framework borrows from existing competency framework domains in telepsychiatry and social media (patient care, medical knowledge, practice-based learning and improvement, systems-based practice, professionalism, and interpersonal skills and communication) and added domains of mHealth clinical decision support, device/technology assessment/selection, and information flow management across an electronic health record platform. mHealth Asynchronous components require additional traditional learning, teaching, supervisory and evaluation practices. Interactive curricula with case-, problem-, and system-based teaching may help faculty focus on decision making and shape skills and attitudes to complement clinical exposure.ConclusionsResearch is needed on how to customize implementation and evaluation of mHealth competencies and to ensure skill development is linked to the quality of care. This will require the management of organizational change with technology and the creation of a positive electronic culture in a complex policy and regulatory environment.

Project description:Digital health technologies (smartphones, smartwatches, and other body-worn sensors) can act as novel tools to aid in the diagnosis and remote objective monitoring of an individual's disease symptoms, both in clinical care and in research. Nonetheless, such digital health technologies have yet to widely demonstrate value in clinical research due to insufficient data interpretability and lack of regulatory acceptance. Metadata, i.e., data that accompany and describe the primary data, can be utilized to better understand the context of the sensor data and can assist in data management, data sharing, and subsequent data analysis. The need for data and metadata standards for digital health technologies has been raised in academic and industry research communities and has also been noted by regulatory authorities. Therefore, to address this unmet need, we here propose a metadata set that reflects regulatory guidelines and that can serve as a conceptual map to (1) inform researchers on the metadata they should collect in digital health studies, aiming to increase the interpretability and exchangeability of their data, and (2) direct standard development organizations on how to extend their existing standards to incorporate digital health technologies. The proposed metadata set is informed by existing standards pertaining to clinical trials and medical devices, in addition to existing schemas that have supported digital health technology studies. We illustrate this specifically in the context of Parkinson's disease, as a model for a wide range of other chronic conditions for which remote monitoring would be useful in both care and science. We invite the scientific and clinical research communities to apply the proposed metadata set to ongoing and planned research. Where the proposed metadata fall short, we ask users to contribute to its ongoing revision so that an adequate degree of consensus can be maintained in a rapidly evolving technology landscape.

Project description:BackgroundPharmacogenomics (PGx) holds promise to revolutionize modern healthcare. Although there are several prospective clinical studies in oncology and cardiology, demonstrating a beneficial effect of PGx-guided treatment in reducing adverse drug reactions, there are very few such studies in psychiatry, none of which spans across all main psychiatric indications, namely schizophrenia, major depressive disorder and bipolar disorder. In this study we aim to investigate the clinical effectiveness of PGx-guided treatment (occurrence of adverse drug reactions, hospitalisations and re-admissions, polypharmacy) and perform a cost analysis of the intervention.MethodsWe report our findings from a multicenter, large-scale, prospective study of pre-emptive genome-guided treatment named as PREemptive Pharmacogenomic testing for preventing Adverse drug REactions (PREPARE) in a large cohort of psychiatric patients (n = 1076) suffering from schizophrenia, major depressive disorder and bipolar disorder.FindingsWe show that patients with an actionable phenotype belonging to the PGx-guided arm (n = 25) present with 34.1% less adverse drug reactions compared to patients belonging to the control arm (n = 36), 41.2% less hospitalisations (n = 110 in the PGx-guided arm versus n = 187 in the control arm) and 40.5% less re-admissions (n = 19 in the PGx-guided arm versus n = 32 in the control arm), less duration of initial hospitalisations (n = 3305 total days of hospitalisation in the PGx-guided arm from 110 patients, versus n = 6517 in the control arm from 187 patients) and duration of hospitalisation upon readmission (n = 579 total days of hospitalisation upon readmission in the PGx-guided arm, derived from 19 patients, versus n = 928 in the control arm, from 32 patients respectively). It was also shown that in the vast majority of the cases, there was less drug dose administrated per drug in the PGx-guided arm compared to the control arm and less polypharmacy (n = 124 patients prescribed with at least 4 psychiatric drugs in the PGx-guided arm versus n = 143 in the control arm) and smaller average number of co-administered psychiatric drugs (2.19 in the PGx-guided arm versus 2.48 in the control arm. Furthermore, less deaths were reported in the PGx-guided arm (n = 1) compared with the control arm (n = 9). Most importantly, we observed a 48.5% reduction of treatment costs in the PGx-guided arm with a reciprocal slight increase of the quality of life of patients suffering from major depressive disorder (0.935 versus 0.925 QALYs in the PGx-guided and control arm, respectively).InterpretationWhile only a small proportion (∼25%) of the entire study sample had an actionable genotype, PGx-guided treatment can have a beneficial effect in psychiatric patients with a reciprocal reduction of treatment costs. Although some of these findings did not remain significant when all patients were considered, our data indicate that genome-guided psychiatric treatment may be successfully integrated in mainstream healthcare.FundingEuropean Union Horizon 2020.

Dataset Information

Validating Biobehavioral Technologies for Use in Clinical Psychiatry.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets