Dataset Information

Initial quantitative development of the Norse Feedback system: a novel clinical feedback system for routine mental healthcare.

ABSTRACT:

Purpose

As routine outcome monitoring has become prevalent in psychological practice, there is need for measurement tools covering diverse symptoms, treatment processes, patient strengths, and risks. Here we describe the development and initial tests of the psychometric properties of a multi-scale system for use in mental healthcare, Norse Feedback.

Methods

In Study 1, we present the item-generation process and structure of the Norse Feedback, a 17-scale digital-first measurement tool for psychopathology and treatment-relevant variables. In Study 2, we present analyses of this initial measure in a nonclinical sample of 794 healthy controls and a sample of 222 mental health patients. In Study 3, we present the analysis of a revised 20-scale system in two separate samples of patients. In each analysis, we investigate item and test information in particular, including analysis of differential item functioning on gender, age, site, and sample differences where applicable.

Results

Scales performed variably. Changes to items and scales are described. Several scales appeared to reliably discriminate individuals entering mental health treatment on severity, and others are less reliable. Marked improvements in scale internal consistency and measurement precision were observed between the first and second implemented versions.

Conclusion

This system includes some scales with reasonable structural validity, though several areas for future development are identified. The system was developed to be iteratively re-evaluated, to strengthen the validity of its scales over time. There are currently a number of limitations on inferences from these scores, which future developments should address.

SUBMITTER: McAleavey AA

PROVIDER: S-EPMC8528796 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:IntroductionThe Partners for Change Outcome Management System (PCOMS) is a client feedback-system built on two brief visual analogue self-report scales. Prior studies of PCOMS have found effects varying from significant positive to negative. Aims of present study are; to test the predicted beneficial impact of PCOMS, while accounting for methodological flaws in prior studies and to clarify under which circumstances the addition of PCOMS to therapy has a beneficial effect.Methods and analysisThis study focuses on patients applying for brief, time-limited treatments. Four centres will be randomised to either treatment as usual (TAU) or TAU with PCOMS. All participating patients will be assessed four times. The full staff in the experimental condition will be trained in PCOMS. In the second part of this study, all therapists in the PCOMS condition will fill in a questionnaire concerning the influence of regulatory focus, self-efficacy, external or internal feedback orientation and perceived feedback validity of PCOMS. Finally, patients in the PCOMS condition will be asked to give feedback through a structured interview.The primary outcome measure is the Outcome Questionnaire over the period from beginning to end of therapy. The Mental Health Continuum-Short Form and Consumer Quality Index are also completed. In the primary analysis, outcomes of the two treatment conditions on treatment outcome, patient satisfaction, costs, drop-out and duration will be examined with a three-level (within patient, between patients and between therapists) multilevel analysis. The DSM-classification, sex, education level, age of each patient and therapist factors will be included as covariates.Ethics and disseminationThe Medical Ethics Committee of the University of Twente approved this study (K15-11, METC Twente). Data will be included from 1 January 2016 to 1 July 2019. Study results will be disseminated through peer-reviewed journals and conferences.Trial registration numberNTR5466; Pre-results.

Project description:Using quantitative multi-parameter mapping (MPM), studies can investigate clinically relevant microstructural changes with high reliability over time and across subjects and sites. However, long acquisition times (20 min for the standard 1-mm isotropic protocol) limit its translational potential. This study aimed to evaluate the sensitivity gain of a fast 1.6-mm isotropic MPM protocol including post-processing optimized for longitudinal clinical studies. 6 healthy volunteers (35±7 years old; 3 female) were scanned at 3T to acquire the following whole-brain MPM maps with 1.6 mm isotropic resolution: proton density (PD), magnetization transfer saturation (MT), longitudinal relaxation rate (R1), and transverse relaxation rate (R2*). MPM maps were generated using two RF transmit field (B1+) correction methods: (1) using an acquired B1+ map and (2) using a data-driven approach. Maps were generated with and without Gibb's ringing correction. The intra-/inter-subject coefficient of variation (CoV) of all maps in the gray and white matter, as well as in all anatomical regions of a fine-grained brain atlas, were compared between the different post-processing methods using Student's t-test. The intra-subject stability of the 1.6-mm MPM protocol is 2-3 times higher than for the standard 1-mm sequence and can be achieved in less than half the scan duration. Intra-subject variability for all four maps in white matter ranged from 1.2-5.3% and in gray matter from 1.8 to 9.2%. Bias-field correction using an acquired B1+ map significantly improved intra-subject variability of PD and R1 in the gray (42%) and white matter (54%) and correcting the raw images for the effect of Gibb's ringing further improved intra-subject variability in all maps in the gray (11%) and white matter (10%). Combining Gibb's ringing correction and bias field correction using acquired B1+ maps provides excellent stability of the 7-min MPM sequence with 1.6 mm resolution suitable for the clinical routine.

Project description:ObjectiveTo evaluate the feasibility of conducting a large clinical trial within the Rwandan mental healthcare system that would establish the safety, efficacy and benefit of paliperidone palmitate once-monthly (PP1M) and once-every-3-months (PP3M) long-acting injectable formulations in adults with schizophrenia.Study designAn open-label, prospective feasibility study.Setting/participants33 adult patients with schizophrenia were enrolled at 3 sites across Rwanda.InterventionsThe study design included 3 phases of treatment: an oral run-in to establish tolerability to risperidone (1 week), lead-in treatment with flexibly dosed PP1M to identify a stable dose (17 weeks) and maintenance treatment with PP3M (24 weeks).Primary and secondary outcome measuresFeasibility endpoints included compliance with governmental and institutional requirements, acceptable supply chain delivery and proper onsite administration of risperidone/PP1M/PP3M, adequate site infrastructure, adequate training of clinical staff and successful completion of study procedures and scales. A variety of study scales were administered to assess outcomes relevant to patients, caregivers, clinicians and payers in Rwanda and other resource-limited settings.ResultsThis study was terminated early by the sponsor because certain aspects of study conduct needed to be addressed to maintain Good Clinical Practice requirements and meet regulatory standards. Results identified areas for improvement in study execution, including study governance, site infrastructure, study preparation and conduct of procedures, study budget and study assessments. Despite the identification of areas in need of adjustment, none of these limitations were considered insurmountable.ConclusionsThis work was designed to strengthen global research in schizophrenia by building the capacity of researchers to prepare and conduct pharmaceutical trials in resource-limited settings. Although the study was ended early, modifications motivated by the results will facilitate the successful design and completion of more comprehensive studies, including an ongoing, follow-up interventional trial of PP1M/PP3M in a larger population of patients in Rwanda.Trial registration numberNCT03713658.

Project description:BackgroundPharmacogenomic clinical decision support systems (CDSS) have the potential to help overcome some of the barriers for translating pharmacogenomic knowledge into clinical routine. Before developing a prototype it is crucial for developers to know which pharmacogenomic CDSS features and user-system interactions have yet been developed, implemented and tested in previous pharmacogenomic CDSS efforts and if they have been successfully applied. We address this issue by providing an overview of the designs of user-system interactions of recently developed pharmacogenomic CDSS.MethodsWe searched PubMed for pharmacogenomic CDSS published between January 1, 2012 and November 15, 2016. Thirty-two out of 118 identified articles were summarized and included in the final analysis. We then compared the designs of user-system interactions of the 20 pharmacogenomic CDSS we had identified.ResultsAlerts are the most widespread tools for physician-system interactions, but need to be implemented carefully to prevent alert fatigue and avoid liabilities. Pharmacogenomic test results and override reasons stored in the local EHR might help communicate pharmacogenomic information to other internal care providers. Integrating patients into user-system interactions through patient letters and online portals might be crucial for transferring pharmacogenomic data to external health care providers. Inbox messages inform physicians about new pharmacogenomic test results and enable them to request pharmacogenomic consultations. Search engines enable physicians to compare medical treatment options based on a patient's genotype.ConclusionsWithin the last 5 years, several pharmacogenomic CDSS have been developed. However, most of the included articles are solely describing prototypes of pharmacogenomic CDSS rather than evaluating them. To support the development of prototypes further evaluation efforts will be necessary. In the future, pharmacogenomic CDSS will likely include prediction models to identify patients who are suitable for preemptive genotyping.

Project description:ImportanceLive feedback in the operating room is essential in surgical training. Despite the role this feedback plays in developing surgical skills, an accepted methodology to characterize the salient features of feedback has not been defined.ObjectiveTo quantify the intraoperative feedback provided to trainees during live surgical cases and propose a standardized deconstruction for feedback.Design, setting, and participantsIn this qualitative study using a mixed methods analysis, surgeons at a single academic tertiary care hospital were audio and video recorded in the operating room from April to October 2022. Urological residents, fellows, and faculty attending surgeons involved in robotic teaching cases during which trainees had active control of the robotic console for at least some portion of a surgery were eligible to voluntarily participate. Feedback was time stamped and transcribed verbatim. An iterative coding process was performed using recordings and transcript data until recurring themes emerged.ExposureFeedback in audiovisual recorded surgery.Main outcomes and measuresThe primary outcomes were the reliability and generalizability of a feedback classification system in characterizing surgical feedback. Secondary outcomes included assessing the utility of our system.ResultsIn 29 surgical procedures that were recorded and analyzed, 4 attending surgeons, 6 minimally invasive surgery fellows, and 5 residents (postgraduate years, 3-5) were involved. For the reliability of the system, 3 trained raters achieved moderate to substantial interrater reliability in coding cases using 5 types of triggers, 6 types of feedback, and 9 types of responses (prevalence-adjusted and bias-adjusted κ range: a 0.56 [95% CI, 0.45-0.68] minimum for triggers to a 0.99 [95% CI, 0.97-1.00] maximum for feedback and responses). For the generalizability of the system, 6 types of surgical procedures and 3711 instances of feedback were analyzed and coded with types of triggers, feedback, and responses. Significant differences in triggers, feedback, and responses reflected surgeon experience level and surgical task being performed. For example, as a response, attending surgeons took over for safety concerns more often for fellows than residents (prevalence rate ratio [RR], 3.97 [95% CI, 3.12-4.82]; P = .002), and suturing involved more errors that triggered feedback than dissection (RR, 1.65 [95% CI, 1.03-3.33]; P = .007). For the utility of the system, different combinations of trainer feedback had associations with rates of different trainee responses. For example, technical feedback with a visual component was associated with an increased rate of trainee behavioral change or verbal acknowledgment responses (RR, 1.11 [95% CI, 1.03-1.20]; P = .02).Conclusions and relevanceThese findings suggest that identifying different types of triggers, feedback, and responses may be a feasible and reliable method for classifying surgical feedback across several robotic procedures. Outcomes suggest that a system that can be generalized across surgical specialties and for trainees of different experience levels may help galvanize novel surgical education strategies.