MyHEARTSMAP: development and evaluation of a psychosocial self-assessment tool, for and by youth.
Ontology highlight
ABSTRACT: Background
Paediatric mental health-related visits to the emergency department are rising. However, few tools exist to identify concerns early and connect youth with appropriate mental healthcare. Our objective was to develop a digital youth psychosocial assessment and management tool (MyHEARTSMAP) and evaluate its inter-rater reliability when self-administered by a community-based sample of youth and parents.Methods
We conducted a multiphasic, multimethod study. In phase 1, focus group sessions were used to inform tool development, through an iterative modification process. In phase 2, a cross-sectional study was conducted in two rounds of evaluation, where participants used MyHEARTSMAP to assess 25 fictional cases.Results
MyHEARTSMAP displays good face and content validity, as supported by feedback from phase 1 focus groups with youth and parents (n=38). Among phase 2 participants (n=30), the tool showed moderate to excellent agreement across all psychosocial sections (?=0.76-0.98).Conclusions
Our findings show that MyHEARTSMAP is an approachable and interpretable psychosocial assessment and management tool that can be reliably applied by a diverse community sample of youth and parents.
SUBMITTER: Virk P
PROVIDER: S-EPMC6668754 | biostudies-literature | 2019
REPOSITORIES: biostudies-literature
Publications
MyHEARTSMAP: development and evaluation of a psychosocial self-assessment tool, for and by youth.
Virk Punit P Laskin Samara S Gokiert Rebecca R Richardson Chris C Newton Mandi M Stenstrom Rob R Wright Bruce B Black Tyler T Doan Quynh Q
BMJ paediatrics open 20190724 1
<h4>Background</h4>Paediatric mental health-related visits to the emergency department are rising. However, few tools exist to identify concerns early and connect youth with appropriate mental healthcare. Our objective was to develop a digital youth psychosocial assessment and management tool (MyHEARTSMAP) and evaluate its inter-rater reliability when self-administered by a community-based sample of youth and parents.<h4>Methods</h4>We conducted a multiphasic, multimethod study. In phase 1, focu ...[more]
Similar Datasets
Project description:ObjectivePoor electronic health record (EHR) usability contributes to clinician burnout and poses patent safety risks. Site-specific customization and configuration of EHRs require individual EHR system usability and safety testing which is resource intensive. We developed and pilot-tested a self-administered EHR usability and safety assessment tool, focused on computerized provider order entry (CPOE), which can be used by any facility to identify specific issues. In addition, the tool provides recommendations for improvement.Materials and methodsAn assessment tool consisting of 104 questions was developed and pilot-tested at 2 hospitals, one using a Cerner EHR and the other using Epic. Five physicians at each site participated in and completed the assessment. Participant response accuracy compared to actual EHR interactions, consistency across participants, and usability issues identified through the tool were measured at each site.ResultsAcross sites, participants answered an average of 46 questions in 23 min with 89.9% of responses either correct or partially correct. The tool identified 8 usability and safety issues at one site and 7 at the other site across medication, laboratory, and radiology CPOE functions.DiscussionThe tool shows promise as a method to rapidly evaluate EHR usability and safety and provide guidance on specific areas for improvement. Important improvements to the evaluation tool were identified including the need to clarify certain questions and provide definitions for usability terminology.ConclusionA self-administered usability and safety assessment tool can serve to identify specific usability and safety issues in the EHR and provide guidance for improvements.
| S-EPMC9338455 | biostudies-literature
Project description:The purpose of this study was to review the current evidence base of psychosocial treatments for suicidal and nonsuicidal self-injurious thoughts and behaviors (SITBs) in youth. We reviewed major scientific databases (HealthSTAR, MEDLine, PsycINFO, PubMed) for relevant studies published prior to June 2013. The search identified 29 studies examining interventions for suicidal or nonsuicidal SITBs in children or adolescents. No interventions currently meet the Journal of Clinical Child and Adolescent Psychology standards for Level 1: well-established treatments. Six treatment categories were classified as Level 2: probably efficacious or Level 3: possibly efficacious for reducing SITBs in youth. These treatments came from a variety of theoretical orientations, including cognitive-behavioral, family, interpersonal, and psychodynamic theories. Common elements across efficacious treatments included family skills training (e.g., family communication and problem solving), parent education and training (e.g., monitoring and contingency management), and individual skills training (e.g., emotion regulation and problem solving). Several treatments have shown potential promise for reducing SITBs in children and adolescents. However, the probably/possibly efficacious treatments identified each have evidence from only a single randomized controlled trial. Future research should focus on replicating studies of promising treatments, identifying active treatment ingredients, examining mediators and moderators of treatment effects, and developing brief interventions for high-risk periods (e.g., following hospital discharge).
| S-EPMC4557625 | biostudies-literature
Project description:In The Netherlands, police officers not only come into contact with juvenile offenders, but also with a large number of juveniles who were involved in a criminal offense, but not in the role of a suspect (i.e., juvenile non-offenders). Until now, no valid and reliable instrument was available that can be used by Dutch police officers for estimating the risk for future care needs of juvenile non-offenders. In the present study, the Youth Actuarial Care Needs Assessment Tool for Non-Offenders (Y-ACNAT-NO) was developed for predicting the risk for future care needs that consisted of (1) a future supervision order as imposed by a juvenile court judge and (2) future worrisome incidents involving child abuse, domestic violence/strife, and/or sexual offensive behavior at the juvenile's living address (i.e., problems in the child-rearing environment).Police records of 3,200 juveniles were retrieved from the Dutch police registration system after which the sample was randomly split in a construction (n = 1,549) and validation sample (n = 1,651). The Y-ACNAT-NO was developed by performing an Exhaustive CHAID analysis using the construction sample. The predictive validity of the instrument was examined in the validation sample by calculating several performance indicators that assess discrimination and calibration.The CHAID output yielded an instrument that consisted of six variables and eleven different risk groups. The risk for future care needs ranged from 0.06 in the lowest risk group to 0.83 in the highest risk group. The AUC value in the validation sample was .764 (95% CI [.743, .784]) and Sander's calibration score indicated an average assessment error of 3.74% in risk estimates per risk category.The Y-ACNAT-NO is the first instrument that can be used by Dutch police officers for estimating the risk for future care needs of juvenile non-offenders. The predictive validity of the Y-ACNAT-NO in terms of discrimination and calibration was sufficient to justify its use as an initial screening instrument when a decision is needed about referring a juvenile for further assessment of care needs.
| S-EPMC4399228 | biostudies-other
Project description:BACKGROUND: Footwear characteristics have been linked to falls in older adults and children, and the development of many musculoskeletal conditions. Due to the relationship between footwear and pathology, health professionals have a responsibility to consider footwear characteristics in the etiology and treatment of various patient presentations. In order for health professionals and researchers to accurately and efficiently critique an individual's footwear, a valid and reliable footwear assessment tool is required. The aim of this study was to develop a simple, efficient, and reliable footwear assessment tool potentially suitable for use in a range of patient populations. METHODS: Consideration of previously published tools, other footwear related literature, and clinical considerations of three therapists were used to assist in the development of the tool. The tool was developed to cover fit, general features, general structure, motion control properties, cushioning, and wear patterns. A total of 15 participants (who provided two pairs of shoes each) were recruited, and assessment using the scale was completed on two separate occasions (separated by 1 - 3 weeks) by a physiotherapist and a podiatrist on each participant's dominant foot. Intra-rater and inter-rater reliability were evaluated using intra-class correlation coefficients (ICCs) (model 2, 1) and the 95% limits of agreement (95% LOAs) for continuous items, and percentage agreement and kappa (kappa) statistics for categorical items. RESULTS: All categorical items demonstrated high percentage agreement statistic for intra-rater (83 - 100%) and inter-rater (83 - 100%) comparisons. With the exception of last shape and objective measures used to categorise the adequacy of length, excellent intra-rater (ICC = 0.91 - 1.00) and inter-rater reliability (ICC = 0.90 - 1.00) was indicated for continuous items in the tool, including the motion control properties scale (0.91 - 0.95). CONCLUSION: A comprehensive footwear assessment tool with good face validity has been developed to assist future research and clinical footwear assessment. Generally good reliability amongst all items indicates that the tool can be used with confidence in research and clinical settings. Further research is now required to determine the clinical validity of each item in various patient populations.
| S-EPMC2678108 | biostudies-literature
Project description:PurposeEffective communication skills are essential for resident doctors to provide optimum patient care. This study was conducted to develop and validate a questionnaire for the self-assessment of resident doctors’ communication skills in India.MethodsThis was a mixed-methods study conducted in 2 phases. The first phase consisted of questionnaire development, including the identification of relevant literature, focus group discussions with residents and experts from clinical specialties, and pre-testing of the questionnaire. The second phase involved administering the questionnaire survey to 95 residents from the Departments of Medicine, Emergency Medicine, Pediatrics, and Surgery at the All India Institute of Medical Sciences, New Delhi, India in April 2019. Internal consistency was tested and the factor structure was analyzed to test construct validity.ResultsThe questionnaire consisted of 3 sections: (A) 4 items on doctor-patient conflicts and the role of communication skills in avoiding these conflicts, (B) 29 items on self-assessment of communication skills in different settings, and (C) 8 items on barriers to practicing good communication skills. Sections B and C had good internal consistency (Cronbach α: 0.885 and 0.771, respectively). Section C had a 2-factor solution, and the barriers were classified as ‘training’ and ‘infrastructure’ factors.ConclusionThis appears to be a valid assessment tool of resident doctors’ communication skills, with potential utility for identifying gaps in communication skills and developing communication skills modules.
| S-EPMC6635607 | biostudies-literature
Project description:ObjectivesPoint-of-care ultrasound (POCUS) has become an integral diagnostic and interventional tool. Barriers to POCUS training persist, and it continues to remain heterogeneous across training programs. Structured POCUS assessment tools exist, but remain limited in their feasibility, acceptability, reliability, and validity; none of these tools are entrustment-based. The objective of this study was to derive a simple, entrustment-based POCUS competency assessment tool and pilot it in an assessment setting.MethodsThis study was composed of two phases. First, a three-step modified Delphi design surveyed 60 members of the Canadian Association of Emergency Physicians Emergency Ultrasound Committee (EUC) to derive the anchors for the tool. Subsequently, the derived ultrasound competency assessment tool (UCAT) was used to assess trainee (N = 37) performance on a simulated FAST examination. The intraclass correlation (ICC) for inter-rater reliability and Cronbach's alpha for internal consistency were calculated. A statistical analysis was performed to compare the UCAT to other competency surrogates.ResultsThe three-round Delphi had 22, 26, and 26 responses from the EUC members. Consensus was reached, and anchors for the domains of preparation, image acquisition, image optimization, and clinical integration achieved approval rates between 92 and 96%. The UCAT pilot revealed excellent inter-rater reliability (with ICC values of 0.69-0.89; p < 0.01) and high internal consistency (α = 0.91). While UCAT scores were not impacted by level of training, they were significantly impacted by the number of previous POCUS studies completed.ConclusionsWe developed and successfully piloted the UCAT, an entrustment-based bedside POCUS competency assessment tool suitable for rapid deployment. The findings from this study indicate early validity evidence for the use of the UCAT as an assessment of trainee POCUS competence on FAST. The UCAT should be trialed in different populations performing several POCUS study types.
| S-EPMC8138101 | biostudies-literature
Project description:BACKGROUND:Patient-reported outcome (PRO) instruments provide robust and effective means of evaluating patients' treatment experience; however, none adequately cover experience using self-injection devices with enhanced features, such as an electromechanical autoinjector (e-Device). The aim of this study was to develop a PRO instrument that accurately assesses patient experience of using an e-Device and to evaluate its psychometric properties. METHODS:A mixed-methods approach was taken; two parallel, targeted literature reviews were conducted to identify relevant concepts and existing self-injection PRO instruments that could be adapted. Patient feedback obtained from two focus groups was used to inform initial instrument development. The pilot instrument was then administered in a multicenter, open-label, phase 3 clinical study in which patients self-injected certolizumab pegol using an e-Device, to gather evidence of its psychometric qualities. Exit interviews were conducted with a sub-sample of patients enrolled in the study to confirm the appropriateness and clarity of the items included and cognitively debrief the instrument. Confirmatory factor analysis (CFA) was conducted on all items, and each domain's internal consistency was measured using Cronbach's ?. RESULTS:The literature searches identified several e-Device-specific concepts related to device features, device function, side effects/reactions/pain, confidence, and interference/convenience in daily life. Seven existing PRO instruments were identified. The Self-Injection Assessment Questionnaire (SIAQ), containing pre- and post-injection questionnaire modules, was selected as most suitable and adapted using feedback from 19 patients in the two focus groups to form the pilot Assessment of Self-Injection (ASI) questionnaire. CFA resulted in some changes to the grouping of items in the post-injection module domains following psychometric evaluation of the ASI. Internal consistency was satisfactory for all pre- and post-injection domains (??>?0.8). Cognitive debriefing results from 12 patient exit interviews confirmed the ASI's appropriateness and clarity. CONCLUSIONS:The ASI was developed iteratively with patient input and was evaluated in its intended clinical context of use. Psychometric analyses indicated promising cross-sectional results; the ASI was well understood and considered relevant by patients self-injecting using the e-Device, suggesting that it could be used in real-world settings to aid with clinical decision making. TRIAL REGISTRATION:NCT03357471.
| S-EPMC7640481 | biostudies-literature
Project description:BackgroundThe World Health Organization describes health literacy as a critical determinant of health and driver of citizen empowerment and health equity. Several studies have shown that health literacy is associated with a range of socioeconomic factors including educational attainment, financial position and ethnicity. The complexity of the health system influences how well a person is able to engage with information and services. Health organisations can empower the populations they serve and address inequity by ensuring they are health literacy responsive. The aim of this study was to develop the Organisational Health Literacy Responsiveness self-assessment tool (Org-HLR Tool), and an assessment process to support organisations with application of the tool.MethodsA co-design workshop with health and social service professionals was undertaken to inform the structure of the tool and assessment process. Participants critiqued existing self-assessment tools and discussed the likely utility of the data they generate. A review of widely used organisational performance assessment tools informed the structure and self-assessment process. The Organisational Health Literacy Responsiveness (Org-HLR) Framework (with seven domains/24 sub-domains) provided the structure for the assessment dimensions of the tool. The performance indicators were drawn from raw data collected during development of the Org-HLR Framework.ResultsTwenty-two professionals participated in the workshop. Based on the feedback provided and a review of existing tools, a multi-stage, group-based assessment process for implementing the Org-HLR Tool was developed. The assessment process was divided into three parts; i) reflection; ii) self-rating; and iii) priority setting, each supported by a corresponding tool. The self-rating tool, consistent with the Org-HLR Framework, was divided into: External policy and funding environment; Leadership and culture; Systems, processes and policies; Access to services and programs; Community engagement and partnerships; Communication practices and standards; Workforce. Each of these had 1 to 5 sub-dimensions (24 in total), and 135 performance indicators.ConclusionsThe Org-HLR Tool and assessment process were developed to address a gap in available tools to support organisations to assess their health literacy responsiveness, and prioritise and plan their quality improvement activities. The tool is currently in the field for further utility and acceptability testing.
| S-EPMC6128002 | biostudies-literature
Project description:The current review provides an evidence base update of psychosocial treatments for self-injurious thoughts and behaviors (SITBs) in youth. A systematic search was conducted of 2 major scientific databases (PsycInfo and PubMed) and ClinicalTrials.gov for relevant randomized controlled trials (RCTs) published prior to June 2018. The search identified 26 RCTs examining interventions for SITBs in youth: 17 were included in the 2015 review and 9 trials were new to this update. The biggest change since the prior review was the evaluation of Dialectical Behavior Therapy for adolescents (DBT-A) as the first Level 1: Well-established intervention for reducing deliberate self-harm (composite of nonsuicidal and suicidal self-injury) and suicide ideation in youth and Level 2: Probably efficacious for reducing nonsuicidal self-injury and suicide attempts. Five other interventions were rated as Level 2: Probably efficacious for reducing SITBs in youth, with the new addition of Integrated Family Therapy. This evidence base update indicates that there are a few promising treatments for reducing SITBs in youth. Efficacious interventions typically include a significant family or parent training component as well as skills training (e.g., emotion regulation skills). Aside from DBT-A, few treatments have been examined in more than one RCT. Given that replication by independent research groups is needed to evaluate an intervention as Well-established, future research should focus on replicating the five promising interventions currently evaluated as Probably efficacious. In addition, an important future direction is to develop brief efficacious interventions that may be scalable to reach large numbers of youth.
| S-EPMC6534465 | biostudies-literature
Project description:There are persistent socioeconomic disparities in many aspects of child development in America. Relative to their affluent peers, children of low socioeconomic status (SES) complete fewer years of education, have a higher prevalence of health problems, and are convicted of more criminal offenses. Based on research indicating that low self-control underlies some of these disparities, policymakers have begun incorporating character-skills training into school curricula and social services. However, emerging data suggest that for low-SES youth, self-control may act as a "double-edged sword," facilitating academic success and psychosocial adjustment, while at the same time undermining physical health. Here, we examine this hypothesis in a five-wave study of 292 African American teenagers from rural Georgia. From ages 17 to 20 y, we assessed SES and self-control annually, along with depressive symptoms, substance use, aggressive behavior, and internalizing problems. At age 22 y, we obtained DNA methylation profiles of subjects' peripheral blood mononuclear cells. These data were used to measure epigenetic aging, a methylation-derived biomarker reflecting the disparity between biological and chronological aging. Among high-SES youth, better mid-adolescent self-control presaged favorable psychological and methylation outcomes. However, among low-SES youth, self-control had divergent associations with these outcomes. Self-control forecasted lower rates of depressive symptoms, substance use, aggressive behavior, and internalizing problems but faster epigenetic aging. These patterns suggest that for low-SES youth, resilience is a "skin-deep" phenomenon, wherein outward indicators of success can mask emerging problems with health. These findings have conceptual implications for models of resilience, and practical implications for interventions aimed at ameliorating social and racial disparities.
| S-EPMC4547243 | biostudies-literature