Dataset Information

Evaluation of an Online System for Routine Outcome Monitoring: Cross-sectional Survey Study.

ABSTRACT:

Background

The use of routine outcome monitoring (ROM) in the treatment of mental health has emerged as a method of improving psychotherapy treatment outcomes. Despite this, very few clinicians regularly use ROM in clinical practice. Online ROM has been suggested as a solution to increase adoption.

Objective

The aim of this study is to identify the influence of moving ROM online on client completion rates of self-reported outcome measures and to identify implementation and utilization barriers to online ROM by assessing clinicians' views on their experience using the online system over previous paper-based methods.

Methods

Client completion rates of self-reported outcome measures were compared pre- and postimplementation of an online system of ROM. In addition, a survey questionnaire was administered to 324 mental health service providers regarding their perception of the benefits with an online system of ROM.

Results

Client completion rates of self-reported measures increased from 15.62% (427/2734) to 53.98% (1267/2347) after they were moved online. Furthermore, 57% (56/98) of service providers found the new system less time-consuming than the previous paper-based ROM, and 64% (63/98) found that it helped monitor clients. However, the perceived value of the system remains in doubt as only 23% (23/98) found it helped them identify clients at risk for treatment failure, and only 18% (18/98) found it strengthened the therapeutic alliance.

Conclusions

Although the current study suggests mixed results regarding service providers' views on their experience using an online system for ROM, it has identified barriers and challenges that are actionable for improvement.

SUBMITTER: Wiebe DE

PROVIDER: S-EPMC8686458 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe US public health response to the COVID-19 pandemic has required contact tracing and symptom monitoring at an unprecedented scale. The US Centers for Disease Control and Prevention and several partners created the Text Illness Monitoring (TIM) platform in 2015 to assist US public health jurisdictions with symptom monitoring for potential novel influenza virus outbreaks. Since May 2020, 142 federal, state, and local public health agencies have deployed TIM for COVID-19 symptom monitoring.ObjectiveThe aim of this study was to evaluate the utility, benefits, and challenges of TIM to help guide decision-making for improvements and expansion to support future public health emergency response efforts.MethodsWe conducted a brief online survey of previous and current TIM administrative users (admin users) from November 28 through December 21, 2020. Closed- and open-ended questions inquired about the onboarding process, decision to use TIM, groups monitored with TIM, comparison of TIM to other symptom monitoring systems, technical challenges and satisfaction with TIM, and user support. A total of 1479 admin users were invited to participate.ResultsA total of 97 admin users from 43 agencies responded to the survey. Most admin users represented the Indian Health Service (35/97, 36%), state health departments (26/97, 27%), and local or county health departments (18/97, 19%), and almost all were current users of TIM (85/94, 90%). Among the 43 agencies represented, 11 (26%) used TIM for monitoring staff exclusively, 13 (30%) monitored community members exclusively, and 19 (44%) monitored both staff and community members. Agencies most frequently used TIM to monitor symptom development in contacts of cases among community members (28/43, 65%), followed by symptom development among staff (27/43, 63%) and among staff contacts of cases (24/43, 56%). Agencies also reported using TIM to monitor patients with COVID-19 for the worsening of symptoms among staff (21/43, 49%) and community members (18/43, 42%). When asked to compare TIM to previous monitoring systems, 78% (40/51) of respondents rated TIM more favorably than their previous monitoring system, 20% (10/51) said there was no difference, and 2% (1/51) rated the previous monitoring system more favorably than TIM. Most respondents found TIM favorable in terms of time burden, staff burden, timeliness of the data, and the ability to monitor large population sizes. TIM compared negatively to other systems in terms of effort to enroll participants (ie, persons TIM monitors) and accuracy of the data. Most respondents (76/85, 89%) reported that they would highly or somewhat recommend TIM to others for symptom monitoring.ConclusionsThis evaluation of TIM showed that agencies used TIM for a variety of purposes and rated TIM favorably compared to previously used monitoring systems. We also identified opportunities to improve TIM; for example, enhancing the flexibility of alert deliveries would better meet admin users' varying needs. We also suggest continuous program evaluation practices to assess and respond to implementation gaps.

Project description:BackgroundYoung people are particularly vulnerable to experiencing mental health difficulties, but very few seek treatment or help during this time. Online help-seeking may offer an additional domain where young people can seek aid for mental health difficulties, yet our current understanding of how young people seek help online is limited.ObjectiveThis was an exploratory study which aimed to investigate the online help-seeking behaviors and preferences of young people.MethodsThis study made use of an anonymous online survey. Young people aged 18-25, living in Ireland, were recruited through social media ads on Twitter and Facebook and participated in the survey.ResultsA total of 1308 respondents completed the survey. Many of the respondents (80.66%; 1055/1308) indicated that they would use their mobile phone to look online for help for a personal or emotional concern. When looking for help online, 82.57% (1080/1308) of participants made use of an Internet search, while 57.03% (746/1308) made use of a health website. When asked about their satisfaction with these resources, 36.94% (399/1080) indicated that they were satisfied or very satisfied with an Internet search while 49.33% (368/746) indicated that they were satisfied or very satisfied with a health website. When asked about credibility, health websites were found to be the most trustworthy, with 39.45% (516/1308) indicating that they found them to be trustworthy or very trustworthy. Most of the respondents (82.95%; 1085/1308) indicated that a health service logo was an important indicator of credibility, as was an endorsement by schools and colleges (54.97%; 719/1308). Important facilitators of online help-seeking included the anonymity and confidentiality offered by the Internet, with 80% (1046/1308) of the sample indicating that it influenced their decision a lot or quite a lot. A noted barrier was being uncertain whether information on an online resource was reliable, with 55.96% (732/1308) of the respondents indicating that this influenced their decision a lot or quite a lot.ConclusionsFindings from this survey suggest that young people are engaging with web-based mental health resources to assist them with their mental health concerns. However, levels of satisfaction with the available resources vary. Young people are engaging in strategies to assign credibility to web-based resources, however, uncertainty around their reliability is a significant barrier to online help-seeking.

Project description:BackgroundAvailable research suggests that menstrual inequity has an impact on (menstrual) health outcomes and emotional wellbeing. It is also a significant barrier to achieve social and gender equity and compromises human rights and social justice. The aim of this study was to describe menstrual inequities and their associations with sociodemographic factors, among women and people who menstruate (PWM) aged 18-55 in Spain.MethodsA cross-sectional survey-based study was conducted in Spain between March and July 2021. Descriptive statistical analyses and multivariate logistic regression models were performed.ResultsA total of 22,823 women and PWM were included in the analyses (Mean age = 33.2, SD = 8.7). Over half of the participants had accessed healthcare services for menstruation (61.9%). The odds for accessing menstrual-related services were significantly higher among participants with university education (aOR: 1.48, 95% CI, 1.13-1.95). Also, 57.8% reported having had partial or no menstrual education pre-menarche, with odds being higher among participants born in non-European or Latin American countries (aOR: 0.58, 95% CI, 0.36-0.93). Lifetime self-reported menstrual poverty was between 22.2-39.9%. Main risk factors for menstrual poverty were identifying as non-binary (aOR: 1.67, 95% CI, 1.32-2.11), being born in non-European or Latin American countries (aOR: 2.74, 95% CI, 1.77-4.24), and not having a permit to reside in Spain (aOR: 4.27, 95% CI, 1.94-9.38). Completed university education (aOR: 0.61, 95% CI, 0.44-0.84) and no financial hardship < 12 months (aOR: 0.06, 95% CI, 0.06-0.07) were protective factors for menstrual poverty. Besides, 75.2% reported having overused menstrual products due to lack of access to adequate menstrual management facilities. Menstrual-related discrimination was reported by 44.5% of the participants. Non-binary participants (aOR: 1.88, 95% CI, 1.52-2.33) and those who did not have a permit to reside in Spain (aOR: 2.11, 95% CI, 1.10-4.03) had higher odds of reporting menstrual-related discrimination. Work and education absenteeism were reported by 20.3% and 62.7% of the participants, respectively.ConclusionsOur study suggests that menstrual inequities affect a high number of women and PWM in Spain, especially those more socioeconomically deprived, vulnerabilised migrant populations and non-binary and trans menstruators. Findings from this study can be valuable to inform future research and menstrual inequity policies.

Project description:BACKGROUND:Due to a low birth rate and an aging population, Japan faces an increase in the number of elderly people without children living in single households. These elderly without a spouse and/or children encounter a lack of caregivers because most sources of care for the elderly in Japan are not provided by private agencies but by family members. However, family caregivers not only help with daily living but are also key participants in treatment decision making. The effect of family absence on treatment decision making has not been elucidated, although more elderly people will not have family members to make surrogate decisions on their behalf. OBJECTIVE:The aim is to understand the influence of family absence on treatment decision making by physicians through a cross-sectional online survey with three hypothetical vignettes of patients. METHODS:We conducted a cross-sectional online survey among Japanese physicians using three hypothetical vignettes. The first vignette was about a 65-year-old man with alcoholic liver cirrhosis and the second was about a 78-year-old woman with dementia, both of whom developed pneumonia with consciousness disturbance. The third vignette was about a 70-year-old woman with necrosis of her lower limb. Participants were randomly assigned to either of the two versions of the questionnaires-with family or without family-but methods were identical otherwise. Participants chose yes or no responses to questions about whether they would perform the presented medical procedures. RESULTS:Among 1112 physicians, 454 (40.8%) completed the survey; there were no significant differences in the baseline characteristics between groups. Significantly fewer physicians had a willingness to perform dialysis (odds ratio [OR] 0.55, 95% CI 0.34-0.80; P=.002) and artificial ventilation (OR 0.51, 95% CI 0.35-0.75; P<.001) for a patient from vignette 1 without family. In vignette 2, fewer physicians were willing to perform artificial ventilation (OR 0.59, 95% CI 0.39-0.90; P=.02). In vignette 3, significantly fewer physicians showed willingness to perform wound treatment (OR 0.51, 95% CI 0.31-0.84; P=.007), surgery (OR 0.35, 95% CI 0.22-0.57; P<.001), blood transfusion (OR 0.45, 95% CI 0.31-0.66; P<.001), vasopressor (OR 0.49, 95% CI 0.34-0.72; P<.001), dialysis (OR 0.38, 95% CI 0.24-0.59; P<.001), artificial ventilation (OR 0.25, 95% CI 0.15-0.40; P<.001), and chest compression (OR 0.29, 95% CI 0.18-0.47; P<.001) for a patient without family. CONCLUSIONS:Elderly patients may have treatments withheld because of the absence of family, highlighting the potential importance of advance care planning in the era of an aging society with a declining birth rate.

Project description:BackgroundCOVID-19 has posed a global threat due to substantial morbidity and mortality, and health education strategies need to be adjusted accordingly to prevent a possible epidemic rebound.ObjectiveThis study aimed to evaluate the perceptions of COVID-19 among individuals coming to, returning to, or living in Jiangsu Province, China, and determine the impact of the pandemic on the perceptions of the public.MethodsIn this study, an online questionnaire was distributed to participants between February 15 and April 21, 2020. The questionnaire comprised items on personal information (eg, sex, age, educational level, and occupation); protection knowledge, skills, and behaviors related to COVID-19; access to COVID-19-related information; and current information needs. Factors influencing the knowledge score, skill score, behavior score, and total score for COVID-19 were evaluated using univariate and multivariate analyses. The time-varying reproduction number (Rt) and its 95% credible interval were calculated and compared with the daily participation number and protection scores.ResultsIn total, 52,066 participants were included in the study; their average knowledge score, skill score, behavior score, and total score were 25.58 (SD 4.22), 24.05 (SD 4.02), 31.51 (SD 2.84), and 90.02 (SD 8.87), respectively, and 65.91% (34,315/52,066) had a total protection score above 90 points. For the knowledge and skill sections, correct rates of answers to questions on medical observation days, infectiousness of asymptomatic individuals, cough or sneeze treatment, and precautions were higher than 95%, while those of questions on initial symptoms (32,286/52,066, 62.01%), transmission routes (37,134/52,066, 71.32%), selection of disinfection products (37,390/52,066, 71.81%), and measures of home quarantine (40,037/52,066, 76.90%) were relatively low. For the actual behavior section, 97.93% (50,989/52,066) of participants could wear masks properly when going out. However, 19.76% (10,290/52,066) could not disinfect their homes each week, and 18.42% (9589/52,066) could not distinguish differences in initial symptoms between the common cold and COVID-19. The regression analyses showed that the knowledge score, skill score, behavior score, and total score were influenced by sex, age, educational level, occupation, and place of residence at different degrees (P<.001). The government, television shows, and news outlets were the main sources of protection knowledge, and the information released by the government and authoritative medical experts was considered the most reliable. The current information needs included the latest epidemic developments, disease treatment progress, and daily protection knowledge. The Rt in the Jiangsu Province and mainland China dropped below 1, while the global Rt remained at around 1. The maximal information coefficients ranged from 0.76 to 1.00, which indicated that the public's perceptions were significantly associated with the epidemic.ConclusionsA high proportion of the participants had sufficient COVID-19 protection knowledge and skills and were able to avoid risky behaviors. Thus, it is necessary to apply different health education measures tailored to work and study resumption for specific populations to improve their self-protection and, ultimately, to prevent a possible rebound of COVID-19.

Project description:BackgroundPandemic fatigue is defined as feelings of demotivation to follow preventive measures against COVID-19, together with decreased trust in government and frequency of information-seeking behaviors.ObjectiveThis study aims to analyze the psychometric properties of the COVID-19-specific pandemic fatigue scale according to classical test theory (CTT) and Rasch model approaches in the general Spanish population.MethodsThis was a cross-sectional study in a representative sample of 1018 adults who completed an online survey in November 2020 in the framework of the COVID-19 Snapshot Monitoring (COSMO)-Spain project. The assessments included the 6-item COVID-19 Pandemic Fatigue Scale (CPFS) and other COVID-19-related variables: COVID-19 infection, adherence to preventive behaviors, information-seeking behavior, self-efficacy, worry, and cognitive and affective risk perception. Data quality, acceptability, reliability, and validity were analyzed according to CTT, and the fit to the Rasch model, unidimensionality, appropriateness of the response scale, item local independency, reliability (person-separation index [PSI]), and item-person distribution were also calculated.ResultsThe mean CPFS score was 17.06 (SD 5.04, range 6-30), with higher scores for women, younger participants, participants who never seek information on COVID-19, those who think they would contract a mild disease in case of infection, those with higher level of worry about coronavirus/COVID-19, and those who felt depressed or felt the coronavirus/COVID-19 is spreading slowly (all P<.01). The Cronbach alpha for the CPFS was 0.74. In the confirmatory factor analysis, one factor was identified (root mean square error of approximation [RMSEA]=.02; comparative fit index [CFI]=.99; χ25=8.06, P=.15). The CPFS showed good fit to the Rasch model (χ 224=42.025, P=.01, PSI=.642), unidimensionality (binomial 95% CI -.005 to .045), and item local independency.ConclusionsOur results suggest that the CPFS has moderate reliability and internal consistency and it is composed of a single dimension. It is a useful tool to ascertain the level of pandemic fatigue in the general population, which may help to guide the communication and information strategies to face the COVID-19 pandemic.