Dataset Information

A review of the reliability and validity of OPCRIT in relation to its use for the routine clinical assessment of mental health patients.

ABSTRACT: The OPCRIT program is a symptom checklist with accompanying algorithms producing operationally defined diagnoses. We undertook a review of studies which had used OPCRIT and had reported statistics concerning its reliability and validity, producing summary measures from 44 studies. The first main measure of interest was inter-rater reliability where mean kappa values indicated that agreement between raters was "substantial" with a marginal improvement at the diagnostic (0.76) versus individual item (0.69) level. The second main measure of interest was convergent validity - the agreement between OPCRIT and clinical diagnoses. Most studies reported these figures as concordance rates suggesting mean agreement, unadjusted for chance, of 69%. Very few studies used the chance-adjusted kappa statistic but where this was used agreement was "fair" (0.39). Agreement between OPCRIT and other research diagnoses was "moderate" (0.60). We also considered differences between the way OPCRIT has traditionally been used in research settings and the naturalistic manner in which it will be employed in the hospital ward. This review provides a summary of the reliability and validity of OPCRIT, which will be considered during the preparation for its use in the routine characterization of mental health patients in clinical settings.

SUBMITTER: Brittain PJ

PROVIDER: S-EPMC6878530 | biostudies-literature | 2013 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A review of the reliability and validity of OPCRIT in relation to its use for the routine clinical assessment of mental health patients.

Brittain Philip J PJ Stahl Daniel D Rucker James J Kawadler Jamie J Schumann Gunter G

International journal of methods in psychiatric research 20130509 2

The OPCRIT program is a symptom checklist with accompanying algorithms producing operationally defined diagnoses. We undertook a review of studies which had used OPCRIT and had reported statistics concerning its reliability and validity, producing summary measures from 44 studies. The first main measure of interest was inter-rater reliability where mean kappa values indicated that agreement between raters was "substantial" with a marginal improvement at the diagnostic (0.76) versus individual it ...[more]

PMID: 23657924

Similar Datasets

Project description:BackgroundPreoperative assessment of mental health rarely occurs within routine surgery. Any screening tool selected to form part of this process must be deemed practical, acceptable and valid by clinicians and consumers alike. This study aims to assess the acceptability and face validity of two existing mental health screening tools to select one for further development and use in the routine surgical setting.MethodsA survey of clinicians and consumers was conducted from October 2020 to March 2021 at a tertiary hospital in Sydney, Australia. Using a Likert scale (1-5, lowest to highest rating), the clinicians evaluated four domains for acceptability and two for validity (six overall) and the consumers four domains for acceptability and one for validity (five overall) on the preoperative use of the amended Kessler Psychological Distress Scale (K10) and the Somatic and Psychological Health Report-12 (SPHERE-12). Consensus was achieved through a rating of 4 or 5 being given by 70% or more of participants with domains able to remain unchanged. Free text responses were analysed into themes.ResultsA total of 73 participants (51 clinicians; 22 consumers) were included. The K10 received consensus scores (≥ 70%) in four out of six domains for clinicians (4/4 acceptability; 0/2 validity), and all five domains for consumers (4/4 acceptability; 1/1 validity). The SPHERE-12 received consensus scores (≥ 70%) in three domains for clinicians (3/4 acceptability; 0/2 validity), and three domains for consumers (3/4 acceptability; 0/1 validity). Six qualitative themes were described including (1) amendments to tool structure and language; (2) scale response options; (3) difficulty with somatic questions; (4) practicality and familiarity with K10; (5) challenges for specific patient cohorts and (6) timing considerations for patients.ConclusionAdequate acceptability was established for the K10. However further development is required to strengthen its validity for this specific surgical cohort and purpose. Future research to determine the feasibility and acceptability of implementing and using the K10 in the routine surgical setting is now needed.

Project description:Background and Aim: Mental health is an integral part of adolescent wellbeing. However, only few adolescents understand the importance of mental health and are aware of the right time to seek help. Lack of knowledge and stigma may impede help-seeking behavior. To assess these aspects, three questionnaires have been developed in the English language. This study aims to assess the validity and reliability of an Indonesian version of the Mental Health Literacy and Help-Seeking Behavior set of questionnaires among adolescents in Indonesia. Methods: This is a cross-sectional study that used The Mental Health Literacy and Help-Seeking Behavior set of questionnaires developed by Kutcher and Wei. The set consists of three questionnaires: the Mental Health Knowledge, Attitude Toward Mental Health, and Help-Seeking Behavior questionnaire. The study was conducted between October 2020 and January 2021 with 68 first-year medical students at the University of Indonesia, who represented adolescents in a transitional phase. The questionnaires were translated into the Indonesian language by a bilingual psychiatrist and reviewed by 10 expert psychiatrists to determine content validity [Item-Level Content Validity Index (I-CVI) and Scale-Level Content Validity Index (S-CVI)]. Cronbach's alpha values were used to assess internal consistency (reliability). Results: The content validity test produced positive results with an I-CVI scores of 0.7–1.0 and S-CVI scores of 0.87, 0.90, and 0.99 for the knowledge, attitude, and help-seeking behavior questionnaires, respectively. For the reliability test, Cronbach's alpha values were 0.780 for the attitude questionnaire and 0.852 for the help-seeking behavior questionnaire, while the value for the knowledge questionnaire was 0.521. Conclusion: The ability to properly measure mental health through the availability of accessible, valid, and understandable tools plays an important role in addressing mental health issues among adolescents. In the current study, the Indonesian translations of all three questionnaires examining knowledge, attitude, and help-seeking behavior were considered to be valid and reliable.

Dataset Information

A review of the reliability and validity of OPCRIT in relation to its use for the routine clinical assessment of mental health patients.

Publications

A review of the reliability and validity of OPCRIT in relation to its use for the routine clinical assessment of mental health patients.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure