The inter-observer agreement of examining pre-school children with acute cough: a nested study.
Ontology highlight
ABSTRACT:
SUBMITTER: Hay AD
PROVIDER: S-EPMC387826 | biostudies-other | 2004 Mar
REPOSITORIES: biostudies-other
Publications
The inter-observer agreement of examining pre-school children with acute cough: a nested study.
Hay Alastair D AD Wilson Andrew A Fahey Tom T Peters Tim J TJ
BMC family practice 20040311
<h4>Background</h4>The presence of clinical signs have implications for diagnosis, prognosis and treatment. Therefore, the aim of this study was to examine the inter-observer agreement of clinical signs in pre-school children presenting to primary care.<h4>Methods</h4>A nested study comparing two clinical assessments within a prospective cohort of 256 pre-school children with acute cough recruited from eight general practices in Leicestershire, UK. We examined agreement (using kappa statistics) ...[more]
Similar Datasets
Project description:BackgroundRecent developments in diagnostic techniques for malaria, particularly DNA probes and sero-immunology, have raised questions as to how these techniques might be used to facilitate malaria diagnosis at the most peripheral levels of the primary health care system. At present, malaria diagnosis is based on the standard microscopic examination of blood films in most field epidemiologic studies and is likely to remain so in the immediate future in Africa. The objective of this study was to assess inter-observer agreement for the examination of Giemsa-stained slides for Plasmodium falciparum parasites.MethodsChildren aged 0 to 10 years were enrolled yearly in Bancoumana village (West Africa), mainly during the transmission season (June to October). The blood smears obtained from the persistently negative children in June 1996, August 1996, October 1996 and March 1997 were systematically re-examined. A stratified random sample (10%) proportional to the following parasite density classes 1-100, 101-5000, and 5001 and over was taken from the slides collected. The kappa statistics and the intra-class correlation were used as measures of agreement the first and the second slide examinations.ResultsThe weighted kappa statistic, widely used as a chance-corrected measure for nominal agreement, showed excellent inter-observer agreement (κ(w)=0.7926; 95% CI [0.7588, 0.8263]; p=0.01). The intra-class correlation co-efficient had the same value of 0.7926 confirming the appropriateness of the weighted kappa statistic. Inter-observer agreement for slides read as negative by one observer, or as containing more than 100 parasites per μl, was excellent: 97% (493/506) and 92% (145/158), respectively. In contrast, the inter-observer agreement for slides read by one observer as containing 1-100 parasites/μl was poor, 36% (96/268).ConclusionsIn field conditions in Mali, there was a high reproducibility for slides reported as negative or as having more than 100 parasites per μl. However, smears with readings of 1-100 parasites per μl were less reproducible and should be re-examined carefully.
| S-EPMC3849530 | biostudies-literature
Project description:BackgroundThere is uncertainty about which children with cough are most and least likely to experience complications.AimTo derive a clinical prediction rule for complications in pre-school children presenting to primary care with acute cough.Design of studyProspective cohort study.SettingEight general practices in Leicestershire, United Kingdom.MethodPre-school children with cough for < or =28 days and without asthma were recruited. Sociodemographic, clinical history, and examination data were collected and univariable logistic regression used to explore the associations with complications. These were defined as any new symptom, sign or diagnosis identified by a primary care clinician at a parent initiated reconsultation, or hospital admission, before cough resolution. Those factors with stronger relationships (P< 0.2) were then modelled using multivariable logistic regression to identify the factors independently associated with complications.ResultsThe pre-test probability of complications was 10%. On univariable analysis, fever (odds ratio [OR] = 4.86; 95% confidence interval [CI] = 1.74 to 13.6), chest signs (OR = 2.72; CI = 1.06 to 6.96), and tachypnoea (OR = 3.80; CI = 1.22 to 11.8) were associated with complications. On multivariable analysis, only fever (OR = 5.56; CI = 1.75 to 17.6) and chest signs (OR = 2.88; CI = 1.02 to 8.05) were independently associated with complications. These ORs translate into post-test probabilities of complications of 6% for children with neither fever nor chest signs, 18% for children with chest signs, 28% for children with fever, and 40% for children with fever and chest signs.ConclusionsIf validated, this clinical prediction rule could be used to individualise the management of acute cough in pre-school children.
| S-EPMC1314771 | biostudies-literature
Project description:Health and socioeconomic disparities tend to be experienced along racial and ethnic lines, but investigators are not sure how individuals are assigned to groups, or how consistent this process is. To address these issues, 1,919 orthodontic patient records were examined by at least two observers who estimated each individual's race and the characteristics that influenced each estimate. Agreement regarding race is high for African and European Americans, but not as high for Asian, Hispanic, and Native Americans. The indicator observers most often agreed upon as important in estimating group membership is name, especially for Asian and Hispanic Americans. The observers, who were almost all European American, most often agreed that skin color is an important indicator of race only when they also agreed the subject was European American. This suggests that in a diverse community, light skin color is associated with a particular group, while a range of darker shades can be associated with members of any other group. This research supports comparable studies showing that race estimations in medical records are likely reliable for African and European Americans, but are less so for other groups. Further, these results show that skin color is not consistently the primary indicator of an individual's race, but that other characteristics such as facial features add significant information.
| S-EPMC3163683 | biostudies-literature
Project description:Invasive lobular breast carcinoma (ILC) is the second most common breast carcinoma (BC) subtype and is mainly driven by loss of E-cadherin expression. Correct classification of BC as ILC is important for patient treatment. This study assessed the degree of agreement among pathologists for the diagnosis of ILC. Two sets of hormone receptor (HR)-positive/HER2-negative BCs were independently reviewed by participating pathologists. In set A (61 cases), participants were provided with hematoxylin/eosin (HE)-stained sections. In set B (62 cases), participants were provided with HE-stained sections and E-cadherin immunohistochemistry (IHC). Tumor characteristics were balanced. Participants classified specimens as non-lobular BC versus mixed BC versus ILC. Pairwise inter-observer agreement and agreement with a pre-defined reference diagnosis were determined with Cohen's kappa statistics. Subtype calls were correlated with molecular features, including CDH1/E-cadherin mutation status. Thirty-five pathologists completed both sets, providing 4,305 subtype calls. Pairwise inter-observer agreement was moderate in set A (median κ = 0.58, interquartile range [IQR]: 0.48-0.66) and substantial in set B (median κ = 0.75, IQR: 0.56-0.86, p < 0.001). Agreement with the reference diagnosis was substantial in set A (median κ = 0.67, IQR: 0.57-0.75) and almost perfect in set B (median κ = 0.86, IQR: 0.73-0.93, p < 0.001). The median frequency of CDH1/E-cadherin mutations in specimens classified as ILC was 65% in set A (IQR: 56-72%) and 73% in set B (IQR: 65-75%, p < 0.001). Cases with variable subtype calls included E-cadherin-positive ILCs harboring CDH1 missense mutations, and E-cadherin-negative ILCs with tubular elements and focal P-cadherin expression. ILCs with trabecular growth pattern were often misclassified as non-lobular BC in set A but not in set B. In conclusion, subtyping of BC as ILC achieves almost perfect agreement with a pre-defined reference standard, if assessment is supported by E-cadherin IHC. CDH1 missense mutations associated with preserved E-cadherin protein expression, E- to P-cadherin switching in ILC with tubular elements, and trabecular ILC were identified as potential sources of discordant classification.
| S-EPMC8822373 | biostudies-literature
Project description:BackgroundAccurate determination of cardiopulmonary exercise test (CPET) derived parameters is essential to allow for uniform preoperative risk assessment. The objective of this prospective observational study was to evaluate the inter-observer agreement of preoperative CPET-derived variables by comparing a self-preferred approach with a systematic guideline-based approach.MethodsTwenty-six professionals from multiple centers across the Netherlands interpreted 12 preoperative CPETs of patients scheduled for hepatopancreatobiliary surgery. Outcome parameters of interest were oxygen uptake at the ventilatory anaerobic threshold (V̇O2VAT) and at peak exercise (V̇O2peak), the slope of the relationship between the minute ventilation and carbon dioxide production (V̇E/V̇CO2-slope), and the oxygen uptake efficiency slope (OUES). Inter-observer agreement of the self-preferred approach and the guideline-based approach was quantified by means of the intra-class correlation coefficient.ResultsAcross the complete cohort, inter-observer agreement intraclass correlation coefficient (ICC) was 0.76 (95% confidence interval (CI) 0.57-0.93) for V̇O2VAT, 0.98 (95% CI 0.95-0.99) for V̇O2peak, and 0.86 (95% CI 0.75-0.95) for the V̇E/V̇CO2-slope when using the self-preferred approach. By using a systematic guideline-based approach, ICCs were 0.88 (95% CI 0.74-0.97) for V̇O2VAT, 0.99 (95% CI 0.99-1.00) for V̇O2peak, 0.97 (95% CI 0.94-0.99) for the V̇E/V̇CO2-slope, and 0.98 (95% CI 0.96-0.99) for the OUES.ConclusionsInter-observer agreement of numerical values of CPET-derived parameters can be improved by using a systematic guideline-based approach. Effort-independent variables such as the V̇E/V̇CO2-slope and the OUES might be useful to further improve uniformity in preoperative risk assessment in addition to, or in case V̇O2VAT and V̇O2peak are not determinable.
| S-EPMC9055752 | biostudies-literature
Project description:BackgroundColon capsule endoscopy is a promising technique for evaluation of the colon, but its reproducibility is still unknown.ObjectiveThis study assesses intra and inter-observer agreement in evaluations of colon capsule endoscopy videos.MethodsForty-two complete colon capsule endoscopy investigations were analysed by three experts and two beginners. Intra-observer agreement was assessed in paired readings of two experts and two beginners. Agreement was determined by the intraclass correlation coefficient: poor (<0.5), moderate (0.5-0.75), good (0.75-0.9) and excellent (>0.9).ResultsAgreement on 'indication for a following colonoscopy' based on the number and size of detected polyps and bowel cleansing quality was poor among all observers. Agreement among experts on the detection of large polyps and number of polyps was moderate, but agreement on bowel cleansing quality was poor. Beginners were in moderate agreement with the experts on polyp detection. Intra-observer agreement in experts was moderate to excellent for the detection of large polyps (≥10 mm), excellent for the number of polyps, and poor to moderate for bowel cleansing quality. Intra-observer agreement in beginners was poor to moderate for all variables.ConclusionsThis study shows a poor agreement on 'indication for a following colonoscopy', but a high intra and inter-observer agreement for polyp detection among experts, as well as a moderate agreement between beginners and experts.Trial registration: NCT02303756.
| S-EPMC6297930 | biostudies-literature
Project description:Ulcerative colitis (UC) endoscopic scores translate mucosal damage into values standardizing image analysis. Due to potential limits of current endoscopic activity indexes, we have elaborated on a new score, the "Extended Mayo Endoscopic Score (EMES)," and evaluated its inter-observer agreement in a multicenter endoscopy team, comparing concordance with the Mayo subscore. Sixteen UC consecutive patients underwent follow-up colonoscopy. Recorded videos were anonymously loaded on a web platform. Thirteen expert endoscopists evaluated UC activity using both Mayo and EMES. EMES was described in every colon segment: erythema (0: absent, 1: mild, 2: moderate, 3: severe), vascular pattern (0: normal, 1: reduction, 2: disappearance), erosions and ulcers (0: absent, 1: from 1 to 5, 2: 6 to 10, 3: >10). Weighted Fleiss' kappa with 95% confidence interval (CI) and p-value defined inter-rater agreement. Global inter-observer agreement of EMES was moderate (kappa = 0.56, 95% CI = 0.46-0.67, p < 0.001). The evaluation of each colonic segment showed moderate agreement for all segments: ascending (kappa = 0.46, 95% CI = 0.32-0.60, p < 0.001), transverse (kappa = 0.48, 95% CI = 0.29-0.67, p < 0.001); descending (kappa = 0.49, 95% CI = 0.35-0.64, p < 0.001), sigmoid (kappa = 0.52, 95% CI = 0.39-0.65, p < 0.001) and rectum (kappa = 0.55, 95% CI = 0.42-0.69, p < 0.001). Mayo subscore agreement was similar to global EMES (kappa = 0.53, 95% CI = 0.39-0.66, p = 0.001). Therefore, our report emphasizes the importance of assessing inter-observer agreement for EMES, but also for other known scoring systems, including the Mayo subscore.
| S-EPMC7236596 | biostudies-literature
Project description:Sanitary risk inspection, an observation protocol for identifying contamination hazards around water sources, is promoted for managing rural water supply safety. However, it is unclear how far different observers consistently identify contamination hazards and consistently classify water source types using standard typologies. This study aimed to quantify inter-observer agreement in hazard identification and classification of rural water sources. Six observers separately visited 146 domestic water sources in Siaya County, Kenya, in wet and dry seasons. Each observer independently classified the source type and conducted a sanitary risk inspection using a standard protocol. Water source types assigned by an experienced observer were cross-tabulated against those of his colleagues, as were contamination hazards identified, and inter-observer agreement measures calculated. Agreement between hazards observed by the most experienced observer versus his colleagues was significant but low (intra-class correlation = 0.49), with inexperienced observers detecting fewer hazards. Inter-observer agreement in classifying water sources was strong (Cohen's kappa = 0.84). However, some source types were frequently misclassified, such as sources adapted to cope with water insecurity (e.g. tanks drawing on both piped and rainwater). Observers with limited training and experience thus struggle to consistently identify hazards using existing protocols, suggesting observation protocols require revision and their implementation should be supported by comprehensive training. Findings also indicate that field survey teams struggle to differentiate some water source types based on a standard water source classification, particularly sources adapted to cope with water insecurity. These findings demonstrate uncertainties underpinning international monitoring and analyses of safe water access via household surveys.
| S-EPMC7661424 | biostudies-literature
Project description:BACKGROUND: The assessment of Generalised Joint Hypermobility (GJH) is usually based on the Beighton tests, which consist of a series of nine tests. Possible methodological shortcomings can arise, as the tests do not include detailed descriptions of performance, interpretation nor classification of GJH. The purpose of this study was, among children aged 7-8 and 10-12 years, to evaluate: 1) the inter-tester reproducibility of the tests and criteria for classification of GJH for 2 variations of the Beighton test battery (Methods A and B) with a variation in starting positions and benchmarks between methods, and 2) the inter-method agreement for the two batteries. METHODS: A standardised three-phase protocol for clinical reproducibility studies was followed including a training phase, an overall agreement phase and a study phase. The number of participants in the three phases was 10, 70 and 39 respectively. For the inter-method study a total of 103 children participated. Two testers judged each test battery. A score of ? 5 was set as the cut-off level for GJH. Cohen's kappa statistics and McNemar's test were used to test for agreement and significant differences. RESULTS: Kappa values for GJH (? 5) were 0.64 (Method A, prevalence 0.42) and 0.59 (Method B, prevalence 0.46), with no difference between testers in Method A (p = 0.45) and B (p = 0.29). Prevalence of GJH in the inter-method study was 31% (A) and 35% (B) with no difference between methods (p = 0.54). CONCLUSIONS: Inter-tester reproducibility of Methods A and B was moderate to substantial, when following a standardised study protocol. Both test batteries can be used in the same children population, as there was no difference in prevalence of GJH at cut point 5, when applying method A and B. However, both methods need to be tested for their predictive validity at higher cut-off levels, e.g. ? 6 and ? 7.
| S-EPMC3878084 | biostudies-other
Project description:BackgroundIntestinal ultrasound [IUS] is a promising and non-invasive cross-sectional imaging modality in the diagnosis and monitoring of ulcerative colitis [UC]. Unlike endoscopy, where standardized scoring for evaluation of disease activity is widely used, scoring for UC with IUS is currently unavailable. Therefore, we conducted a study to assess the reliability of IUS in UC among expert sonographists in order to identify robust parameters.MethodsThirty patients with both clinically active [25] and quiescent [five] UC were included. Six expert sonographers first agreed upon key IUS parameters and grading, including bowel wall thickness [BWT], colour Doppler signal [CDS], inflammatory fat [i-fat], loss of bowel wall stratification [BWS], loss of haustrations and presence of lymph nodes. Thirty video-recorded cases were blindly reviewed.ResultsInter-observer agreement was almost perfect for BWT (intra-class correlation coefficient [ICC]: 0.96) and substantial for CDS [κ = 0.63]. Agreement was moderate for presence of lymph nodes [κ = 0.41] and fair for presence of i-fat [κ = 0.36], BWS [κ = 0.24] and loss of haustrations [κ = 0.26]. Furthermore, there was substantial agreement for presence of disease activity on IUS [κ = 0.77] and almost perfect agreement for disease severity [ICC: 0.93]. Most individual parameters showed a strong association with IUS disease activity as measured by the six readers.ConclusionIUS is a reliable imaging modality to assess disease activity and severity in UC. Important individual parameters such as BWT and CDS are reliable and could be incorporated in a future UC scoring index. Standardized acquisition and assessment of UC utilizing IUS with established reliability is important to expand the use of IUS globally.
| S-EPMC8328294 | biostudies-literature