Dataset Information

Field validation of secondary data sources: a novel measure of representativity applied to a Canadian food outlet database.

ABSTRACT:

Background

Validation studies of secondary datasets used to characterize neighborhood food businesses generally evaluate how accurately the database represents the true situation on the ground. Depending on the research objectives, the characterization of the business environment may tolerate some inaccuracies (e.g. minor imprecisions in location or errors in business names). Furthermore, if the number of false negatives (FNs) and false positives (FPs) is balanced within a given area, one could argue that the database still provides a "fair" representation of existing resources in this area. Yet, traditional validation measures do not relax matching criteria, and treat FNs and FPs independently. Through the field validation of food businesses found in a Canadian database, this paper proposes alternative criteria for validity.

Methods

Field validation of the 2010 Enhanced Points of Interest (EPOI) database (DMTI Spatial®) was performed in 2011 in 12 census tracts (CTs) in Montreal, Canada. Some 410 food outlets were extracted from the database and 484 were observed in the field. First, traditional measures of sensitivity and positive predictive value (PPV) accounting for every single mismatch between the field and the database were computed. Second, relaxed measures of sensitivity and PPV that tolerate mismatches in business names or slight imprecisions in location were assessed. A novel measure of representativity that further allows for compensation between FNs and FPs within the same business category and area was proposed. Representativity was computed at CT level as ((TPs +|FPs-FNs|)/(TPs+FNs)), with TPs meaning true positives, and |FPs-FNs| being the absolute value of the difference between the number of FNs and the number of FPs within each outlet category.

Results

The EPOI database had a "moderate" capacity to detect an outlet present in the field (sensitivity: 54.5%) or to list only the outlets that actually existed in the field (PPV: 64.4%). Relaxed measures of sensitivity and PPV were respectively 65.5% and 77.3%. The representativity of the EPOI database was 77.7%.

Conclusions

The novel measure of representativity might serve as an alternative to traditional validity measures, and could be more appropriate in certain situations, depending on the nature and scale of the research question.

SUBMITTER: Clary CM

PROVIDER: S-EPMC3710283 | biostudies-literature | 2013 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Field validation of secondary data sources: a novel measure of representativity applied to a Canadian food outlet database.

Clary Christelle M CM Kestens Yan Y

The international journal of behavioral nutrition and physical activity 20130619

<h4>Background</h4>Validation studies of secondary datasets used to characterize neighborhood food businesses generally evaluate how accurately the database represents the true situation on the ground. Depending on the research objectives, the characterization of the business environment may tolerate some inaccuracies (e.g. minor imprecisions in location or errors in business names). Furthermore, if the number of false negatives (FNs) and false positives (FPs) is balanced within a given area, on ...[more]

PMID: 23782570

Similar Datasets

Project description:BackgroundFood- and activity-related establishments are increasingly viewed as neighbourhood resources that potentially condition health-related behaviour. The primary objective of the current study was to establish, using ground truthing (on-site verification), the validity of measures of availability of food stores and physical activity establishments that were obtained from commercial database and Internet searches. A secondary objective was to examine differences in validity results according to neighbourhood characteristics and commercial establishment categories.MethodsLists of food stores and physical activity-related establishments in 12 census tracts within the Montreal metropolitan region were compiled using a commercial database (n = 171 establishments) and Internet search engines (n = 123 establishments). Ground truthing through field observations was performed to assess the presence of listed establishments and identify those absent. Percentage agreement, sensitivity (proportion of establishments found in the field that were listed), and positive predictive value (proportion of listed establishments found in the field) were calculated and contrasted according to data sources, census tracts characteristics, and establishment categories.ResultsAgreement with field observations was good (0.73) for the commercial list, and moderate (0.60) for the Internet-based list. The commercial list was superior to the Internet-based list for correctly listing establishments present in the field (sensitivity), but slightly inferior in terms of the likelihood that a listed establishment was present in the field (positive predictive value). Agreement was higher for food stores than for activity-related establishments.ConclusionCommercial data sources may provide a valid alternative to field observations and could prove a valuable tool in the evaluation of commercial environments relevant to eating behaviour. In contrast, this study did not find strong evidence in support of commercial and Internet data sources to represent neighbourhood opportunities for active lifestyle.

Project description:BackgroundAdministrative data are commonly used to study clinical outcomes in renal disease. Race is an important determinant of renal health delivery and outcomes in Canada but is not validated in most administrative data, and the correlation with census-based definitions of race is unknown.ObjectivesValidation of self-reported race (SRR) in a Canadian provincial renal administrative database (Patient Records and Outcome Management Information System [PROMIS]) and comparison with the Canadian census categories of race.DesignProspective patient survey study to validate SRR in PROMIS.SettingBritish Columbia, Canada.PatientsAdult patients registered in PROMIS.MeasurementsSurvey SRR was used as gold standard to validate SRR in PROMIS. Self-reported race in PROMIS was compared with census race categories.MethodsThis is a cross-sectional telephone survey of a random sample of all adults in PROMIS conducted between February 2016 and November 2016. Responders selected a race category from PROMIS and from the Canadian census. Sensitivity (Sn) and specificity (Sp) were calculated with 95% confidence intervals (CIs).ResultsA total of 21 039 patients met inclusion criteria, 1677 were selected for the survey and 637 participated (38% response rate). There were no differences between the PROMIS, sampled, and responder populations. PROMIS SRR had an accuracy of 95.3% (95% CI: 94.2%-97.0%) when validated against the survey SRR with Sn and Sp ≥90% in all race groups except in Aboriginals (Sn 87.5%). The positive and negative predictive values were ≥95%, except in very low and high-prevalence groups, respectively. The Canadian census had an accuracy of 95.7% (95% CI: 94.4%-97.6%) when validated against PROMIS SRR with Sn and Sp ≥90%. The results did not differ in subgroups based on age, sex, birth outside Canada, or renal group (glomerulonephritis, chronic kidney disease, hemodialysis, peritoneal dialysis, transplant recipients, or live donors).LimitationsAnalysis of minority groups and lower prevalence groups is limited by sample size. Results may not be generalizable to other administrative databases.ConclusionsWe have shown high accuracy of PROMIS SRR that validates its use in the secondary analysis of administrative data for research. There is high correlation between PROMIS and census race categories which allows linkage with other data sources that use census-based definitions of race.

Project description:BackgroundIn light of the publications (2008-2014) linking calcium intake, mainly from supplements, to the elevated risk of cardiovascular events, there is a need to determine if there have been any changes in usual intakes of calcium among Canadians.ObjectiveWe aimed to examine changes in dietary and total usual intake of calcium among Canadians aged ≥1 y over the period 2004-2015.MethodsWe used nutrition data from 2 nationally representative surveys conducted in 2004 and 2015 (CCHS 2004 Cycle 2.2 and CCHS-Nutrition 2015). This study included all the Canadians across 10 provinces, and the analyses were performed across different age/sex groups. We used the National Cancer Institute (NCI) method to estimate the usual intake of calcium and the prevalence of calcium inadequacy. Multiple logistic regression was performed to assess the relation between supplement uses and sociodemographic variables.ResultsFrom 2004 to 2015, the usual intake of calcium from food sources significantly decreased in calcium supplement nonusers (from 872 ± 18.2 mg/d to 754 ± 18.0 mg/d), but not in calcium supplement users. The contribution of calcium from the Milk and alternatives food group significantly decreased by 7.5% and 6.1% in calcium supplement users and nonusers, respectively. The prevalence of calcium supplement use significantly decreased from 2004 to 2015 in the Canadian population, from 27.5% to 22.0%. During this time, the percentage contribution of calcium from supplemental sources significantly decreased among Canadians, especially women. The prevalence of calcium inadequacy increased from 58.0% to 68.0% in supplement nonusers; however, among users of calcium supplements, the prevalence of calcium inadequacy remained at ∼31%.ConclusionsCalcium intake from both food and supplemental sources decreased in the Canadian population over an 11-y period, which must be addressed by policy-makers in their efforts to decrease the high prevalence of calcium inadequacy.

Dataset Information

Field validation of secondary data sources: a novel measure of representativity applied to a Canadian food outlet database.

Background

Methods

Results

Conclusions

Publications

Field validation of secondary data sources: a novel measure of representativity applied to a Canadian food outlet database.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets