Dataset Information

Addressing Participant Validity in a Small Internet Health Survey (The Restore Study): Protocol and Recommendations for Survey Response Validation.

ABSTRACT: BACKGROUND:While deduplication and cross-validation protocols have been recommended for large Web-based studies, protocols for survey response validation of smaller studies have not been published. OBJECTIVE:This paper reports the challenges of survey validation inherent in a small Web-based health survey research. METHODS:The subject population was North American, gay and bisexual, prostate cancer survivors, who represent an under-researched, hidden, difficult-to-recruit, minority-within-a-minority population. In 2015-2016, advertising on a large Web-based cancer survivor support network, using email and social media, yielded 478 completed surveys. RESULTS:Our manual deduplication and cross-validation protocol identified 289 survey submissions (289/478, 60.4%) as likely spam, most stemming from advertising on social media. The basic components of this deduplication and validation protocol are detailed. An unexpected challenge encountered was invalid survey responses evolving across the study period. This necessitated the static detection protocol be augmented with a dynamic one. CONCLUSIONS:Five recommendations for validation of Web-based samples, especially with smaller difficult-to-recruit populations, are detailed.

SUBMITTER: Dewitt J

PROVIDER: S-EPMC5941092 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND: Clinical practice guidelines (CPGs) become quickly outdated and require a periodic reassessment of evidence research to maintain their validity. However, there is little research about this topic. Our project will provide evidence for some of the most pressing questions in this field: 1) what is the average time for recommendations to become out of date?; 2) what is the comparative performance of two restricted search strategies to evaluate the need to update recommendations?; and 3) what is the feasibility of a more regular monitoring and updating strategy compared to usual practice?. In this protocol we will focus on questions one and two. METHODS: The CPG Development Programme of the Spanish Ministry of Health developed 14 CPGs between 2008 and 2009. We will stratify guidelines by topic and by publication year, and include one CPG by strata.We will develop a strategy to assess the validity of CPG recommendations, which includes a baseline survey of clinical experts, an update of the original exhaustive literature searches, the identification of key references (reference that trigger a potential recommendation update), and the assessment of the potential changes in each recommendation.We will run two alternative search strategies to efficiently identify important new evidence: 1) PLUS search based in McMaster Premium LiteratUre Service (PLUS) database; and 2) a Restrictive Search (ReSe) based on the least number of MeSH terms and free text words needed to locate all the references of each original recommendation.We will perform a survival analysis of recommendations using the Kaplan-Meier method and we will use the log-rank test to analyse differences between survival curves according to the topic, the purpose, the strength of recommendations and the turnover. We will retrieve key references from the exhaustive search and evaluate their presence in the PLUS and ReSe search results. DISCUSSION: Our project, using a highly structured and transparent methodology, will provide guidance of when recommendations are likely to be at risk of being out of date. We will also assess two novel restrictive search strategies which could reduce the workload without compromising rigour when CPGs developers check for the need of updating.

Project description:BackgroundQuestionnaires used in longitudinal studies may have questions added or removed over time for numerous reasons. Data missing completely at a follow-up survey is a unique issue for longitudinal studies. While such excluded questions lack information at one follow-up survey, they are collected at other follow-up surveys, and covariances observed at other follow-up surveys may allow for the recovery of the missing data. This study utilized data from a large longitudinal cohort study to assess the efficiency and feasibility of using multiple imputation (MI) to recover this type of information.MethodsMillennium Cohort Study participants completed the 9-item Patient Health Questionnaire (PHQ) depression module at 2 time points (2004, 2007). The suicidal ideation item in the module was set to missing for the 2007 assessment. Several single-level MI models using different sets of predictors and forms of suicidal ideation were used to compare self-reported values and imputed values for this item in 2007. Additionally, associations with sleep duration and smoking status, which are related constructs, were compared between self-reported and imputed values of suicidal ideation.ResultsAmong 63,028 participants eligible for imputation analysis, 4.05% reported suicidal ideation on the 2007 survey. The imputation models successfully identified suicidal ideation, with a sensitivity ranging between 34 and 66% and a positive predictive value between 36 and 42%. Specificity remained above 96% and negative predictive value above 97% for all imputed models. Similar associations were found for all imputation models on related constructs, though the dichotomous suicidal ideation imputed from the model using only PHQ depression items yielded estimates that were closest with the self-reported associations for all adjusted analyses.ConclusionsAlthough sensitivity and positive predictive value were relatively low, applying MI techniques allowed for inclusion of an otherwise missing variable. Additionally, correlations with related constructs were estimated near self-reported values. Therefore, the other 8 depression items can be used to estimate suicidal ideation that was completely missing from a survey using MI. However, these imputed values should not be used to estimate population prevalence.

Project description:ObjectiveTo systematically summarise acupuncture-related Clinical Practice Guidelines (CPGs)'s clinical and methodological characteristics and critically appraise their methodology quality.DesignWe summarised the characteristics of the guidelines and recommendations and evaluated their methodological quality using the Appraisal of Guidelines Research and Evaluation II (AGREE II) instrument.Data sourcesNine databases were searched from 1 January 2010 to 20 September 2020.Eligibility criteria for selecting studiesWe included the latest version of acupuncture CPGs, which must have used at least one systematic review addressing the benefits and harms of alternative care options to inform acupuncture recommendations.Data extraction and synthesisReviewers, working in pairs, independently screened and extracted data. When there are statistical differences among types of CPGs, we reported the data by type in the text, but when not, we reported the overall data.ResultsOf the 133 eligible guidelines, musculoskeletal and connective tissue diseases proved the most commonly addressed therapeutic areas. According to the AGREE II instrument, the CPG was moderate quality in the domain of clarity of scope and purpose, clarity of presentation, the rigour of development, stakeholder involvement and low quality in editorial independence, and applicability. The study identified 433 acupuncture-related recommendations; 380 recommended the use of acupuncture, 28 recommended against the use of acupuncture and 25 considered acupuncture but did not make recommendations. Of the 303 recommendations that used Grading of Recommendations Assessment, Development and Evaluation to determine the strength of recommendations, 152 were weak recommendations, 131 were strong recommendations, of which 104 were supported by low or very low certainty evidence (discordant recommendations).ConclusionIn the past 10 years, a large number of CPGs addressing acupuncture interventions exist. Although these guidelines may be as or more rigorous than many others, considerable room for improvement remains.

Dataset Information

Addressing Participant Validity in a Small Internet Health Survey (The Restore Study): Protocol and Recommendations for Survey Response Validation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets