Dataset Information

An Efficient Message Evaluation Protocol: Two Empirical Analyses on Positional Effects and Optimal Sample Size.

ABSTRACT: Reliable and valid message evaluation has a central role in effective health communication and message effects research. The authors have employed a message testing protocol to efficiently acquire valid and reliable message evaluation results: (a) use multiple messages, (b) recruit evaluators from the target population, (c) use valid and reliable effectiveness measures, (d) expose an evaluator to multiple messages, and (e) ensure enough evaluations per message. Two secondary analyses of anti-tobacco message evaluation studies provide evidence for reliability and validity regarding points (d) and (e). Seven studies where adult smokers evaluated the effectiveness of various anti-smoking campaign messages were examined. The first analysis shows that the position in which a message appears has little or no impact on its evaluation, supporting the validity of multiple-exposure design. The second analysis suggests having 25 evaluations per message can achieve a fair balance between accuracy and efficiency.

SUBMITTER: Kim M

PROVIDER: S-EPMC6906244 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

An Efficient Message Evaluation Protocol: Two Empirical Analyses on Positional Effects and Optimal Sample Size.

Kim Minji M Cappella Joseph N JN

Journal of health communication 20190921 10

Reliable and valid message evaluation has a central role in effective health communication and message effects research. The authors have employed a message testing protocol to efficiently acquire valid and reliable message evaluation results: (a) use multiple messages, (b) recruit evaluators from the target population, (c) use valid and reliable effectiveness measures, (d) expose an evaluator to multiple messages, and (e) ensure enough evaluations per message. Two secondary analyses of anti-tob ...[more]

PMID: 31543057

Similar Datasets

Project description:BackgroundRecent work using large datasets (>500 records per subject) has demonstrated seemingly high levels of step-to-step variation in peak plantar pressure within human individuals during walking. One intuitive consequence of this variation is that smaller sample sizes (e.g., 10 steps per subject) may be quantitatively and qualitatively inaccurate and fail to capture the variance in plantar pressure of individuals seen in larger data sets. However, this remains quantitatively unexplored reflecting a lack of detailed investigation of intra-subject sample size effects in plantar pressure analysis.MethodsHere we explore the sensitivity of various plantar pressure metrics to intra-subject sample size (number of steps per subject) using a random subsampling analysis. We randomly and incrementally subsample large data sets (>500 steps per subject) to compare variability in three metric types at sample sizes of 5-400 records: (1) overall whole-record mean and maximum pressure; (2) single-pixel values from five locations across the foot; and (3) the sum of pixel-level variability (measured by mean square error, MSE) from the whole plantar surface.ResultsOur results indicate that the central tendency of whole-record mean and maximum pressure within and across subjects show only minor sensitivity to sample size >200 steps. However, <200 steps, and particularly <50 steps, the range of overall mean and maximum pressure values yielded by our subsampling analysis increased considerably resulting in potential qualitative error in analyses of pressure changes with speed within-subjects and in comparisons of relative pressure magnitudes across subjects at a given speed. Our analysis revealed considerable variability in the absolute and relative response of the single pixel centroids of five regions to random subsampling. As the number of steps analysed decreased, the absolute value ranges were highest in the areas of highest pressure (medial forefoot and hallux), while the largest relative changes were seen in areas of lower pressure (the midfoot). Our pixel-level measure of variability by MSE across the whole-foot was highly sensitive to our manipulation of sample size, such that the range in MSE was exponentially larger in smaller subsamples. Random subsampling showed that the range in pixel-level MSE only came within 5% of the overall sample size in subsamples of >400 steps. The range in pixel-level MSE at low subsamples (<50) was 25-75% higher than that of the full datasets of >500 pressure records per subject. Overall, therefore, we demonstrate a high probability that the very small sample sizes (n < 20 records), which are routinely used in human and animal studies, capture a relatively low proportion of variance evident in larger plantar pressure data set, and thus may not accurately reflect the true population mean.

Dataset Information

An Efficient Message Evaluation Protocol: Two Empirical Analyses on Positional Effects and Optimal Sample Size.

Publications

An Efficient Message Evaluation Protocol: Two Empirical Analyses on Positional Effects and Optimal Sample Size.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets