Unknown

Dataset Information

0

Comparative Study of Confidence Intervals for Proportions in Complex Sample Surveys.


ABSTRACT: The most widespread method of computing confidence intervals (CIs) in complex surveys is to add and subtract the margin of error (MOE) from the point estimate, where the MOE is the estimated standard error multiplied by the suitable Gaussian quantile. This Wald-type interval is used by the American Community Survey (ACS), the largest US household sample survey. For inferences on small proportions with moderate sample sizes, this method often results in marked under-coverage and lower CI endpoint less than 0. We assess via simulation the coverage and width, in complex sample surveys, of seven alternatives to the Wald interval for a binomial proportion with sample size replaced by the 'effective sample size,' that is, the sample size divided by the design effect. Building on previous work by the present authors, our simulations address the impact of clustering, stratification, different stratum sampling fractions, and stratum-specific proportions. We show that all intervals undercover when there is clustering and design effects are computed from a simple design-based estimator of sampling variance. Coverage can be better calibrated for the alternatives to Wald by improving estimation of the effective sample size through superpopulation modeling. This approach is more effective in our simulations than previously proposed modifications of effective sample size. We recommend intervals of the Wilson or Bayes uniform prior form, with the Jeffreys prior interval not far behind.

SUBMITTER: Franco C 

PROVIDER: S-EPMC6690503 | biostudies-literature | 2019 Sep

REPOSITORIES: biostudies-literature

altmetric image

Publications

Comparative Study of Confidence Intervals for Proportions in Complex Sample Surveys.

Franco Carolina C   Little Roderick J A RJA   Louis Thomas A TA   Slud Eric V EV  

Journal of survey statistics and methodology 20190107 3


The most widespread method of computing confidence intervals (CIs) in complex surveys is to add and subtract the margin of error (MOE) from the point estimate, where the MOE is the estimated standard error multiplied by the suitable Gaussian quantile. This Wald-type interval is used by the American Community Survey (ACS), the largest US household sample survey. For inferences on small proportions with moderate sample sizes, this method often results in marked under-coverage and lower CI endpoint  ...[more]

Similar Datasets

| S-EPMC10646701 | biostudies-literature
| S-EPMC9447366 | biostudies-literature
| S-EPMC4899279 | biostudies-literature
| S-EPMC4742505 | biostudies-literature
2008-03-04 | GSE10697 | GEO
| S-EPMC2241843 | biostudies-other
| S-EPMC7958418 | biostudies-literature
| S-EPMC6027739 | biostudies-literature
| S-EPMC9355556 | biostudies-literature
| S-EPMC3161748 | biostudies-other