Dataset Information

Modeling observations with a detection limit using a truncated normal distribution with censoring.

ABSTRACT:

Background

When data are collected subject to a detection limit, observations below the detection limit may be considered censored. In addition, the domain of such observations may be restricted; for example, values may be required to be non-negative.

Methods

We propose a method for estimating population mean and variance from censored observations that accounts for known domain restriction. The method finds maximum likelihood estimates assuming an underlying truncated normal distribution.

Results

We show that our method, tcensReg, has lower bias, Type I error rates, and mean squared error than other methods commonly used for data with detection limits such as Tobit regression and single imputation under a range of simulation settings from mild to heavy censoring and truncation. We further demonstrate the consistency of the maximum likelihood estimators. We apply our method to analyze vision quality data collected from ophthalmology clinical trials comparing different types of intraocular lenses implanted during cataract surgery. All of the methods yield similar conclusions regarding non-inferiority, but estimates from the tcensReg method suggest that there may be greater mean differences and overall variability.

Conclusions

In the presence of detection limits, our new method tcensReg provides a way to incorporate known domain restrictions in dependent variables that substantially improves inferences.

SUBMITTER: Williams JR

PROVIDER: S-EPMC7322891 | biostudies-literature | 2020 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Modeling observations with a detection limit using a truncated normal distribution with censoring.

Williams Justin R JR Kim Hyung-Woo HW Crespi Catherine M CM

BMC medical research methodology 20200629 1

<h4>Background</h4>When data are collected subject to a detection limit, observations below the detection limit may be considered censored. In addition, the domain of such observations may be restricted; for example, values may be required to be non-negative.<h4>Methods</h4>We propose a method for estimating population mean and variance from censored observations that accounts for known domain restriction. The method finds maximum likelihood estimates assuming an underlying truncated normal dist ...[more]

PMID: 32600261

Similar Datasets

Project description:BackgroundIn geographic surveillance of disease, areas with large numbers of disease cases are to be identified so that investigations of the causes of high disease rates can be pursued. Areas with high rates are called disease clusters and statistical cluster detection tests are used to identify geographic areas with higher disease rates than expected by chance alone. Typically cluster detection tests are applied to incident or prevalent cases of disease, but surveillance of disease-related events, where an individual may have multiple events, may also be of interest. Previously, a compound Poisson approach that detects clusters of events by testing individual areas that may be combined with their neighbours has been proposed. However, the relevant probabilities from the compound Poisson distribution are obtained from a recursion relation that can be cumbersome if the number of events are large or analyses by strata are performed. We propose a simpler approach that uses an approximate normal distribution. This method is very easy to implement and is applicable to situations where the population sizes are large and the population distribution by important strata may differ by area. We demonstrate the approach on pediatric self-inflicted injury presentations to emergency departments and compare the results for probabilities based on the recursion and the normal approach. We also implement a Monte Carlo simulation to study the performance of the proposed approach.ResultsIn a self-inflicted injury data example, the normal approach identifies twelve out of thirteen of the same clusters as the compound Poisson approach, noting that the compound Poisson method detects twelve significant clusters in total. Through simulation studies, the normal approach well approximates the compound Poisson approach for a variety of different population sizes and case and event thresholds.ConclusionA drawback of the compound Poisson approach is that the relevant probabilities must be determined through a recursion relation and such calculations can be computationally intensive if the cluster size is relatively large or if analyses are conducted with strata variables. On the other hand, the normal approach is very flexible, easily implemented, and hence, more appealing for users. Moreover, the concepts may be more easily conveyed to non-statisticians interested in understanding the methodology associated with cluster detection test results.

Project description:BackgroundMeasures of patient satisfaction are increasingly used to measure patient experience. Most satisfaction measures have notable ceiling effects, which limits our ability to learn from variation among relatively satisfied patients. This study tested a variety of single-question satisfaction measures for their mean overall score, ceiling and floor effect, and data distribution. In addition, we assessed the correlation between satisfaction and psychological factors and assessed how the various methods for measuring satisfaction affected net promoter scores (NPSs).MethodologyA total of 212 patients visiting orthopedic offices were enrolled in this randomized controlled trial. Patients were randomized to 1 of 5 newly designed, single-question satisfaction scales: (a) a helpfulness 11-point ordinal scale from 0 to 10, (b) a helpfulness ordinal 11-point scale from 0 to 5 (ie, with 1.5, 2.5, etc), (c) a helpfulness 100-point slider, (d) a satisfaction 11-point ordinal scale from 0 to 10, and (e) a willingness to recommend 11-point ordinal scale from 0 to 10. Additionally, patients completed the 2-item Pain Self-Efficacy Questionnaire (PSEQ-2), 5-item Short Health Anxiety Inventory (SHAI-5) Scale, and Patient-Reported Outcomes Measurement Information System (PROMIS) Depression. We assessed mean and median score, ceiling and floor effect, and skewness and kurtosis for each scale. Spearman's correlation tests were used to test correlations between satisfaction and psychological status. Finally, we assessed the NPS for the various scales.ResultsCeiling effects ranged from 29% to 68%. The 11-point ordinal helpfulness scale from 0 to 10 had the least ceiling effect (29%). All of the scales were asymmetrically distributed, with the 11-point ordinal scale from 0 to 5 having the most Gaussian distribution (skew = 0.64 and kurtosis = 2.3). Satisfaction scores did not correlate with psychological factors: PSEQ-2 (r = 0.04; P = .57), SHAI-5 (r = 0.01; P = .93), and PROMIS Depression (r = -0.04; P = .61). Net promoter scores varied substantially by scale design, with higher scores corresponding with greater ceiling effects.ConclusionsVariations in scale types, text anchors, and lead-in statements do not eliminate the ceiling effect of single-question measures of satisfaction with a visit to an orthopedic specialist. Further studies might test other scale designs and labels.Level of evidenceDiagnostic; Level II.

Project description:BACKGROUND:Volatile organic compounds (VOC), which include many hazardous chemicals, have been used extensively in personal, commercial and industrial products. Due to the variation in source emissions, differences in the settings and environmental conditions where exposures occur, and measurement issues, distributions of VOC concentrations can have multiple modes, heavy tails, and significant portions of data below the method detection limit (MDL). These issues challenge standard parametric distribution models needed to estimate the exposures, even after log-transformation of the data. METHODS:This paper considers mixture of distributions that can be directly applied to concentration and exposure data. Two types of mixture distributions are considered: the traditional finite mixture of normal distributions, and a semi-parametric Dirichlet process mixture (DPM) of normal distributions. Both methods are implemented for a sample data set obtained from the Relationship between Indoor, Outdoor and Personal Air (RIOPA) study. Performance is assessed based on goodness-of-fit criteria that compare the closeness of the density estimates with the empirical density based on data. The goodness-of-fit for the proposed density estimation methods are evaluated by a comprehensive simulation study. RESULTS:The finite mixture of normals and DPM of normals have superior performance when compared to the single normal distribution fitted to log-transformed exposure data. The advantages of using these mixture distributions are more pronounced when exposure data have heavy tails or a large fraction of data below the MDL. Distributions from the DPM provided slightly better fits than the finite mixture of normals. Additionally, the DPM method avoids certain convergence issues associated with the finite mixture of normals, and adaptively selects the number of components. CONCLUSIONS:Compared to the finite mixture of normals, DPM of normals has advantages by characterizing uncertainty around the number of components, and by providing a formal assessment of uncertainty for all model parameters through the posterior distribution. The method adapts to a spectrum of departures from standard model assumptions and provides robust estimates of the exposure density even under censoring due to MDL.

Dataset Information

Modeling observations with a detection limit using a truncated normal distribution with censoring.

Background

Methods

Results

Conclusions

Publications

Modeling observations with a detection limit using a truncated normal distribution with censoring.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets