Evaluating Model Fit in Bayesian Confirmatory Factor Analysis With Large Samples: Simulation Study Introducing the BRMSEA.
Ontology highlight
ABSTRACT:
SUBMITTER: Hoofs H
PROVIDER: S-EPMC6041765 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:As a commonly used tool for operationalizing measurement models, confirmatory factor analysis (CFA) requires strong assumptions that can lead to a poor fit of the model to real data. The post hoc modification model approach attempts to improve CFA fit through the use of modification indexes for identifying significant correlated residual error terms. We analyzed a 28-item emotion measure collected for n = 175 participants. The post hoc modification approach indicated that 90 item-pair errors were significantly correlated, which demonstrated the challenge in using a modification index, as the error terms must be individually modified as a sequence. Additionally, the post hoc modification approach cannot guarantee a positive definite covariance matrix for the error terms. We propose a method that enables the entire inverse residual covariance matrix to be modeled as a sparse positive definite matrix that contains only a few off-diagonal elements bounded away from zero. This method circumvents the problem of having to handle correlated residual terms sequentially. By assigning a Lasso prior to the inverse covariance matrix, this Bayesian method achieves model parsimony as well as an identifiable model. Both simulated and real data sets were analyzed to evaluate the validity, robustness, and practical usefulness of the proposed procedure. (PsycINFO Database Record
| S-EPMC5745070 | biostudies-literature
Project description:Emotional competence (EC) reflects individual differences in the identification, comprehension, expression, regulation, and utilization of one's own and others' emotions. EC can be operationalized using the Profile of Emotional Competence (PEC). This scale measures each of the five core emotional competences (identification, comprehension, expression, regulation, and utilization), separately for one's own and others' emotions. However, the higher-order structure of the PEC has not yet been systematically examined. This study aimed to fill this gap using four different samples (French-speaking Belgian, Dutch-speaking Belgian, Spanish, and Japanese). Confirmatory factor analyses and Bayesian structural equation modeling revealed that a structure with two second-order factors (intrapersonal and interpersonal EC) and with residual correlations among the types of competence (identification, comprehension, expression, regulation, and utilization) fitted the data better than alternative models. The findings emphasize the importance of distinguishing between intrapersonal and interpersonal domains in EC, offer a better framework for differentiating among individuals with different EC profiles, and provide exciting perspectives for future research.
| S-EPMC6855477 | biostudies-literature
Project description:Researchers collected multiple measurements on patients with schizophrenia and their relatives, as well as control subjects and their relatives, to study vulnerability factors for schizophrenics and their near relatives. Observations across individuals from the same family are correlated, and also the multiple outcome measures on the same individuals are correlated. Traditional data analyses model outcomes separately and thus do not provide information about the interrelationships among outcomes. We propose a novel Bayesian family factor model (BFFM), which extends the classical confirmatory factor analysis model to explain the correlations among observed variables using a combination of family-member and outcome factors. Traditional methods for fitting confirmatory factor analysis models, such as full-information maximum likelihood (FIML) estimation using quasi-Newton optimization (QNO), can have convergence problems and Heywood cases (lack of convergence) caused by empirical underidentification. In contrast, modern Bayesian Markov chain Monte Carlo handles these inference problems easily. Simulations compare the BFFM to FIML-QNO in settings where the true covariance matrix is identified, close to not identified, and not identified. For these settings, FIML-QNO fails to fit the data in 13%, 57%, and 85% of the cases, respectively, while MCMC provides stable estimates. When both methods successfully fit the data, estimates from the BFFM have smaller variances and comparable mean-squared errors. We illustrate the BFFM by analyzing data on data from schizophrenics and their family members.
| S-EPMC5895511 | biostudies-literature
Project description:Although item response theory (IRT) models such as the bifactor, two-tier, and between-item-dimensionality IRT models have been devised to confirm complex dimensional structures in educational and psychological data, they can be challenging to use in practice. The reason is that these models are multidimensional IRT (MIRT) models and thus are highly parameterized, making them only suitable for data provided by large samples. Unfortunately, many educational and psychological studies are conducted on a small scale, leaving the researchers without the necessary MIRT models to confirm the hypothesized structures in their data. To address the lack of modeling options for these researchers, we present a general Bayesian MIRT model based on adaptive informative priors. Simulations demonstrated that our MIRT model could be used to confirm a two-tier structure (with two general and six specific dimensions), a bifactor structure (with one general and six specific dimensions), and a between-item six-dimensional structure in rating scale data representing sample sizes as small as 100. Although our goal was to provide a general MIRT model suitable for smaller samples, the simulations further revealed that our model was applicable to larger samples. We also analyzed real data from 121 individuals to illustrate that the findings of our simulations are relevant to real situations.
| S-EPMC7307486 | biostudies-literature
Project description:With the advent of high-throughput phenotyping platforms, plant breeders have a means to assess many traits for large breeding populations. However, understanding the genetic interdependencies among high-dimensional traits in a statistically robust manner remains a major challenge. Since multiple phenotypes likely share mutual relationships, elucidating the interdependencies among economically important traits can better inform breeding decisions and accelerate the genetic improvement of plants. The objective of this study was to leverage confirmatory factor analysis and graphical modeling to elucidate the genetic interdependencies among a diverse agronomic traits in rice. We used a Bayesian network to depict conditional dependencies among phenotypes, which can not be obtained by standard multi-trait analysis. We utilized Bayesian confirmatory factor analysis which hypothesized that 48 observed phenotypes resulted from six latent variables including grain morphology, morphology, flowering time, physiology, yield, and morphological salt response. This was followed by studying the genetics of each latent variable, which is also known as factor, using single nucleotide polymorphisms. Bayesian network structures involving the genomic component of six latent variables were established by fitting four algorithms (i.e., Hill Climbing, Tabu, Max-Min Hill Climbing, and General 2-Phase Restricted Maximization algorithms). Physiological components influenced the flowering time and grain morphology, and morphology and grain morphology influenced yield. In summary, we show the Bayesian network coupled with factor analysis can provide an effective approach to understand the interdependence patterns among phenotypes and to predict the potential influence of external interventions or selection related to target traits in the interrelated complex traits systems.
| S-EPMC6553530 | biostudies-other
Project description:PurposeThis study aims to assess the fit of a number of exploratory and confirmatory factor analysis models to the 2010 Medical Council of Canada Qualifying Examination Part I (MCCQE1) clinical decision-making (CDM) cases. The outcomes of this study have important implications for a range of domains, including scoring and test development.MethodsThe examinees included all first-time Canadian medical graduates and international medical graduates who took the MCCQE1 in spring or fall 2010. The fit of one- to five-factor exploratory models was assessed for the item response matrix of the 2010 CDM cases. Five confirmatory factor analytic models were also examined with the same CDM response matrix. The structural equation modeling software program Mplus was used for all analyses.ResultsOut of the five exploratory factor analytic models that were evaluated, a three-factor model provided the best fit. Factor 1 loaded on three medicine cases, two obstetrics and gynecology cases, and two orthopedic surgery cases. Factor 2 corresponded to pediatrics, and the third factor loaded on psychiatry cases. Among the five confirmatory factor analysis models examined in this study, three- and four-factor lifespan period models and the five-factor discipline models provided the best fit.ConclusionThe results suggest that knowledge of broad disciplinary domains best account for performance on CDM cases. In test development, particular effort should be placed on developing CDM cases according to broad discipline and patient age domains; CDM testlets should be assembled largely using the criteria of discipline and age.
| S-EPMC4536366 | biostudies-literature
Project description:To evaluate the validity and reliability of an innovative training model for endocrine surgical procedures. A simulator training model for endocrine procedures (SimLife) was developed at an academic center. The model consisted of a realistic operating environment with a coherent simulated patient dynamized by pulsatile vascularization with simulated blood warmed to 37 °C, and ventilation. Training sessions were designed for adrenal and thyroid surgery, as well as neck dissection. The primary outcome of interest was to evaluate learners' performance and satisfaction. Learners' performance was evaluated based on a scoring scale that followed the Downing method for the assessment of competency. While learners' satisfaction was evaluated using a Likert scale of 1 to 10 on four items (ease of learning, anatomic correspondence of landmarks, realism, and overall satisfaction). Participants were engaged in 32 training sessions. These included 24 adrenalectomies (conventional and laparoscopic both transabdominal and posterior), and 4 thyroid lobectomies with concomitant functional lateral compartment neck dissection. competency scores were procedure-specific addressing specific core components of a given procedure. Learners' performance scored above average in all procedures evaluated. Satisfaction scores for the specified four items ranged between 8.43 (SD 0.87) and 8.89 (SD 0.96). No major events were reported for the adrenalectomies, while only one jugular vein injury occurred during neck dissection. SimLife is a hyper-realistic training model that allows for satisfactory acquisition of skills and the evaluation of performance progression. It has the potential to become a cornerstone in specialized surgical training.
| S-EPMC7464064 | biostudies-literature
Project description:Limited-information fit measures appear to be promising in assessing the goodness-of-fit of dichotomous response cognitive diagnosis models (CDMs), but their performance has not been examined for polytomous response CDMs. This study investigates the performance of the M ord statistic and standardized root mean square residual (SRMSR) for an ordinal response CDM-the sequential generalized deterministic inputs, noisy "and" gate model. Simulation studies showed that the M ord statistic had well-calibrated Type I error rates, but the correct detection rates were influenced by various factors such as item quality, sample size, and the number of response categories. In addition, the SRMSR was also influenced by many factors and the common practice of comparing the SRMSR against a prespecified cut-off (e.g., .05) may not be appropriate. A set of real data was analyzed as well to illustrate the use of M ord statistic and SRMSR in practice.
| S-EPMC7174807 | biostudies-literature
Project description:A problem that is frequently encountered in many areas of scientific research is that of estimating the effect of a non-randomized binary intervention on an outcome of interest by using time series data on units that received the intervention ('treated') and units that did not ('controls'). One popular estimation method in this setting is based on the factor analysis (FA) model. The FA model is fitted to the preintervention outcome data on treated units and all the outcome data on control units, and the counterfactual treatment-free post-intervention outcomes of the former are predicted from the fitted model. Intervention effects are estimated as the observed outcomes minus these predicted counterfactual outcomes. We propose a model that extends the FA model for estimating intervention effects by jointly modelling the multiple outcomes to exploit shared variability, and assuming an auto-regressive structure on factors to account for temporal correlations in the outcome. Using simulation studies, we show that the method proposed can improve the precision of the intervention effect estimates and achieve better control of the type I error rate (compared with the FA model), especially when either the number of preintervention measurements or the number of control units is small. We apply our method to estimate the effect of stricter alcohol licensing policies on alcohol-related harms.
| S-EPMC7612111 | biostudies-literature
Project description:Bayesian skyline plots (BSPs) are a useful tool for making inferences about demographic history. For example, researchers typically apply BSPs to test hypotheses regarding how climate changes have influenced intraspecific genetic diversity over time. Like any method, BSP has assumptions that may be violated in some empirical systems (e.g., the absence of population genetic structure), and the naïve analysis of data collected from these systems may lead to spurious results. To address these issues, we introduce P2C2M.Skyline, an R package designed to assess model adequacy for BSPs using posterior predictive simulation. P2C2M.Skyline uses a phylogenetic tree and the log file output from Bayesian Skyline analyses to simulate posterior predictive datasets and then compares this null distribution to statistics calculated from the empirical data to check for model violations. P2C2M.Skyline was able to correctly identify model violations when simulated datasets were generated assuming genetic structure, which is a clear violation of BSP model assumptions. Conversely, P2C2M.Skyline showed low rates of false positives when models were simulated under the BSP model. We also evaluate the P2C2M.Skyline performance in empirical systems, where we detected model violations when DNA sequences from multiple populations were lumped together. P2C2M.Skyline represents a user-friendly and computationally efficient resource for researchers aiming to make inferences from BSP.
| S-EPMC9312427 | biostudies-literature