Methods of Detecting Insufficient Effort Responding: Comparisons and Practical Recommendations.
Ontology highlight
ABSTRACT:
SUBMITTER: Hong M
PROVIDER: S-EPMC7047258 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:While self-report data is a staple of modern psychological studies, they rely on participants accurately self-reporting. Two constructs that impede accurate results are insufficient effort responding (IER) and response styles. These constructs share conceptual underpinnings and both utilized to reduce cognitive effort when responding to self-report scales. Little research has extensively explored the relationship of the two constructs. The current study explored the relationship of the two constructs across even-point and odd-point scales, as well as before and after data cleaning procedures. We utilized IRTrees, a statistical method for modeling response styles, to examine the relationship between IER and response styles. To capture the wide range of IER metrics available, we employed several forms of IER assessment in our analyses and generated IER factors based on the type of IER being detected. Our results indicated an overall modest relationship between IER and response styles, which varied depending on the type of IER metric being considered or type of scale being evaluated. As expected, data cleaning also changed the relationships of some of the variables. We posit the difference between the constructs may be the degree of cognitive effort participants are willing to expend. Future research and applications are discussed.
| S-EPMC8789874 | biostudies-literature
Project description:Careless and insufficient effort responding (C/IER) can pose a major threat to data quality and, as such, to validity of inferences drawn from questionnaire data. A rich body of methods aiming at its detection has been developed. Most of these methods can detect only specific types of C/IER patterns. However, typically different types of C/IER patterns occur within one data set and need to be accounted for. We present a model-based approach for detecting manifold manifestations of C/IER at once. This is achieved by leveraging response time (RT) information available from computer-administered questionnaires and integrating theoretical considerations on C/IER with recent psychometric modeling approaches. The approach a) takes the specifics of attentive response behavior on questionnaires into account by incorporating the distance-difficulty hypothesis, b) allows for attentiveness to vary on the screen-by-respondent level, c) allows for respondents with different trait and speed levels to differ in their attentiveness, and d) at once deals with various response patterns arising from C/IER. The approach makes use of item-level RTs. An adapted version for aggregated RTs is presented that supports screening for C/IER behavior on the respondent level. Parameter recovery is investigated in a simulation study. The approach is illustrated in an empirical example, comparing different RT measures and contrasting the proposed model-based procedure against indicator-based multiple-hurdle approaches.
| S-EPMC9166878 | biostudies-literature
Project description:BackgroundChromatin immunoprecipitation coupled with massively parallel sequencing (ChIP-seq) is increasingly being applied to study transcriptional regulation on a genome-wide scale. While numerous algorithms have recently been proposed for analysing the large ChIP-seq datasets, their relative merits and potential limitations remain unclear in practical applications.ResultsThe present study compares the state-of-the-art algorithms for detecting transcription factor binding sites in four diverse ChIP-seq datasets under a variety of practical research settings. First, we demonstrate how the biological conclusions may change dramatically when the different algorithms are applied. The reproducibility across biological replicates is then investigated as an internal validation of the detections. Finally, the predicted binding sites with each method are compared to high-scoring binding motifs as well as binding regions confirmed in independent qPCR experiments.ConclusionsIn general, our results indicate that the optimal choice of the computational approach depends heavily on the dataset under analysis. In addition to revealing valuable information to the users of this technology about the characteristics of the binding site detection approaches, the systematic evaluation framework provides also a useful reference to the developers of improved algorithms for ChIP-seq data.
| S-EPMC2804666 | biostudies-literature
Project description:Multiple comparisons tests (MCTs) include the statistical tests used to compare groups (treatments) often following a significant effect reported in one of many types of linear models. Due to a variety of data and statistical considerations, several dozen MCTs have been developed over the decades, with tests ranging from very similar to each other to very different from each other. Many scientific disciplines use MCTs, including >40,000 reports of their use in ecological journals in the last 60 years. Despite the ubiquity and utility of MCTs, several issues remain in terms of their correct use and reporting. In this study, we evaluated 17 different MCTs. We first reviewed the published literature for recommendations on their correct use. Second, we created a simulation that evaluated the performance of nine common MCTs. The tests examined in the simulation were those that often overlapped in usage, meaning the selection of the test based on fit to the data is not unique and that the simulations could inform the selection of one or more tests when a researcher has choices. Based on the literature review and recommendations: planned comparisons are overwhelmingly recommended over unplanned comparisons, for planned non-parametric comparisons the Mann-Whitney-Wilcoxon U test is recommended, Scheffé's S test is recommended for any linear combination of (unplanned) means, Tukey's HSD and the Bonferroni or the Dunn-Sidak tests are recommended for pairwise comparisons of groups, and that many other tests exist for particular types of data. All code and data used to generate this paper are available at: https://github.com/stevemidway/MultipleComparisons.
| S-EPMC7720730 | biostudies-literature
Project description:Value of information (VOI) analyses can help policy makers make informed decisions about whether to conduct and how to design future studies. Historically a computationally expensive method to compute the expected value of sample information (EVSI) restricted the use of VOI to simple decision models and study designs. Recently, 4 EVSI approximation methods have made such analyses more feasible and accessible. Members of the Collaborative Network for Value of Information (ConVOI) compared the inputs, the analyst's expertise and skills, and the software required for the 4 recently developed EVSI approximation methods. Our report provides practical guidance and recommendations to help inform the choice between the 4 efficient EVSI estimation methods. More specifically, this report provides: (1) a step-by-step guide to the methods' use, (2) the expertise and skills required to implement the methods, and (3) method recommendations based on the features of decision-analytic problems.
| S-EPMC8183576 | biostudies-literature
Project description:Careless responding is a bias in survey responses that disregards the actual item content, constituting a threat to the factor structure, reliability, and validity of psychological measurements. Different approaches have been proposed to detect aberrant responses such as probing questions that directly assess test-taking behavior (e.g., bogus items), auxiliary or paradata (e.g., response times), or data-driven statistical techniques (e.g., Mahalanobis distance). In the present study, gradient boosted trees, a state-of-the-art machine learning technique, are introduced to identify careless respondents. The performance of the approach was compared with established techniques previously described in the literature (e.g., statistical outlier methods, consistency analyses, and response pattern functions) using simulated data and empirical data from a web-based study, in which diligent versus careless response behavior was experimentally induced. In the simulation study, gradient boosting machines outperformed traditional detection mechanisms in flagging aberrant responses. However, this advantage did not transfer to the empirical study. In terms of precision, the results of both traditional and the novel detection mechanisms were unsatisfactory, although the latter incorporated response times as additional information. The comparison between the results of the simulation and the online study showed that responses in real-world settings seem to be much more erratic than can be expected from the simulation studies. We critically discuss the generalizability of currently available detection methods and provide an outlook on future research on the detection of aberrant response patterns in survey research.
| S-EPMC8725053 | biostudies-literature
Project description:The SATB2-associated syndrome is a recently described syndrome characterized by developmental delay/intellectual disability with absent or limited speech development, craniofacial abnormalities, behavioral problems, dysmorphic features, and palatal and dental abnormalities. Alterations of the SATB2 gene can result from a variety of different mechanisms that include contiguous deletions, intragenic deletions and duplications, translocations with secondary gene disruption, and point mutations. The multisystemic nature of this syndrome demands a multisystemic approach and we propose evaluation and management guidelines. The SATB2-associated syndrome registry has now been started and that will allow gathering further clinical information and refining the provided surveillance recommendations. © 2016 The Authors. American Journal of Medical Genetics Part A Published by Wiley Periodicals, Inc.
| S-EPMC5297989 | biostudies-literature
Project description:Amyloid light chain (AL) amyloidosis is among the more common and more severe of the amyloidoses usually involving the slow proliferation of a bone-marrow-residing plasma cell (PC) clone and the secretion of unstable immunoglobulin-free light chains (FLC) that infiltrate peripheral tissues and result in detrimental end-organ damage. Disease presentation is rather vague, and the hallmark of treatment is early diagnosis before irreversible end-organ damage. Once diagnosed, treatment decision is transplant-driven whereby ~20% of patients are eligible for autologous stem cell transplantation (ASCT) with or without bortezomib-based induction. In the setting of ASCT-ineligibility, bortezomib plays a central role in upfront treatment with the recent addition of daratumumab to the current emerging standard of care. In general, management of AL amyloidosis is aimed at achieving deep, durable responses with very close monitoring for early detection of relapse/refractory disease. This article provides a comprehensive review of the management of patients with AL amyloidosis including goals of therapy, current treatment guidelines in the setting of both ASCT-eligibility and ineligibility, treatment response monitoring recommendations, toxicity management, and treatment of relapse/refractory disease.
| S-EPMC8130794 | biostudies-literature
Project description:Microbial genome evolution is shaped by a variety of selective pressures. Understanding how these processes occur can help to address important problems in microbiology by explaining observed differences in phenotypes, including virulence and resistance to antibiotics. Greater access to whole-genome sequencing provides microbiologists with the opportunity to perform large-scale analyses of selection in novel settings, such as within individual hosts. This tutorial aims to guide researchers through the fundamentals underpinning popular methods for measuring selection in pathogens. These methods are transferable to a wide variety of organisms, and the exercises provided are designed for researchers with any level of programming experience.
| S-EPMC4750996 | biostudies-literature
Project description:IntroductionIntegrated community healthcare Hubs may offer a 'one stop shop' for service users with complex health and social needs, and more efficiently use service resources. Various policy imperatives exist to implement Hub models of care, however, there is a dearth of research specifically evaluating Hubs targeted at families experiencing adversity. To contribute to building this evidence, we propose to co-design, test and evaluate integrated Hub models of care in two Australian community health services in low socioeconomic areas that serve families experiencing adversity: Wyndham Vale in Victoria and Marrickville in New South Wales.Methods and analysisThis multisite convergent mixed-methods study will run over three phases to (1) develop the initial Hub programme theory through formative research; (2) test and, then, (3) refine the Hub theory using empirical data. Phase 1 involves co-design of each Hub with caregivers, community members and practitioners. Phase 2 uses caregiver and Hub practitioner surveys at baseline, and 6 and 12 months after Hub implementation, and in-depth interviews at 12 months. Two stakeholder groups will be recruited: caregivers (n=100-200 per site) and Hub practitioners (n=20-30 per site). The intervention is a co-located Hub providing health, social, legal and community services with no comparator. The primary outcomes are caregiver-reported: (i) identification of, (ii) interventions received and/or (iii) referrals received for adversity from Hub practitioners. The study also assesses child, caregiver, practitioner and system outcomes including mental health, parenting, quality of life, care experience and service linkages. Primary and secondary outcomes will be assessed by examining change in proportions/means from baseline to 6 months, from 6 to 12 months and from baseline to 12 months. Service linkages will be analysed using social network analysis. Costs of Hub implementation and a health economics analysis of unmet need will be conducted. Thematic analysis will be employed to analyse qualitative data.Ethics and disseminationRoyal Children's Hospital and Sydney Local Health District ethics committees have approved the study (HREC/62866/RCHM-2020). Participants and stakeholders will receive results through meetings, presentations and publications.Trial registration numberISRCTN55495932.
| S-EPMC9125738 | biostudies-literature