Dataset Information

Predictive validity and efficiency of ongoing visual-inspection criteria for interpreting functional analyses.

ABSTRACT: Prior research has evaluated the reliability and validity of structured criteria for visually inspecting functional-analysis (FA) results on a post-hoc basis, after completion of the FA (i.e., post-hoc visual inspection [PHVI]; e.g., Hagopian et al., 1997). However, most behavior analysts inspect FAs using ongoing visual inspection (OVI) as the FA is implemented, and the validity of applying structured criteria during OVI remains unknown. In this investigation, we evaluated the predictive validity and efficiency of applying structured criteria on an ongoing basis by comparing the interim interpretations produced through OVI with (a) the final interpretations produced by PHVI, (b) the authors' post-hoc interpretations (PHAI) reported in the research studies, and (c) the consensus interpretations of these two post-hoc analyses. Ongoing visual inspection predicted the results of PHVI and the consensus interpretations with a very high degree of accuracy, and PHAI with a reasonably high degree of accuracy. Furthermore, the PHVI and PHAI results involved 32 FA sessions, on average, whereas the OVI required only 19 FA sessions to accurately identify the function(s) of destructive behavior (i.e., a 41% increase in efficiency). We discuss these findings relative to other methods designed to increase the accuracy and efficiency of FAs.

SUBMITTER: Saini V

PROVIDER: S-EPMC6002782 | biostudies-literature | 2018 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Predictive validity and efficiency of ongoing visual-inspection criteria for interpreting functional analyses.

Saini Valdeep V Fisher Wayne W WW Retzlaff Billie J BJ

Journal of applied behavior analysis 20180312 2

Prior research has evaluated the reliability and validity of structured criteria for visually inspecting functional-analysis (FA) results on a post-hoc basis, after completion of the FA (i.e., post-hoc visual inspection [PHVI]; e.g., Hagopian et al., 1997). However, most behavior analysts inspect FAs using ongoing visual inspection (OVI) as the FA is implemented, and the validity of applying structured criteria during OVI remains unknown. In this investigation, we evaluated the predictive validi ...[more]

PMID: 29527741

Similar Datasets

Project description:The Sepsis-3 taskforce defined sepsis as suspicion of infection and an acute rise in the Sequential Organ Failure Assessment score by 2 points over the preinfection baseline. Sepsis-3 studies, though, have not distinguished between acute and chronic organ failure, and may not accurately reflect the epidemiology, natural history, or impact of sepsis. Our objective was to determine the extent to which the predictive validity of Sepsis-3 is attributable to chronic rather than acute organ failure.DesignRetrospective cohort study.SettingGeneral medicine inpatient service at a tertiary teaching hospital.PatientsA total of 3,755 adult medical acute-care encounters (1,864 confirmed acute infections) over 1 year.InterventionsNone.Measurements and main resultsWe measured the total Sequential Organ Failure Assessment score at the onset of infection and separated its components (baseline and acute rise) using case-by-case chart reviews. We compared the predictive validities of acuity-focused (acute rise in Sequential Organ Failure Assessment ≥ 2) and conventional (total Sequential Organ Failure Assessment ≥ 2) implementations of Sepsis-3 criteria. Measures of predictive validity were change in the rate of outcomes and change in the area under receiver operating characteristic curves after adding sepsis criteria to multivariate logistic regression models of baseline risk (age, sex, race, and Charlson comorbidity index). Outcomes were inhospital mortality (primary) and ICU transfer or inhospital mortality (secondary). Acuity-focused implementations of Sepsis-3 were associated with neither a change in mortality (2.2% vs 1.2%; p = 0.18) nor a rise in area under receiver operating characteristic curves compared with baseline models (0.67 vs 0.66; p = 0.75). In contrast, conventional implementations were associated with a six-fold change in mortality (2.4% vs 0.4%; p = 0.01) and a rise in area under receiver operating characteristic curves compared with baseline models (0.70 vs 0.66; p = 0.04). Results were similar for the secondary outcome.ConclusionsThe evaluation of the validity of organ dysfunction-based clinical sepsis criteria is prone to bias, because acute organ dysfunction consequent to infection is difficult to separate from preexisting organ failure in large retrospective cohorts.

Dataset Information

Predictive validity and efficiency of ongoing visual-inspection criteria for interpreting functional analyses.

Publications

Predictive validity and efficiency of ongoing visual-inspection criteria for interpreting functional analyses.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets