Assessing the Impact of Different Depression Treatment Success Metrics on Organizational Performance.
Ontology highlight
ABSTRACT:
SUBMITTER: Carlo AD
PROVIDER: S-EPMC8249313 | biostudies-literature | 2021 Jul
REPOSITORIES: biostudies-literature
Publications
Assessing the Impact of Different Depression Treatment Success Metrics on Organizational Performance.
Carlo Andrew D AD Chan Gary G Arao Robert F RF Vredevoogd Melinda A MA Fortney John C JC Powers Diane M DM Russo Joan E JE Unützer Jürgen J
Psychiatric services (Washington, D.C.) 20210415 7
<b>Objective:</b> The Patient Health Questionnaire-9 (PHQ-9) is commonly used to assess depression symptoms, but its associated treatment success criteria (i.e., metrics) are inconsistently defined. The authors aimed to analyze the impact of metric choice on outcomes and discuss implications for clinical practice and research. <b>Methods:</b> Analyses included three overlapping and nonexclusive time cohorts of adult patients with depression treated in 33 organizations between 2008 and 2018. Aver ...[more]
Similar Datasets
Project description:BackgroundThe job performance of individual employees determines the overall performance of an organization, and organizational support is known as an important resource at the organizational level to enhance job performance. Although nursing scholars have confirmed the crucial role of organizational support in enhancing job performance, there are no studies on whether psychological capital and organizational identification mediate the association between organizational support and job performance. The purpose of this study is to investigate the influence of organizational support, psychological capital, and organizational identification on nurses' job performance.MethodsA cross-sectional survey was conducted among 455 nurses from 21 public hospitals in China. Instruments were perceived organizational support scale, task performance scale, contextual performance scale, Nurse Psychological Capital Questionnaire, and Organizational Identification Questionnaire. Survey data were analyzed using SPSS and AMOS, and hypotheses were tested using path model analysis.ResultsNurses' perceived organizational support, psychological capital, organizational identification, and task/contextual performance were positively correlated in every two variables. Psychological capital played an important mediating role in perceived organizational support and task/contextual performance, as well as organizational identification. The multi-mediating effect of psychological capital and organizational identification on the relationship between organizational support and task/contextual performance were 0.14 and 0.25, respectively.ConclusionsThere was a positive correlation between organizational support and job performance among nurses. Psychological support, organizational identification and contextual performance played a chain mediation role in the relationship between organizational support on task performance in nurses. Nursing managers should pay more attention to enhancing nurses' psychological capital and organizational identification through effective interventions to improve nurses' job performance.
| S-EPMC10375763 | biostudies-literature
Project description:When multiple institutions with strong sustainability initiatives use a new environmental impact assessment tool, there is an impulse to compare. The first seven institutions to calculate nitrogen footprints using the Nitrogen Footprint Tool have worked collaboratively to improve calculation methods, share resources, and suggest methods for reducing their footprints. This article compares those seven institutions' results to reveal the common and unique drivers of institution nitrogen footprints. The footprints were compared by scope and sector, and the results were normalized by multiple factors (e.g., population, amount of food served). The comparisons found many consistencies across the footprints, including the large contribution of food. The comparisons identified metrics that could be used to track progress, such as an overall indicator for the nitrogen sustainability of food purchases. The comparisons also pointed to differences in system bounds of the calculations, which are important to standardize when comparing across institutions. The footprints were influenced by factors both within and outside of the institutions' ability to control, such as size, location, population, and campus use. However, these comparisons also point to a pathway forward for standardizing nitrogen footprint tool calculations, identifying metrics that can be used to track progress, and determining a sustainable institution nitrogen footprint.
| S-EPMC5765843 | biostudies-literature
Project description:BackgroundVarious metrics predicated on Patient Health Questionnaire-9 (PHQ-9) scores denote depression "response" or "remission" over time, but few have been empirically validated. We compare the associations of depression response and remission metrics with concomitant clinical improvement in patient-centered outcomes (PCOs).SubjectsSecondary analysis of PHQ-9 and PCO data from the treatment arm (n=906) of the Improving Mood-Promoting Access to Collaborative Treatment (IMPACT) trial.Research designWe conducted univariate correlations between 9 depression treatment metrics and 4 PCOs. For each PCO, we specified a multivariate linear fixed-effects regression model with penalized LASSO (least absolute shrinkage and selection operator) variable selection that included parameters for each incremental absolute PHQ-9 decrease between 0 and 16 points. Model predictive properties were assessed using a split sample analysis.ResultsThere was a notable variation in depression improvement rates across metrics. Each metric was significantly associated with PCOs in univariate analyses. In the multivariate models, the cumulative likelihood of PCO improvement was most improved by absolute PHQ-9 score decreases of 7-9 and 14-16 points. The multivariate models showed greater area under the curve (0.671-0.804) in out-of-sample predictions of PCO changes than the univariate models (0.529-0.649).ConclusionsChoice of depression response metric impacts observed response and remission rates, though PCOs tend to improve with depression improvement regardless of metric choice. Absolute incremental PHQ-9 score decreases are broadly associated with an increased likelihood of favorable PCO scores. Our findings support a novel PHQ-9 metric defined by an absolute score change of 8 points or greater.
| S-EPMC8187281 | biostudies-literature
Project description:BackgroundMeasuring the performance of models that predict individualized treatment effect is challenging because the outcomes of two alternative treatments are inherently unobservable in one patient. The C-for-benefit was proposed to measure discriminative ability. However, measures of calibration and overall performance are still lacking. We aimed to propose metrics of calibration and overall performance for models predicting treatment effect in randomized clinical trials (RCTs).MethodsSimilar to the previously proposed C-for-benefit, we defined observed pairwise treatment effect as the difference between outcomes in pairs of matched patients with different treatment assignment. We match each untreated patient with the nearest treated patient based on the Mahalanobis distance between patient characteristics. Then, we define the Eavg-for-benefit, E50-for-benefit, and E90-for-benefit as the average, median, and 90th quantile of the absolute distance between the predicted pairwise treatment effects and local-regression-smoothed observed pairwise treatment effects. Furthermore, we define the cross-entropy-for-benefit and Brier-for-benefit as the logarithmic and average squared distance between predicted and observed pairwise treatment effects. In a simulation study, the metric values of deliberately "perturbed models" were compared to those of the data-generating model, i.e., "optimal model". To illustrate these performance metrics, different modeling approaches for predicting treatment effect are applied to the data of the Diabetes Prevention Program: 1) a risk modelling approach with restricted cubic splines; 2) an effect modelling approach including penalized treatment interactions; and 3) the causal forest.ResultsAs desired, performance metric values of "perturbed models" were consistently worse than those of the "optimal model" (Eavg-for-benefit ≥ 0.043 versus 0.002, E50-for-benefit ≥ 0.032 versus 0.001, E90-for-benefit ≥ 0.084 versus 0.004, cross-entropy-for-benefit ≥ 0.765 versus 0.750, Brier-for-benefit ≥ 0.220 versus 0.218). Calibration, discriminative ability, and overall performance of three different models were similar in the case study. The proposed metrics were implemented in a publicly available R-package "HTEPredictionMetrics".ConclusionThe proposed metrics are useful to assess the calibration and overall performance of models predicting treatment effect in RCTs.
| S-EPMC10329397 | biostudies-literature
Project description:ObjectiveDeep learning (DL) MRI reconstruction enables fast scan acquisition with good visual quality, but the diagnostic impact is often not assessed because of large reader study requirements. This study used existing diagnostic DL to assess the diagnostic quality of reconstructed images.Materials and methodsA retrospective multisite study of 1535 patients assessed biparametric prostate MRI between 2016 and 2020. Likely clinically significant prostate cancer (csPCa) lesions (PI-RADS ≥ 4) were delineated by expert radiologists. T2-weighted scans were retrospectively undersampled, simulating accelerated protocols. DL reconstruction (DLRecon) and diagnostic DL detection (DLDetect) were developed. The effect on the partial area under (pAUC), the Free-Response Operating Characteristic (FROC) curve, and the structural similarity (SSIM) were compared as metrics for diagnostic and visual quality, respectively. DLDetect was validated with a reader concordance analysis. Statistical analysis included Wilcoxon, permutation, and Cohen's kappa tests for visual quality, diagnostic performance, and reader concordance.ResultsDLRecon improved visual quality at 4- and 8-fold (R4, R8) subsampling rates, with SSIM (range: -1 to 1) improved to 0.78 ± 0.02 (p < 0.001) and 0.67 ± 0.03 (p < 0.001) from 0.68 ± 0.03 and 0.51 ± 0.03, respectively. However, diagnostic performance at R4 showed a pAUC FROC of 1.33 (CI 1.28-1.39) for DL and 1.29 (CI 1.23-1.35) for naive reconstructions, both significantly lower than fully sampled pAUC of 1.58 (DL: p = 0.024, naïve: p = 0.02). Similar trends were noted for R8.ConclusionDL reconstruction produces visually appealing images but may reduce diagnostic accuracy. Incorporating diagnostic AI into the assessment framework offers a clinically relevant metric essential for adopting reconstruction models into clinical practice.Clinical relevance statementIn clinical settings, caution is warranted when using DL reconstruction for MRI scans. While it recovered visual quality, it failed to match the prostate cancer detection rates observed in scans not subjected to acceleration and DL reconstruction.
| S-EPMC11519109 | biostudies-literature
Project description:Previous research has noted that many factors greatly influence the spread of COVID-19. Contrary to explicit factors that are measurable, such as population density, number of medical staff, and the daily test rate, many factors are not directly observable, for instance, culture differences and attitudes toward the disease, which may introduce unobserved heterogeneity. Most contemporary COVID-19 related research has focused on modeling the relationship between explicitly measurable factors and the response variable of interest (such as the infection rate or the death rate). The infection rate is a commonly used metric for evaluating disease progression and a state's mitigation efforts. Because unobservable sources of heterogeneity cannot be measured directly, it is hard to incorporate them into the quantitative assessment and decision-making process. In this study, we propose new metrics to study a state's performance by adjusting the measurable county-level covariates and unobservable state-level heterogeneity through random effects. A hierarchical linear model (HLM) is postulated, and we calculate two model-based metrics-the standardized infection ratio (SDIR) and the adjusted infection rate (AIR). This analysis highlights certain time periods when the infection rate for a state was high while their SDIR was low and vice versa. We show that trends in these metrics can give insight into certain aspects of a state's performance. As each state continues to develop their individualized COVID-19 mitigation strategy and ultimately works to improve their performance, the SDIR and AIR may help supplement the crude infection rate metric to provide a more thorough understanding of a state's performance.
| S-EPMC8437244 | biostudies-literature
Project description:Nestedness is a property of interaction networks widely observed in natural mutualistic communities, among other systems. A perfectly nested network is characterized by the peculiarity that the interactions of any node form a subset of the interactions of all nodes with higher degree. Despite a widespread interest on this pattern, no general consensus exists on how to measure it. Instead, several nestedness metrics, based on different but not necessarily independent properties of the networks, coexist in the literature, blurring the comparison between ecosystems. In this work, we present a detailed critical study of the behavior of six nestedness metrics and the variants of two of them. In order to evaluate their performance, we compare the obtained values of the nestedness of a large set of real networks among them and against a maximum-entropy and maximum-likelihood null model. We also analyze the dependencies of each metrics on different network parameters, as size, fill, and eccentricity. Our results point out, first, that the metrics do not rank networks universally in terms of their degree of nestedness. Furthermore, several metrics show significant dependencies on the network properties considered. The study of these dependencies allows us to understand some of the observed systematic shifts against the null model. Altogether, this paper intends to provide readers with a critical guide on how to measure nestedness patterns, by explaining the functioning of several metrics and disclosing their qualities and flaws. Besides, we also aim to extend the application of null models based on maximum entropy to the scarcely explored area of ecological networks. Finally, we provide a fully documented repository that allows constructing the null model and calculating the studied nestedness indexes. In addition, it provides the probability matrices to build the null model for a large dataset of more than 200 bipartite networks.
| S-EPMC7663079 | biostudies-literature
Project description:ObjectiveHorizontal consolidation in the hospital industry has gained momentum in the United States despite concerns over rising costs and lower quality. Hospital systems frequently point to potential gains in interoperability and electronic exchange of patient information as consolidation benefits. We sought to assess whether hospitals in different health system structures varied in their interoperable data sharing.Materials and methodsWe created a cross-sectional national hospital sample from the 2014 AHA Annual Survey and 2015 IT Supplement. We combined the existing taxonomy of health system organizational forms and the ONC's functionality-based, technology-agnostic definition of interoperability. We used logistic regression models to assess the relationship between health systems' organizational forms and interoperability engagement, controlling for hospital characteristics.ResultsWe found that interoperability engagement varied greatly across hospitals in different health system structures, with facilities in more centralized health systems more likely to be interoperable. Hospitals in one system type, featuring centralized insurance product development but diverse service offerings across member organizations, had significantly higher odds of being engaged in interoperable data sharing in our multivariate regression results.DiscussionThe heterogeneity in health system interoperability engagement indicates that incentives to share data vary greatly across organizational strategies and structures. Our results suggest that horizontal consolidation in the hospital industry may not bring significant gains in interoperability progress unless that consolidation takes a specific business alignment form.ConclusionPolicymakers should be wary of claims that horizontal consolidation will lead to interoperability gains. Future research should explore the specific mechanisms that lead to greater interoperability in certain health system organizational structures.
| S-EPMC7646916 | biostudies-literature
Project description:BackgroundPrevious work suggests that major depressive disorder (MDD) is associated with disturbances in global connectivity among brain regions, as well as local connectivity within regions. However, the relative importance of these global versus local changes for successful antidepressant treatment is unknown. We used multiscale entropy (MSE), a measure of brain signal variability, to examine how the propensity for local (fine scale MSE) versus global (coarse scale MSE) neural processing measured prior to antidepressant treatment is related to subsequent treatment response.MethodsWe collected resting-state EEG activity during eyes-open and closed conditions from unmedicated individuals with MDD prior to antidepressant pharmacotherapy (N = 36) as well as from non-depressed controls (N = 36). Treatment response was assessed after 12 weeks of treatment using the Montgomery-Åsberg Depression Rating Scale (MADRS), at which time participants with MDD were characterized as either responders (≥ 50% MADRS decrease) or non-responders. MSE was calculated from baseline EEG, and compared between controls, future treatment responders and non-responders. Putative interactions with the well-documented age effect on signal variability (increased reliance on local neural communication with increasing age, indexed by greater finer-scale variability) were assessed.ResultsOnly in responders, we found that reduced MSE at fine temporal scales (especially fronto-centrally) and increased MSE diffusely at coarser temporal scales was related to the magnitude of the antidepressant response. In controls and MDD non-responders, but not MDD responders, there was an increase in MSE with age at fine temporal scales and a decrease in MSE with age at coarse temporal scales.ConclusionOur results suggest that an increased propensity toward global processing, indexed by greater MSE at coarser timescales, at baseline appears to facilitate eventual antidepressant treatment response.
| S-EPMC5683802 | biostudies-literature
Project description:To increase the probability of success in drug discovery, the concept of drug-like properties was introduced. Efficiency metrics that normalize potency against these properties could help reach drug-like space more efficiently. Potential reasons for the inefficient use of metrics and suboptimal decision making are discussed.
| S-EPMC4027587 | biostudies-other