Dataset Information

Assessment of variation in the Alberta Context Tool: the contribution of unit level contextual factors and specialty in Canadian pediatric acute care settings.

ABSTRACT:

Background

There are few validated measures of organizational context and none that we located are parsimonious and address modifiable characteristics of context. The Alberta Context Tool (ACT) was developed to meet this need. The instrument assesses 8 dimensions of context, which comprise 10 concepts. The purpose of this paper is to report evidence to further the validity argument for ACT. The specific objectives of this paper are to: (1) examine the extent to which the 10 ACT concepts discriminate between patient care units and (2) identify variables that significantly contribute to between-unit variation for each of the 10 concepts.

Methods

859 professional nurses (844 valid responses) working in medical, surgical and critical care units of 8 Canadian pediatric hospitals completed the ACT. A random intercept, fixed effects hierarchical linear modeling (HLM) strategy was used to quantify and explain variance in the 10 ACT concepts to establish the ACT's ability to discriminate between units. We ran 40 models (a series of 4 models for each of the 10 concepts) in which we systematically assessed the unique contribution (i.e., error variance reduction) of different variables to between-unit variation. First, we constructed a null model in which we quantified the variance overall, in each of the concepts. Then we controlled for the contribution of individual level variables (Model 1). In Model 2, we assessed the contribution of practice specialty (medical, surgical, critical care) to variation since it was central to construction of the sampling frame for the study. Finally, we assessed the contribution of additional unit level variables (Model 3).

Results

The null model (unadjusted baseline HLM model) established that there was significant variation between units in each of the 10 ACT concepts (i.e., discrimination between units). When we controlled for individual characteristics, significant variation in the 10 concepts remained. Assessment of the contribution of specialty to between-unit variation enabled us to explain more variance (1.19% to 16.73%) in 6 of the 10 ACT concepts. Finally, when we assessed the unique contribution of the unit level variables available to us, we were able to explain additional variance (15.91% to 73.25%) in 7 of the 10 ACT concepts.

Conclusion

The findings reported here represent the third published argument for validity of the ACT and adds to the evidence supporting its use to discriminate patient care units by all 10 contextual factors. We found evidence of relationships between a variety of individual and unit-level variables that explained much of this between-unit variation for each of the 10 ACT concepts. Future research will include examination of the relationships between the ACT's contextual factors and research utilization by nurses and ultimately the relationships between context, research utilization, and outcomes for patients.

SUBMITTER: Estabrooks CA

PROVIDER: S-EPMC3200177 | biostudies-literature | 2011 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Assessment of variation in the Alberta Context Tool: the contribution of unit level contextual factors and specialty in Canadian pediatric acute care settings.

Estabrooks Carole A CA Squires Janet E JE Hutchinson Alison M AM Scott Shannon S Cummings Greta G GG Kang Sung Hyun SH Midodzi William K WK Stevens Bonnie B

BMC health services research 20111004

<h4>Background</h4>There are few validated measures of organizational context and none that we located are parsimonious and address modifiable characteristics of context. The Alberta Context Tool (ACT) was developed to meet this need. The instrument assesses 8 dimensions of context, which comprise 10 concepts. The purpose of this paper is to report evidence to further the validity argument for ACT. The specific objectives of this paper are to: (1) examine the extent to which the 10 ACT concepts ...[more]

PMID: 21970404

Similar Datasets

Project description:BackgroundThe context of healthcare organizations such as hospitals is increasingly accepted as having the potential to influence the use of new knowledge. However, the mechanisms by which the organizational context influences evidence-based practices are not well understood. Current measures of organizational context lack a theory-informed approach, lack construct clarity and generally have modest psychometric properties. This paper presents the development and initial psychometric validation of the Alberta Context Tool (ACT), an eight dimension measure of organizational context for healthcare settings.MethodsThree principles guided the development of the ACT: substantive theory, brevity, and modifiability. The Promoting Action on Research Implementation in Health Services (PARiHS) framework and related literature were used to guide selection of items in the ACT. The ACT was required to be brief enough to be tolerated in busy and resource stretched work settings and to assess concepts of organizational context that were potentially modifiable. The English version of the ACT was completed by 764 nurses (752 valid responses) working in seven Canadian pediatric care hospitals as part of its initial validation. Cronbach's alpha, exploratory factor analysis, analysis of variance, and tests of association were used to assess instrument reliability and validity.ResultsFactor analysis indicated a 13-factor solution (accounting for 59.26% of the variance in 'organizational context'). The composition of the factors was similar to those originally conceptualized. Cronbach's alpha for the 13 factors ranged from .54 to .91 with 4 factors performing below the commonly accepted alpha cut off of .70. Bivariate associations between instrumental research utilization levels (which the ACT was developed to predict) and the ACT's 13 factors were statistically significant at the 5% level for 12 of the 13 factors. Each factor also showed a trend of increasing mean score ranging from the lowest level to the highest level of instrumental research use, indicating construct validity.ConclusionsTo date, no completely satisfactory measures of organizational context are available for use in healthcare. The ACT assesses several core domains to provide a comprehensive account of organizational context in healthcare settings. The tool's strengths are its brevity (allowing it to be completed in busy healthcare settings) and its focus on dimensions of organizational context that are modifiable. Refinements of the instrument for acute, long term care, and home care settings are ongoing.

Project description:BackgroundA classification system that categorizes International Statistical Classification of Diseases and Related Health Problems, Tenth Revision (ICD-10) diagnosis codes into clinically meaningful categories is important for pediatric clinical and health services research using administrative data. While a Pediatric Clinical Classification System (PECCS) is available for the United States ICD-10 system (i.e, ICD-10-CM), differences in the ICD-10 system between countries limits PECCS use in Canada.ObjectiveTo translate PECCS from ICD-10-CM to ICD-10-CA for use in Canada (PECCS-CA), and examine the utility of PECCS-CA in administrative data of pediatric hospital encounters in Ontario, Canada.MethodsPECCS was translated by mapping each ICD-10-CA code to its corresponding ICD-10-CM code, based on code description and alphanumeric code, using automated functions in Microsoft Excel. All unmatched ICD-10-CA codes were manually matched to an ICD-10-CM code. The ICD-10-CA codes were mapped to a PECCS category based on the placement of the corresponding ICD-10-CM code. Finally, in this cross-sectional study, the utility of PECCS-CA was examined in pediatric hospital encounters in children <18 years of age with an inpatient or same day surgery encounter, between April 1, 2014 to March 31, 2019 in Ontario.ResultsIn total, 16,992 ICD-10-CA diagnosis codes were mapped to 781 mutually exclusive condition categories that included pediatric specific conditions and treatments in PECCS-CA. From the 781 categories, 777 (99.5%) were derived from the original PECCS, 3 (0.4%) from merging the original PECCS categories, and 1 (0.1%) was newly developed. The PECCS-CA was applied to health administrative data of 911,732 hospital encounters in children. The most prevalent condition in children was low birth weight (n = 54,100 encounters).ConclusionThe PECCS-CA is an open-source classification system which maps ICD-10-CA codes into 781 clinically important pediatric categories. The PECCS-CA can be used for pediatric health services and outcomes research in Canada.

Project description:The organisational context of healthcare settings has an essential role in how research evidence is used in clinical practice. The Alberta Context Tool (ACT) measures 10 concepts of organisational context with higher scores indicating a more positive work environment and potentially better use of research evidence in patient care. We assessed the psychometric properties of the ACT in Emergency Departments (EDs). This validation study was conducted as part of a multi-centre trial of triage, treatment and transfer (T3 Trial) of patients with stroke admitted to EDs. Stratified sampling with proportional allocation was used to recruit ED nurses from 26 participating hospitals at baseline. Nurses completed a survey containing the ACT. Structural validity was investigated by exploratory and confirmatory factor analysis. Reliability was assessed using Cronbach's alpha and intraclass correlation coefficients. Item-rest correlations and the average inter-item correlations were also assessed. 558 ED nurses completed the survey, comprised of 433 surveys without missing data. Our exploratory factor analysis produced a 14-factor structure, explaining 62% of variance of organisational context. For eight of ten concepts, item loadings matched the factor structure of the original ACT. Confirmatory factor analysis of the 10 ACT concepts showed moderate model fit (p = 0.001, root mean square error of approximation: 0.049, standardised root mean squared residual: 0.048). Cronbach's alphas showed very good internal consistency for nine of ten ACT concepts (α>0.7; 0.45-0.90). Item-rest correlations indicated that most ACT items (50 of 56 items) within any concept related well to the total score of the concept. Average inter-item correlations indicated potential redundant items for three concepts (feedback processes, leadership, staffing) that were above the threshold of 0.5. While identifying a few shortcomings for some ACT concepts in an ED context, the majority of findings confirm reliability and validity of the original ACT in an Australian population of ED nurses.

Project description:IntroductionPediatric acute liver failure is a rare and serious disease. Though liver transplantation is considered as the established treatment option for patients who are unlikely to recover with medical management, however, with the advancement of medical care there has been an increase in spontaneous regeneration of liver, obviating the need for liver transplantation. We identified the etiologies, outcome and prognostic factors of acute liver failure and the validity of the existing liver transplantation criteria to predict the outcome of pediatric acute liver failure.Materials and methodsThis was a retrospective study done from January 2014 to December 2019 in a tertiary pediatric critical care unit in South India. All children aged between 1 month to 18 years admitted with acute liver failure were enrolled.ResultsOf 125 children with acute liver failure, the main etiologies were infections (32%), indeterminate (23%), paracetamol toxicity (21%), metabolic (13%) and others (11%). Dengue was the most common infection (55%). The median pediatric logistic organ dysfunction score at admission was 12 (4-27). Of 125 patients, 63.2% (n = 79) had spontaneous regeneration which was higher in paracetamol induced (92.3%) compared to non-paracetamol induced acute liver failure (55.5%). Only two patients underwent liver transplantation and 35% died. Peak alanine transaminase and use of inotropes significantly predicted the outcome of disease. Of 38 children meeting King's College Hospital criteria for liver transplantation, 57.9% had spontaneous regeneration and 36.8% died. Of 74 children meeting INR > 4 criteria, 54% (n = 40) had spontaneous regeneration and 43.2% died. INR >4 criteria was more sensitive than King's College Hospital criteria for predicting the need for liver transplantation.ConclusionPediatric acute liver failure is caused by varied etiologies and infections were the commonest cause. Despite having a seriously ill cohort of patients, medical management resulted in spontaneous regeneration in the majority of children with acute liver failure. The use of inotropes, advanced hepatic encephalopathy, and peak alanine transaminase were predictors of poor outcome in children with acute liver failure and these patients could be considered for liver transplantation as available. Therefore, we may need to develop better predictors of pediatric acute liver failure in resource limited settings.

Project description:BACKGROUND: To study the association between organizational context and research utilization in German residential long term care (LTC), we translated three Canadian assessment instruments: the Alberta Context Tool (ACT), Estabrooks' Kinds of Research Utilization (RU) items and the Conceptual Research Utilization Scale. Target groups for the tools were health care aides (HCAs), registered nurses (RNs), allied health professionals (AHPs), clinical specialists and care managers. Through a cognitive debriefing process, we assessed response processes validity-an initial stage of validity, necessary before more advanced validity assessment. METHODS: We included 39 participants (16 HCAs, 5 RNs, 7 AHPs, 5 specialists and 6 managers) from five residential LTC facilities. We created lists of questionnaire items containing problematic items plus items randomly selected from the pool of remaining items. After participants completed the questionnaires, we conducted individual semi-structured cognitive interviews using verbal probing. We asked participants to reflect on their answers for list items in detail. Participants' answers were compared to concept maps defining the instrument concepts in detail. If at least two participants gave answers not matching concept map definitions, items were revised and re-tested with new target group participants. RESULTS: Cognitive debriefings started with HCAs. Based on the first round, we modified 4 of 58 ACT items, 1 ACT item stem and all 8 items of the RU tools. All items were understood by participants after another two rounds. We included revised HCA ACT items in the questionnaires for the other provider groups. In the RU tools for the other provider groups, we used different wording than the HCA version, as was done in the original English instruments. Only one cognitive debriefing round was needed with each of the other provider groups. CONCLUSION: Cognitive debriefing is essential to detect and respond to problematic instrument items, particularly when translating instruments for heterogeneous, less well educated provider groups such as HCAs. Cognitive debriefing is an important step in research tool development and a vital component of establishing response process validity evidence. Publishing cognitive debriefing results helps researchers to determine potentially critical elements of the translated tools and assists with interpreting scores.

Project description:BackgroundOrganizational context has the potential to influence the use of new knowledge. However, despite advances in understanding the theoretical base of organizational context, its measurement has not been adequately addressed, limiting our ability to quantify and assess context in healthcare settings and thus, advance development of contextual interventions to improve patient care. We developed the Alberta Context Tool (the ACT) to address this concern. It consists of 58 items representing 10 modifiable contextual concepts. We reported the initial validation of the ACT in 2009. This paper presents the second stage of the psychometric validation of the ACT.MethodsWe used the Standards for Educational and Psychological Testing to frame our validity assessment. Data from 645 English speaking healthcare aides from 25 urban residential long-term care facilities (nursing homes) in the three Canadian Prairie Provinces were used for this stage of validation. In this stage we focused on: (1) advanced aspects of internal structure (e.g., confirmatory factor analysis) and (2) relations with other variables validity evidence. To assess reliability and validity of scores obtained using the ACT we conducted: Cronbach's alpha, confirmatory factor analysis, analysis of variance, and tests of association. We also assessed the performance of the ACT when individual responses were aggregated to the care unit level, because the instrument was developed to obtain unit-level scores of context.ResultsItem-total correlations exceeded acceptable standards (> 0.3) for the majority of items (51 of 58). We ran three confirmatory factor models. Model 1 (all ACT items) displayed unacceptable fit overall and for five specific items (1 item on adequate space for resident care in the Organizational Slack-Space ACT concept and 4 items on use of electronic resources in the Structural and Electronic Resources ACT concept). This prompted specification of two additional models. Model 2 used the 7 scaled ACT concepts while Model 3 used the 3 count-based ACT concepts. Both models displayed substantially improved fit in comparison to Model 1. Cronbach's alpha for the 10 ACT concepts ranged from 0.37 to 0.92 with 2 concepts performing below the commonly accepted standard of 0.70. Bivariate associations between the ACT concepts and instrumental research utilization levels (which the ACT should predict) were statistically significant at the 5% level for 8 of the 10 ACT concepts. The majority (8/10) of the ACT concepts also showed a statistically significant trend of increasing mean scores when arrayed across the lowest to the highest levels of instrumental research use.ConclusionsThe validation process in this study demonstrated additional empirical support for construct validity of the ACT, when completed by healthcare aides in nursing homes. The overall pattern of the data was consistent with the structure hypothesized in the development of the ACT and supports the ACT as an appropriate measure for assessing organizational context in nursing homes. Caution should be applied in using the one space and four electronic resource items that displayed misfit in this study with healthcare aides until further assessments are made.

Project description:BackgroundChamplain BASE™ (Building Access to Specialists through eConsultation) is a web-based asynchronous electronic communication service that allows primary-care- practitioners (PCPs) to submit "elective" clinical questions to a specialist. For adults, PCPs have reported improved access and timeliness to specialist advice, averted face-to-face specialist referrals in up to 40% of cases and high provider satisfaction.ObjectiveTo determine whether the expansion of eConsult to a pediatric setting would result in similar measures of improved healthcare system process and high provider acceptance reported in adults.DesignProspective observational cohort study.SettingSingle Canadian tertiary-care academic pediatric hospital (June 2014-16) servicing 1.2 million people.Participants1. PCPs already using eConsult. 2.Volunteer pediatric specialists provided services in addition to their regular workload. 3.Pediatric patients (< 18 years-old) referred for none-acute care conditions.Main outcomes and measuresSpecialty service utilization and access, impact on PCP course-of-action and referral-patterns and survey-based provider satisfaction data were collected.Results1064 eConsult requests from 367 PCPs were answered by 23 pediatric specialists representing 14 specialty-services. The top three specialties represented were: General Pediatrics 393 cases (36.9%), Orthopedics 162 (15.2%) and Psychiatry 123 (11.6%). Median specialist response time was 0.9 days (range <1 hour-27 days), most consults (63.2%) required <10minutes to complete and 21/21(100%) specialist survey-respondents reported minimal workload burden. For 515/1064(48.4%) referrals, PCPs received advice for a new or additional course of action; 391/1064(36.7%) referrals resulted in an averted face-to-face specialist visit. In 9 specialties with complete data, the median wait-time was significantly less (p<0.001) for an eConsult (1 day, 95%CI:0.9-1.2) compared with a face-to-face referral (132 days; 95%CI:127-136). The majority (>93.3%) of PCPs rated eConsult as very good/excellent value for both patients and themselves. All specialist survey-respondents indicated eConsult should be a continued service.Conclusions and relevanceSimilar to adults, eConsult improves PCP access and timeliness to elective pediatric specialist advice and influences their care decisions, while reporting high end-user satisfaction. Further study is warranted to assess impact on resource utilization and clinical outcomes.

Dataset Information

Assessment of variation in the Alberta Context Tool: the contribution of unit level contextual factors and specialty in Canadian pediatric acute care settings.

Background

Methods

Results

Conclusion

Publications

Assessment of variation in the Alberta Context Tool: the contribution of unit level contextual factors and specialty in Canadian pediatric acute care settings.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets