Test Preparation in Figural Matrices Tests: Focus on the Difficult Rules.
Ontology highlight
ABSTRACT:
SUBMITTER: Krautter K
PROVIDER: S-EPMC8081851 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundThe Ruff Figural Fluency Test (RFFT) is a valid but time-consuming and labour-intensive cognitive paper-and-pencil test. A digital RFFT was developed that can be conducted independently using an iPad and Apple Pencil and RFFT scores are computed automatically. We investigated the validity and reliability of this digital RFFT.MethodsWe randomly allocated participants to the digital or paper-and-pencil RFFT. After the first test, the other test was performed immediately (cross-over). Participants were invited for a second digital RFFT 1 week later. For the digital RFFT, an (automatic) algorithm and two independent raters (criterion standard) assessed the number of unique designs (UD) and perseverative errors (PE). These raters also assessed the paper-and-pencil RFFT. We used Intraclass correlation coefficients (ICC), sensitivity, specificity, %-agreement, Kappa, and Bland-Altman plots.ResultsWe included 94 participants (mean (SD) age 39.9 (14.8), 73.4% follow-up). Mean (SD) UD and median (IQR) PE of the digital RFFT were 84.2 (26.0) and 4 (2-7.3), respectively. Agreement between manual and automatic scoring of the digital RFFT was high for UD (ICC = 0.99, 95% CI 0.98, 0.99, sensitivity = 0.98; specificity = 0.96) and PE (ICC = 0.99, 95% CI 0.98, 0.99; sensitivity = 0.90, specificity = 1.00), indicating excellent criterion validity. Small but significant differences in UD were found between the automatic and manual scoring (mean difference: - 1.12, 95% CI - 1.92, - 0.33). Digital and paper-and-pencil RFFT had moderate agreement for UD (ICC = 0.73, 95% CI 0.34, 0.87) and poor agreement for PE (ICC = 0.47, 95% CI 0.30, 0.62). Participants had fewer UD on the digital than paper-and-pencil RFFT (mean difference: - 7.09, 95% CI - 11.80, - 2.38). The number of UD on the digital RFFT was associated with higher education (Spearman's r = 0.43, p < 0.001), and younger age (Pearson's r = - 0.36, p < 0.001), showing its ability to discriminate between different age categories and levels of education. Test-retest reliability was moderate (ICC = 0.74, 95% CI 0.61, 0.83).ConclusionsThe automatic scoring of the digital RFFT has good criterion and convergent validity. There was low agreement between the digital RFFT and paper-and-pencil RFFT and moderate test-retest reliability, which can be explained by learning effects. The digital RFFT is a valid and reliable instrument to measure executive cognitive function among the general population and is a feasible alternative to the paper-and-pencil RFFT in large-scale studies. However, its scores cannot be used interchangeably with the paper-and-pencil RFFT scores.
| S-EPMC8080381 | biostudies-literature
Project description:The Ruff Figural Fluency Test (RFFT) is a sensitive test for nonverbal fluency suitable for all age groups. However, assessment of performance on the RFFT is time-consuming and may be affected by interrater differences. Therefore, we developed computer software specifically designed to analyze performance on the RFFT by automated pattern recognition. The aim of this study was to compare assessment by the new software with conventional assessment by human raters. The software was developed using data from the Lifelines Cohort Study and validated in an independent cohort of the Prevention of Renal and Vascular End Stage Disease (PREVEND) study. The total study population included 1,761 persons: 54% men; mean age (SD), 58 (10) years. All RFFT protocols were assessed by the new software and two independent human raters (criterion standard). The mean number of unique designs (SD) was 81 (29) and the median number of perseverative errors (interquartile range) was 9 (4 to 16). The intraclass correlation coefficient (ICC) between the computerized and human assessment was 0.994 (95%CI, 0.988 to 0.996; p<0.001) and 0.991 (95%CI, 0.990 to 0.991; p<0.001) for the number of unique designs and perseverative errors, respectively. The mean difference (SD) between the computerized and human assessment was -1.42 (2.78) and +0.02 (1.94) points for the number of unique designs and perseverative errors, respectively. This was comparable to the agreement between two independent human assessments: ICC, 0.995 (0.994 to 0.995; p<0.001) and 0.985 (0.982 to 0.988; p<0.001), and mean difference (SD), -0.44 (2.98) and +0.56 (2.36) points for the number of unique designs and perseverative errors, respectively. We conclude that the agreement between the computerized and human assessment was very high and comparable to the agreement between two independent human assessments. Therefore, the software is an accurate tool for the assessment of performance on the RFFT.
| S-EPMC5035016 | biostudies-literature
Project description:The Ruff Figural Fluency Test (RFFT) was developed to avoid the difficulties that were encountered in earlier tests of figural fluency. Although the test characteristics of the RFFT seem to be good and it is a valuable addition to neuropsychological assessments, reference data are still scarce. To this aim, we required 2,404 community dwelling persons in Groningen, The Netherlands to perform the RFFT. All 1,651 persons with a complete RFFT and known educational level formed the reference sample. Their age ranged from 35 to 82 years and their educational level from primary school to university grade. Ninety-six percent of the persons were of Western European descent. All tests were analyzed by two independent examiners and subsequently three measures were calculated: number of unique designs, number of perseverative errors and error ratio. The main finding was that performance on the RFFT was dependent on age and educational level. This was not only observed in older persons but also in young and middle-aged persons. Reference data for the three RFFT measures are presented in groups of five years of age ranging from 35-39 years to 75 years or older.
| S-EPMC3037396 | biostudies-literature
Project description:Testing correlation structures has attracted extensive attention in the literature due to both its importance in real applications and several major theoretical challenges. The aim of this paper is to develop a general framework of testing correlation structures for the one-, two-, and multiple sample testing problems under a high-dimensional setting when both the sample size and data dimension go to infinity. Our test statistics are designed to deal with both the dense and sparse alternatives. We systematically investigate the asymptotic null distribution, power function, and unbiasedness of each test statistic. Theoretically, we make great efforts to deal with the non-independency of all random matrices of the sample correlation matrices. We use simulation studies and real data analysis to illustrate the versatility and practicability of our test statistics.
| S-EPMC6709985 | biostudies-literature
Project description:The World Health Organization (WHO) international standard rabies immune globulins (SRIGs) allow the standardisation of the cell-based rapid fluorescent-focus inhibition test (RFFIT) for rabies virus neutralising antibody measurement. SRIG stocks have been depleted. We describe the preparation and qualification of two internal rabies reference standards (IRRSs), calibrated against WHO SRIGs. Candidate IRRSs IMORAB2, from human rabies immunoglobulin; and GCIRAB1, from pooled serum samples from healthy adults immunised with licensed rabies vaccine, were generated. IRRSs were qualified for use in RFFIT based on pre-determined acceptance criteria. Unitage (IU/mL) was assigned using WHO-1 and WHO-2 SRIGs as calibrators. Geometric mean concentrations (GMCs) (% geometric coefficient of variation), calibrated against WHO-1 and WHO-2 SRIGs, were: 1.8 IU/mL (18.7%) and 1.5 IU/mL (17.8%) for IMORAB2; and 2.9 IU/mL (17.5%) and 2.5 IU/mL (16.7%), respectively, for GCIRAB1. We demonstrated IRRS specificity in competition studies using homologous (inactivated Pitman Moore rabies virus) and heterologous (inactivated vesicular stomatitis virus) antigens and acceptable accuracy/linearity of WHO SRIGs using IRRSs as calibrators. Concordance between IRRS and the WHO-1 SRIG was demonstrated using (non-)clinical human serum samples. The candidate reference standards are suitable for use as IRRS in the in-house rabies RFFIT. Funding:Sanofi Pasteur.
| S-EPMC7303118 | biostudies-literature
Project description:This paper deals with the detection and identification of changepoints among covariances of high-dimensional longitudinal data, where the number of features is greater than both the sample size and the number of repeated measurements. The proposed methods are applicable under general temporal-spatial dependence. A new test statistic is introduced for changepoint detection, and its asymptotic distribution is established. If a changepoint is detected, an estimate of the location is provided. The rate of convergence of the estimator is shown to depend on the data dimension, sample size, and signal-to-noise ratio. Binary segmentation is used to estimate the locations of possibly multiple changepoints, and the corresponding estimator is shown to be consistent under mild conditions. Simulation studies provide the empirical size and power of the proposed test and the accuracy of the changepoint estimator. An application to a time-course microarray dataset identifies gene sets with significant gene interaction changes over time.
| S-EPMC6690172 | biostudies-literature
Project description:The limited available treatment options for patients with chronic lung diseases, such as fibrosis, lead to poor prognosis after diagnosis and short survival rates. An exciting new bioengineering approach utilizes de- and recellularization of lung tissue to potentially overcome donor organ shortage and immune reactions toward the received transplant. The goal of decellularization is to create a scaffold which contains the necessary framework for stability and functionality for regenerating lung tissue while removing immunomodulatory factors by removal of cells. After decellularization, the scaffold could be re-functionalized by repopulation with the patient's own stem/progenitor cells to create a fully functional organ or can be used as ex vivo models of disease. In this chapter the decellularization of lung tissue from multiple species (i.e., rodents, pigs, and humans) as well as disease states such as fibrosis is described. We discuss and describe the various quality control measures which should be used to characterize decellularized scaffolds, methods for protein analysis of the remaining scaffold, and methods for recellularization of scaffolds.
| S-EPMC7456164 | biostudies-literature
Project description:An automatic item generator for figural memory test items called figumem was developed. It is available in R. A cognitive model allowed the generation of hypothetically parallel items within three difficulty levels determined by visual information load. In a pilot study, participants solved three items for each level of visual load. Within an item response theory approach, the Rasch Poisson counts model and modifications of it were fitted to the data. Results showed overall satisfying fit. Visual information load explained most of the variance in item difficulty. Differences in difficulty between items of the same family were comparatively low, displaying the utility of the item generator for the creation of parallel test forms. Implications, limitations, and suggestions for the use and extensions of figumem are discussed.
| S-EPMC7298330 | biostudies-literature
Project description:PurposeNumerous clinical guidelines are available for management of the unanticipated difficult airway. It is unclear if practice recommendations are endorsed on regional, local, or individual levels. The objective of this observational study was to examine local and regional use of airway guidelines by anesthesiologists within a hospital partnership in Southwestern Ontario.MethodsUsing a paper survey, distributed locally to consultant and trainee anesthesiologists in a tertiary hospital, we examined individual clinical and educational practices regarding guideline use in airway management. Respondents were asked to report which published guideline they used for unanticipated airway difficulty. The effectiveness of dissemination of the national Canadian airway guidelines-the Canadian Airway Focus Group (CAFG) Difficult Airway Guidelines-was examined. We invited anesthesia department heads within the regional hospital partnership to complete an electronic survey investigating departmental adoption of guidelines.ResultsThe response rate was 70% locally (79/112 anesthesiologists) and 52% regionally (11/21 department heads). Approximately 80% (64/79) of respondents reported using a formal clinical guideline if unanticipated difficulty with airway management was encountered. Seventy-two per cent of respondents (57/79) were aware of the published CAFG guidelines. Approximately 30% (16/51) of consultant anesthesiologists reported using the CAFG guidelines in clinical practice. Within the hospital partnership, 36% (4/11) of departments formally endorsed use of a specific airway management guideline.ConclusionsDespite widespread awareness of the national CAFG Difficult Airway Guidelines, they are not widely adopted in clinical practice. Further research is warranted to explore barriers to adoption of airway management guidelines for both individual anesthesiologists and anesthesia departments.
| S-EPMC8259770 | biostudies-literature
Project description:Spatial-temporal k-anonymity has become a mainstream approach among techniques for protection of users' privacy in location-based services (LBS) applications, and has been applied to several variants such as LBS snapshot queries and continuous queries. Analyzing large-scale spatial-temporal anonymity sets may benefit several LBS applications. In this paper, we propose two location prediction methods based on transition probability matrices constructing from sequential rules for spatial-temporal k-anonymity dataset. First, we define single-step sequential rules mined from sequential spatial-temporal k-anonymity datasets generated from continuous LBS queries for multiple users. We then construct transition probability matrices from mined single-step sequential rules, and normalize the transition probabilities in the transition matrices. Next, we regard a mobility model for an LBS requester as a stationary stochastic process and compute the n-step transition probability matrices by raising the normalized transition probability matrices to the power n. Furthermore, we propose two location prediction methods: rough prediction and accurate prediction. The former achieves the probabilities of arriving at target locations along simple paths those include only current locations, target locations and transition steps. By iteratively combining the probabilities for simple paths with n steps and the probabilities for detailed paths with n-1 steps, the latter method calculates transition probabilities for detailed paths with n steps from current locations to target locations. Finally, we conduct extensive experiments, and correctness and flexibility of our proposed algorithm have been verified.
| S-EPMC4980015 | biostudies-literature