Linking existing instruments to develop a continuum of care measure: accuracy comparison using function-related group classification.
Ontology highlight
ABSTRACT: Purposes
To compare measurement accuracy of test forms with varied number of items (13, 8, and 4 items) generated from the self-care physical function item bank composed of Functional Independence Measure (FIM™) and the Minimum Data Set (MDS).Methods
Retrospective data analysis of 2499 Veterans who completed both FIM and MDS within 6 days. We compared measurement accuracy between the converted FIM (FIMc) motor score generated from the MDS and the original FIM (FIMa) motor score (13 items) at: (a) individual-level using point differences, and (b) group-level using function-related group (FRG).Results
The differences of mean FIMa and FIMc scores were between 0.05 and 1.07 points for all test forms. Over 81% of FIMc from MDS_13 were within 15 points of the FIMa. 81-90% of FRGs generated by the FIM short forms was identical to those generated by the FIMa for stroke, lower limb amputation, knee and hip replacement; and 59.9-90.5% by all MDS test forms. All MDS test forms had above 74% agreement with same or adjacent FMGs (ICC 0.65-0.91).Conclusions
The accuracy is dependent on the comparison level (i.e., individual or group), length of the test and which FRG is used. Our results partially support using existing instruments-without decreasing the number of the items-to generate a continuum of care measurement.
SUBMITTER: Li CY
PROVIDER: S-EPMC8489266 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Classification approaches have been increasingly applied to differentiate patients and normal controls using resting-state functional magnetic resonance imaging data (RS-fMRI). Although most previous classification studies have reported promising accuracy within individual datasets, achieving high levels of accuracy with multiple datasets remains challenging for two main reasons: high dimensionality, and high variability across subjects. We used two independent RS-fMRI datasets (n = 31, 46, respectively) both with eyes closed (EC) and eyes open (EO) conditions. For each dataset, we first reduced the number of features to a small number of brain regions with paired t-tests, using the amplitude of low frequency fluctuation (ALFF) as a metric. Second, we employed a new method for feature extraction, named the PAIR method, examining EC and EO as paired conditions rather than independent conditions. Specifically, for each dataset, we obtained EC minus EO (EC-EO) maps of ALFF from half of subjects (n = 15 for dataset-1, n = 23 for dataset-2) and obtained EO-EC maps from the other half (n = 16 for dataset-1, n = 23 for dataset-2). A support vector machine (SVM) method was used for classification of EC RS-fMRI mapping and EO mapping. The mean classification accuracy of the PAIR method was 91.40% for dataset-1, and 92.75% for dataset-2 in the conventional frequency band of 0.01-0.08 Hz. For cross-dataset validation, we applied the classifier from dataset-1 directly to dataset-2, and vice versa. The mean accuracy of cross-dataset validation was 94.93% for dataset-1 to dataset-2 and 90.32% for dataset-2 to dataset-1 in the 0.01-0.08 Hz range. For the UNPAIR method, classification accuracy was substantially lower (mean 69.89% for dataset-1 and 82.97% for dataset-2), and was much lower for cross-dataset validation (64.69% for dataset-1 to dataset-2 and 64.98% for dataset-2 to dataset-1) in the 0.01-0.08 Hz range. In conclusion, for within-group design studies (e.g., paired conditions or follow-up studies), we recommend the PAIR method for feature extraction. In addition, dimensionality reduction with strong prior knowledge of specific brain regions should also be considered for feature selection in neuroimaging studies.
| S-EPMC5767225 | biostudies-literature
Project description:Despite the multitude of health challenges faced by adults living with HIV, we know of no HIV-specific instrument developed for the purpose of describing the health-related consequences of HIV, a concept known as disability. In a previous phase of research, adults living with HIV conceptualized disability as symptoms/impairments, difficulties carrying out day-to-day activities, challenges to social inclusion, and uncertainty that may fluctuate on a daily basis and over the course of living with HIV. In this paper, we describe the extent to which existing HIV-specific health-status instruments capture the experience of disability for adults living with HIV.We searched databases from 1980 to 2006 for English language, HIV-specific, self-reported questionnaires consisting of at least two items that were tested for reliability and validity. We then conducted a content analysis to assess how well existing questionnaires describe disability as defined by the Episodic Disability Framework, a framework that conceptualizes this experience from the perspective of adults living with HIV. We matched items of the instruments with categories of the framework to evaluate the extent to which the instruments capture major dimensions of disability in the framework.We reviewed 4274 abstracts, of which 30 instruments met the inclusion criteria and were retrieved. Of the four major dimensions of disability, symptoms/impairments were included in all 30 instruments, difficulties with day-to-day activities in 16, challenges to social inclusion in 16, and uncertainty in 9. Seven instruments contained at least 1 item from all 4 dimensions of disability (breadth) however, the comprehensiveness with which the dimensions were represented (depth) varied among the instruments.In general, symptoms/impairments and difficulties carrying out day-to-day activities were the disability dimensions characterized in greatest depth while uncertainty and challenges to social inclusion were less well represented. Although none of the instruments described the full breadth and depth of disability as conceptualized by the Episodic Disability Framework, they provide a foundation from which to build a measure of disability for adults living with HIV.
| S-EPMC2936441 | biostudies-literature
Project description:Powerful detectors at modern experimental facilities routinely collect data at multiple GB/s. Online analysis methods are needed to enable the collection of only interesting subsets of such massive data streams, such as by explicitly discarding some data elements or by directing instruments to relevant areas of experimental space. Thus, methods are required for configuring and running distributed computing pipelines-what we call flows-that link instruments, computers (e.g., for analysis, simulation, artificial intelligence [AI] model training), edge computing (e.g., for analysis), data stores, metadata catalogs, and high-speed networks. We review common patterns associated with such flows and describe methods for instantiating these patterns. We present experiences with the application of these methods to the processing of data from five different scientific instruments, each of which engages powerful computers for data inversion,model training, or other purposes. We also discuss implications of such methods for operators and users of scientific facilities.
| S-EPMC9583115 | biostudies-literature
Project description:Reliable and valid measurement of behavioural and psychological symptoms of dementia (BPSD) is important for research and clinical practice. Here we provide an overview of the different instruments and discuss issues involved in the choice of the most appropriate instrument to measure BPSD in research. A list of BPSD instruments was generated. For each instrument Pubmed and SCOPUS were searched for articles that reported on their use or quality. Eighty-three instruments that are used to measure BPSD were identified. Instruments differ in length and detail, whether the interview is with participants, informants or by observation, the target sample and the time frames for use. Reliability and validity is generally good, but reported in few independent samples. When choosing a BPSD instrument for research the research question should be carefully scrutinised and the symptoms of interest, population, quality, detail, time frame and practical issues should be considered.
| S-EPMC6878288 | biostudies-literature
Project description:Background/objectivePlaying a wind instrument implies rhythmic jaw movements where the embouchure applies forces with different directions and intensities towards the orofacial structures. These features are relevant when comparing the differences between a clarinettist and a saxophone player embouchure, independently to the fact that both belong to the single-reed instrument group, making therefore necessary to update the actual classification.MethodsLateral cephalograms were taken to single-reed, double-reed and brass instrumentalists with the purpose of analyzing the relationship of the mouthpiece and the orofacial structures.ResultsThe comparison of the different wind instruments showed substantial differences. Therefore the authors purpose a new classification of wind instruments: Class 1 single-reed mouthpiece, division 1- clarinet, division 2 -saxophone; Class 2 double-reed instruments, division 1- oboe, division 2- bassoon; Class 3 cup-shaped mouthpiece, division 1- trumpet and French horn, division 2- trombone and tuba; Class 4 aperture mouthpieces, division 1- flute, division 2 - transversal flute and piccolo.ConclusionsElements such as dental arches, teeth and lips, assume vital importance at a new nomenclature and classification of woodwind instruments that were in the past mainly classified by the type of mouthpiece and not taking into consideration its relationship with their neighboring structures.
| S-EPMC6587030 | biostudies-literature
Project description:Imputation, the process of inferring genotypes for untyped variants, is used to identify and refine genetic association findings. Inaccuracies in imputed data can distort the observed association between variants and a disease. Many statistics are used to assess accuracy; some compare imputed to genotyped data and others are calculated without reference to true genotypes. Prior work has shown that the Imputation Quality Score (IQS), which is based on Cohen's kappa statistic and compares imputed genotype probabilities to true genotypes, appropriately adjusts for chance agreement; however, it is not commonly used. To identify differences in accuracy assessment, we compared IQS with concordance rate, squared correlation, and accuracy measures built into imputation programs. Genotypes from the 1000 Genomes reference populations (AFR N = 246 and EUR N = 379) were masked to match the typed single nucleotide polymorphism (SNP) coverage of several SNP arrays and were imputed with BEAGLE 3.3.2 and IMPUTE2 in regions associated with smoking behaviors. Additional masking and imputation was conducted for sequenced subjects from the Collaborative Genetic Study of Nicotine Dependence and the Genetic Study of Nicotine Dependence in African Americans (N = 1,481 African Americans and N = 1,480 European Americans). Our results offer further evidence that concordance rate inflates accuracy estimates, particularly for rare and low frequency variants. For common variants, squared correlation, BEAGLE R2, IMPUTE2 INFO, and IQS produce similar assessments of imputation accuracy. However, for rare and low frequency variants, compared to IQS, the other statistics tend to be more liberal in their assessment of accuracy. IQS is important to consider when evaluating imputation accuracy, particularly for rare and low frequency variants.
| S-EPMC4601794 | biostudies-literature
Project description:BackgroundThe COVID-19 pandemic has become a source of fear across the world. Measuring the level or significance of fear in different populations may help identify populations and areas in need of public health and education campaigns. We were interested in diagnostic tests developed to assess or diagnose COVID-19-related fear or phobia.MethodsWe performed a systematic review of studies that examined instruments diagnosing or assessing fear or phobia of COVID-19 (PROSPERO registration: CRD42020197100). We utilized the Norwegian Institute of Public Health's Live map of covid-19 evidence, a database of pre-screened and pre-categorized studies. The Live map of covid-19 evidence identified references published since 1 December 2019 in MEDLINE, Embase, and the Centers for Disease Control and Prevention. Following biweekly searches, two researchers independently categorized all studies according to topic (seven main topics, 52 subordinate topics), population (41 available groups), study design, and publication type. For this review, we assessed for eligibility all studies that had been categorized to the topic "Experiences and perceptions, consequences; social, political, economic aspects" as of 25 September 2020, in addition to hand-searching included studies' reference lists. We meta-analyzed correlation coefficients of fear scores to the most common reference tests (self-reports of anxiety, depression, and stress), and reported additional concurrent validity to other reference tests such as specific phobias. We assessed study quality using the QUADAS-2 for the minority of studies that presented diagnostic accuracy statistics.ResultsWe found 18 studies that validated fear instruments. Fifteen validated the Fear of COVID-19 scale (FCV-19S). We found no studies that proposed a diagnosis of fear of COVID-19 or a threshold of significant/clinical versus non-significant/subclinical fear. Study quality was low, with the most common potential biases related to sampling strategy and un-blinded data analysis. The FSV-19S total score correlated strongly with severe phobia (r = 0.703, 95%CI 0.634-0.761) in one study, and moderately with anxiety in a meta-analysis.ConclusionsThe accuracy of the FSV-19S needs to be measured further using fear-related reference instruments, and future studies need to provide cut-off scores and normative values. Further evaluation of the remaining three instruments is required.
| S-EPMC8064424 | biostudies-literature
Project description:Foot self-care is an important element of caring for and promoting foot health. However, little is known about the validity and reliability of existing foot self-care instruments. The purpose of this review is to describe and analyze the focus, content, and psychometric evidence of existing instruments for measuring foot self-care. A methodological review of three international scientific databases-Medline (PubMed), CINAHL (Ebsco), and Embase-was conducted in May 2022. The search produced 3520 hits, of which 53 studies were included in the final analysis based on a two-phase selection process. A total of 31 instruments were identified, of which six were observed to have been used more than once. Subsequently, the methodological quality of these six instruments was evaluated. It is noted that although a considerable variety of instruments are used in measuring foot self-care, only a small proportion are used consistently. In general, the psychometric testing instruments seem to primarily focus on analyzing content validity and homogeneity. In the future, comprehensive testing of instrument psychometrics could enhance the cumulative evidence of the methodological quality of these instruments. Furthermore, researchers and clinicians can use the information in this review to make informed choices when selecting an instrument for their purposes.
| S-EPMC10052648 | biostudies-literature
Project description:Fentanyl is an anesthetic with a high bioavailability and is the leading cause of drug overdose death in the U.S. Fentanyl and its derivatives have a low lethal dose and street drugs which contain such compounds may lead to death of the user and simultaneously pose hazards for first responders. Rapid identification methods of both known and emerging opioid fentanyl substances is crucial. In this effort, machine learning (ML) is applied in a systematic manner to identify fentanyl-related functional groups in such compounds based on their observed spectral properties. In our study, accurate infrared (IR) spectra of common organic molecules which contain functional groups that are constituents of fentanyl is determined by investigating the structure-property relationship. The average accuracy rate of correctly identifying the functional groups of interest is 92.5% on our testing data. All the IR spectra of 632 organic molecules are from National Institute of Standards and Technology (NIST) database as the training set and are assessed. Results from this work will provide Artificial Intelligence (AI) based tools and algorithms increased confidence, which serves as a basis to detect fentanyl and its derivatives.
| S-EPMC7419312 | biostudies-literature
Project description:Polygenic scores (PGSs) have limited portability across different groupings of individuals (for example, by genetic ancestries and/or social determinants of health), preventing their equitable use1-3. PGS portability has typically been assessed using a single aggregate population-level statistic (for example, R2)4, ignoring inter-individual variation within the population. Here, using a large and diverse Los Angeles biobank5 (ATLAS, n = 36,778) along with the UK Biobank6 (UKBB, n = 487,409), we show that PGS accuracy decreases individual-to-individual along the continuum of genetic ancestries7 in all considered populations, even within traditionally labelled 'homogeneous' genetic ancestries. The decreasing trend is well captured by a continuous measure of genetic distance (GD) from the PGS training data: Pearson correlation of -0.95 between GD and PGS accuracy averaged across 84 traits. When applying PGS models trained on individuals labelled as white British in the UKBB to individuals with European ancestries in ATLAS, individuals in the furthest GD decile have 14% lower accuracy relative to the closest decile; notably, the closest GD decile of individuals with Hispanic Latino American ancestries show similar PGS performance to the furthest GD decile of individuals with European ancestries. GD is significantly correlated with PGS estimates themselves for 82 of 84 traits, further emphasizing the importance of incorporating the continuum of genetic ancestries in PGS interpretation. Our results highlight the need to move away from discrete genetic ancestry clusters towards the continuum of genetic ancestries when considering PGSs.
| S-EPMC10284707 | biostudies-literature