Taxonomy-Based Approaches to Quality Assurance of Ontologies.
Ontology highlight
ABSTRACT:
SUBMITTER: Halper M
PROVIDER: S-EPMC5660792 | biostudies-literature | 2017
REPOSITORIES: biostudies-literature
Publications
Taxonomy-Based Approaches to Quality Assurance of Ontologies.
Halper Michael M Perl Yehoshua Y Ochs Christopher C Zheng Ling L
Journal of healthcare engineering 20171011
Ontologies are important components of health information management systems. As such, the quality of their content is of paramount importance. It has been proven to be practical to develop quality assurance (QA) methodologies based on automated identification of sets of concepts expected to have higher likelihood of errors. Four kinds of such sets (called QA-sets) organized around the themes of complex and uncommonly modeled concepts are introduced. A survey of different methodologies based on ...[more]
Similar Datasets
Project description:Metabolomics promises a holistic phenotypic characterization of biological responses to toxicants. This technology is based on advanced chemical analytical tools with reasonable throughput, including mass-spectroscopy and NMR. Quality assurance, however - from experimental design, sample preparation, metabolite identification, to bioinformatics data-mining - is urgently needed to assure both quality of metabolomics data and reproducibility of biological models. In contrast to microarray-based transcriptomics, where consensus on quality assurance and reporting standards has been fostered over the last two decades, quality assurance of metabolomics is only now emerging. Regulatory use in safety sciences, and even proper scientific use of these technologies, demand quality assurance. In an effort to promote this discussion, an expert workshop discussed the quality assurance needs of metabolomics. The goals for this workshop were 1) to consider the challenges associated with metabolomics as an emerging science, with an emphasis on its application in toxicology and 2) to identify the key issues to be addressed in order to establish and implement quality assurance procedures in metabolomics-based toxicology. Consensus has still to be achieved regarding best practices to make sure sound, useful, and relevant information is derived from these new tools.
| S-EPMC5578451 | biostudies-literature
Project description:The Delta(4DVH) Anatomy 3D quality assurance (QA) system (ScandiDos), which converts the measured detector dose into the dose distribution in the patient geometry was evaluated. It allows a direct comparison of the calculated 3D dose with the measured back-projected dose. In total, 16 static and 16 volumetric-modulated arc therapy (VMAT) fields were planned using four different energies. Isocenter dose was measured with a pinpoint chamber in homogeneous phantoms to investigate the dose prediction by the Delta(4DVH) Anatomy algorithm for static fields. Dose distributions of VMAT fields were measured using GAFCHROMIC film. Gravitational gantry errors up to 10° were introduced into all VMAT plans to study the potential of detecting errors. Additionally, 20 clinical treatment plans were verified. For static fields, the Delta(4DVH) Anatomy predicted the isocenter dose accurately, with a deviation to the measured phantom dose of 1.1% ± 0.6%. For VMAT fields the predicted Delta(4DVH) Anatomy dose in the isocenter plane corresponded to the measured dose in the phantom, with an average gamma agreement index (GAI) (3 mm/3%) of 96.9± 0.4%. The Delta(4DVH) Anatomy detected the induced systematic gantry error of 10° with a relative GAI (3 mm/3%) change of 5.8% ± 1.6%. The conventional Delta(4PT) QA system detected a GAI change of 4.2%± 2.0%. The conventional Delta(4PT) GAI (3 mm/3%) was 99.8% ± 0.4% for the clinical treatment plans. The mean body and PTV-GAI (3 mm/5%) for the Delta(4DVH) Anatomy were 96.4% ± 2.0% and 97.7%± 1.8%; however, this dropped to 90.8%± 3.4% and 87.1% ± 4.1% for passing criteria of 3 mm/3%. The anatomy-based patient specific quality assurance system predicts the dose distribution correctly for a homogeneous case. The limiting factor for the error detection is the large variability in the error-free plans. The dose calculation algorithm is inferior to that used in the TPS (Eclipse).
| S-EPMC5875461 | biostudies-literature
Project description:Purpose: More and more automatic segmentation tools are being introduced in routine clinical practice. However, physicians need to spend a considerable amount of time in examining the generated contours slice by slice. This greatly reduces the benefit of the tool's automaticity. In order to overcome this shortcoming, we developed an automatic quality assurance (QA) method for automatic segmentation using convolutional neural networks (CNNs). Materials and Methods: The study cohort comprised 680 patients with early-stage breast cancer who received whole breast radiation. The overall architecture of the automatic QA method for deep learning-based segmentation included the following two main parts: a segmentation CNN model and a QA network that was established based on ResNet-101. The inputs were from computed tomography, segmentation probability maps, and uncertainty maps. Two kinds of Dice similarity coefficient (DSC) outputs were tested. One predicted the DSC quality level of each slice ([0.95, 1] for "good," [0.8, 0.95] for "medium," and [0, 0.8] for "bad" quality), and the other predicted the DSC value of each slice directly. The performances of the method to predict the quality levels were evaluated with quantitative metrics: balanced accuracy, F score, and the area under the receiving operator characteristic curve (AUC). The mean absolute error (MAE) was used to evaluate the DSC value outputs. Results: The proposed methods involved two types of output, both of which achieved promising accuracy in terms of predicting the quality level. For the good, medium, and bad quality level prediction, the balanced accuracy was 0.97, 0.94, and 0.89, respectively; the F score was 0.98, 0.91, and 0.81, respectively; and the AUC was 0.96, 0.93, and 0.88, respectively. For the DSC value prediction, the MAE was 0.06 ± 0.19. The prediction time was approximately 2 s per patient. Conclusions: Our method could predict the segmentation quality automatically. It can provide useful information for physicians regarding further verification and revision of automatic contours. The integration of our method into current automatic segmentation pipelines can improve the efficiency of radiotherapy contouring.
| S-EPMC7212344 | biostudies-literature
Project description:OBJECTIVE:Standards terminologies may be large and complex, making their quality assurance challenging. Some terminology quality assurance (TQA) methodologies are based on abstraction networks (AbNs), compact terminology summaries. We have tested AbNs and the performance of related TQA methodologies on small terminology hierarchies. However, some standards terminologies, for example, SNOMED, are composed of very large hierarchies. Scaling AbN TQA techniques to such hierarchies poses a significant challenge. We present a scalable subject-based approach for AbN TQA. METHODS:An innovative technique is presented for scaling TQA by creating a new kind of subject-based AbN called a subtaxonomy for large hierarchies. New hypotheses about concentrations of erroneous concepts within the AbN are introduced to guide scalable TQA. RESULTS:We test the TQA methodology for a subject-based subtaxonomy for the Bleeding subhierarchy in SNOMED's large Clinical finding hierarchy. To test the error concentration hypotheses, three domain experts reviewed a sample of 300 concepts. A consensus-based evaluation identified 87 erroneous concepts. The subtaxonomy-based TQA methodology was shown to uncover statistically significantly more erroneous concepts when compared to a control sample. DISCUSSION:The scalability of TQA methodologies is a challenge for large standards systems like SNOMED. We demonstrated innovative subject-based TQA techniques by identifying groups of concepts with a higher likelihood of having errors within the subtaxonomy. Scalability is achieved by reviewing a large hierarchy by subject. CONCLUSIONS:An innovative methodology for scaling the derivation of AbNs and a TQA methodology was shown to perform successfully for the largest hierarchy of SNOMED.
| S-EPMC6283060 | biostudies-literature
Project description:The regular evaluation of imaging performance of computed tomography (CT) scanners is essential for CT quality assurance. For automation of this process, the software QAMaster was developed at the Universitätsklinikum Erlangen, which provides based on CT scans of the CatPhan® 504 (The Phantom Laboratory, Salem, USA) automated image quality analysis and documentation by evaluating CT number accuracy, spatial linearity, uniformity, contrast-noise-ratio, spatial resolution, noise, and slice thickness. Dose assessment is supported by calculations of the weighted computed tomography dose index (CTDIw ) and weighted cone beam dose index (CBDIw ). QAMaster was tested with CatPhan® 504 scans and compared to manual evaluations of these scans, whereby high consistency of the respective results was observed. The CT numbers, spatial linearity, uniformity, contrast-noise-ratio, noise, and slice thickness deviated by only (0.13 ± 0.25) HU, (0.02 ± 0.05) mm, (-0.01 ± 0.03)%, 0.8 ± 1.8, (0.131 ± 0.05) HU, and (0.004 ± 0.005) mm between both evaluations, respectively. The QAMaster results for spatial resolution did not differ significantly (p = 0.34) from the CatPhan® 504 based manual resolution assessment. Dose computations were fully consistent between QAMaster and manual calculations. Thus, QAMaster proved to be a comprehensive and functional software for performing an automated CT quality assurance routine. QAMaster will be open-source after its release.
| S-EPMC8992959 | biostudies-literature
Project description:BackgroundThe verbalisation of quality standards and parameters by medical societies are relevant for qualitative improvement but may also be an instrument to demand more resources for health care or be a unique characteristic. Within the health care system 3 different quality levels can be defined: structure, process and result quality.MethodsThe current S2k guideline of the German Society for Gastroenterology (quality requirements for gastrointestinal endoscopy) AWMF registry no. 021-022 provides recommendations based on the available evidence for the structure quality (requirements for equipment, human resources) as well as for the process quality (patient preparation, conduct, documentation) and result quality (follow-up of specific endoscopic procedures).ResultsBased on these recommendations, measurable quality indicators/parameters for the endoscopy have been selected and formulated. General quality parameters for endoscopic examinations are given as well as quality parameters for specific procedures for the preparation, conduct, and follow-up of specific endoscopic interventions.ConclusionOnly the regular review of processes and courses by means of defined measurement parameters builds up the basis for corrections based on facts. In addition, the implementation of recommended standards may be an instrument in demanding more resources from the health care system and, therefore, should be embedded as routine.
| S-EPMC4988246 | biostudies-literature
Project description:Gene Ontology (GO) is widely used in the biological domain. It is the most comprehensive ontology providing formal representation of gene functions (GO concepts) and relations between them. However, unintentional quality defects (e.g. missing or erroneous relations) in GO may exist due to the large size of GO concepts and complexity of GO structures. Such quality defects would impact the results of GO-based analyses and applications. In this work, we introduce a novel evidence-based lexical pattern approach for quality assurance of GO relations. We leverage two layers of evidence to suggest potentially missing relations in GO as follows. We first utilize related concept pairs (i.e. existing relations) in GO to extract relationship-specific lexical patterns, which serve as the first layer evidence to automatically suggest potentially missing relations between unrelated concept pairs. For each suggested missing relation, we further identify two other existing relations as the second layer of evidence that resemble the difference between the missing relation and the existing relation based on which the missing relation is suggested. Applied to the 15 December 2021 release of GO, this approach suggested a total of 866 potentially missing relations. Local domain experts evaluated the entire set of potentially missing relations, and identified 821 as missing relations and 45 indicate erroneous existing relations. We submitted these findings to the GO consortium for further validation and received encouraging feedback. These indicate that our evidence-based approach can be utilized to uncover missing relations and erroneous existing relations in GO.
| S-EPMC9116247 | biostudies-literature
Project description:This SuperSeries is composed of the SubSeries listed below.
2022-10-19 | GSE196553 | GEO
Project description:To develop and implement a failure mode and effect analysis (FMEA)-based commissioning and quality assurance framework for dynamic multileaf collimator (DMLC) tumor tracking systems.A systematic failure mode and effect analysis was performed for a prototype real-time tumor tracking system that uses implanted electromagnetic transponders for tumor position monitoring and a DMLC for real-time beam adaptation. A detailed process tree of DMLC tracking delivery was created and potential tracking-specific failure modes were identified. For each failure mode, a risk probability number (RPN) was calculated from the product of the probability of occurrence, the severity of effect, and the detectibility of the failure. Based on the insights obtained from the FMEA, commissioning and QA procedures were developed to check (i) the accuracy of coordinate system transformation, (ii) system latency, (iii) spatial and dosimetric delivery accuracy, (iv) delivery efficiency, and (v) accuracy and consistency of system response to error conditions. The frequency of testing for each failure mode was determined from the RPN value.Failures modes with RPN > or = 125 were recommended to be tested monthly. Failure modes with RPN < 125 were assigned to be tested during comprehensive evaluations, e.g., during commissioning, annual quality assurance, and after major software/hardware upgrades. System latency was determined to be approximately 193 ms. The system showed consistent and accurate response to erroneous conditions. Tracking accuracy was within 3%-3 mm gamma (100% pass rate) for sinusoidal as well as a wide variety of patient-derived respiratory motions. The total time taken for monthly QA was approximately 35 min, while that taken for comprehensive testing was approximately 3.5 h.FMEA proved to be a powerful and flexible tool to develop and implement a quality management (QM) framework for DMLC tracking. The authors conclude that the use of FMEA-based QM ensures efficient allocation of clinical resources because the most critical failure modes receive the most attention. It is expected that the set of guidelines proposed here will serve as a living document that is updated with the accumulation of progressively more intrainstitutional and interinstitutional experience with DMLC tracking.
| S-EPMC3016096 | biostudies-other
Project description:PurposeIn the context of national calls for reorganizing cancer clinical trials, the National Cancer Institute sponsored a 2-day workshop to examine challenges and opportunities for optimizing radiotherapy quality assurance (QA) in clinical trial design.Methods and materialsParticipants reviewed the current processes of clinical trial QA and noted the QA challenges presented by advanced technologies. The lessons learned from the radiotherapy QA programs of recent trials were discussed in detail. Four potential opportunities for optimizing radiotherapy QA were explored, including the use of normal tissue toxicity and tumor control metrics, biomarkers of radiation toxicity, new radiotherapy modalities such as proton beam therapy, and the international harmonization of clinical trial QA.ResultsFour recommendations were made: (1) to develop a tiered (and more efficient) system for radiotherapy QA and tailor the intensity of QA to the clinical trial objectives (tiers include general credentialing, trial-specific credentialing, and individual case review); (2) to establish a case QA repository; (3) to develop an evidence base for clinical trial QA and introduce innovative prospective trial designs to evaluate radiotherapy QA in clinical trials; and (4) to explore the feasibility of consolidating clinical trial QA in the United States.ConclusionRadiotherapy QA can affect clinical trial accrual, cost, outcomes, and generalizability. To achieve maximum benefit, QA programs must become more efficient and evidence-based.
| S-EPMC3361528 | biostudies-literature