Dataset Information

External validation of the Hong Kong Chinese non-laboratory risk models and scoring algorithm for case finding of prediabetes and diabetes mellitus in primary care.

ABSTRACT:

Aims/introduction

Two Hong Kong Chinese non-laboratory-based prediabetes/diabetes mellitus (pre-DM/DM) risk models were developed using logistic regression (LR) and machine learning, respectively. We aimed to evaluate the models' validity in case finding of pre-DM/DM in a Chinese primary care (PC) population. We also evaluated the validity of a risk-scoring algorithm derived from the LR model.

Materials and methods

This was a cross-sectional external validation study on Chinese adults, without a prior DM diagnosis, who were recruited from public/private PC clinics in Hong Kong. A total of 1,237 participants completed a questionnaire on the models' predictors. Of that, 919 underwent blood glucose testing. The primary outcome was the models' and the algorithm's sensitivity in finding pre-DM/DM cases. The secondary outcomes were the models' and the algorithm's specificity, positive/negative predictive values, discrimination and calibration.

Results

The models' sensitivity were 0.70 (machine learning) and 0.72 (LR). Both showed good external discrimination (area under the receiver operating characteristic curve: machine learning 0.744, LR 0.739). The risks estimated by the models were lower than the observed incidence, indicating poor calibration. Both models were more effective among participants with lower pretest probabilities; that is, age 18-44 years. The algorithm's sensitivity was 0.77 at the cut-off score of ≥16 out of 41.

Conclusion

This study showed the validity of the models and the algorithm for finding pre-DM/DM cases in a Chinese PC population in Hong Kong. They can facilitate more cost-effective identification of high-risk individuals for blood testing to diagnose pre-DM/DM in PC. Further studies should recalibrate the models for more precise risk estimation in PC populations.

SUBMITTER: Cheng WH

PROVIDER: S-EPMC11363091 | biostudies-literature | 2024 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

External validation of the Hong Kong Chinese non-laboratory risk models and scoring algorithm for case finding of prediabetes and diabetes mellitus in primary care.

Cheng Will Hg WH Dong Weinan W Tse Emily Ty ET Wong Carlos Kh CK Chin Weng Y WY Bedford Laura E LE Fong Daniel Yt DY Ko Welchie Wk WW Chao David Vk DV Tan Kathryn Cb KC Lam Cindy Lk CL

Journal of diabetes investigation 20240621 9

<h4>Aims/introduction</h4>Two Hong Kong Chinese non-laboratory-based prediabetes/diabetes mellitus (pre-DM/DM) risk models were developed using logistic regression (LR) and machine learning, respectively. We aimed to evaluate the models' validity in case finding of pre-DM/DM in a Chinese primary care (PC) population. We also evaluated the validity of a risk-scoring algorithm derived from the LR model.<h4>Materials and methods</h4>This was a cross-sectional external validation study on Chinese ad ...[more]

PMID: 39212338

Similar Datasets

Project description:IntroductionDiabetes mellitus (DM) is a major non-communicable disease with an increasing prevalence. Undiagnosed DM is not uncommon and can lead to severe complications and mortality. Identifying high-risk individuals at an earlier disease stage, that is, pre-diabetes (pre-DM), is crucial in delaying progression. Existing risk models mainly rely on non-modifiable factors to predict only the DM risk, and few apply to Chinese people. This study aims to develop and validate a risk prediction function that incorporates modifiable lifestyle factors to detect DM and pre-DM in Chinese adults in primary care.Methods and analysisA cross-sectional study to develop DM/Pre-DM risk prediction functions using data from the Hong Kong's Population Health Survey (PHS) 2014/2015 and a 12-month prospective study to validate the functions in case finding of individuals with DM/pre-DM. Data of 1857 Chinese adults without self-reported DM/Pre-DM will be extracted from the PHS 2014/2015 to develop DM/Pre-DM risk models using logistic regression and machine learning methods. 1014 Chinese adults without a known history of DM/Pre-DM will be recruited from public and private primary care clinics in Hong Kong. They will complete a questionnaire on relevant risk factors and blood tests on Oral Glucose Tolerance Test (OGTT) and haemoglobin A1C (HbA1c) on recruitment and, if the first blood test is negative, at 12 months. A positive case is DM/pre-DM defined by OGTT or HbA1c in any blood test. Area under receiver operating characteristic curve, sensitivity, specificity, positive predictive value and negative predictive value of the models in detecting DM/pre-DM will be calculated.Ethics and disseminationEthics approval has been received from The University of Hong Kong/Hong Kong Hospital Authority Hong Kong West Cluster (UW19-831) and Hong Kong Hospital Authority Kowloon Central/Kowloon East Cluster (REC(KC/KE)-21-0042/ER-3). The study results will be submitted for publication in a peer-reviewed journal.Trial registration numberUS ClinicalTrial.gov: NCT04881383; HKU clinical trials registry: HKUCTR-2808; Pre-results.

Project description:BackgroundConsultation rates of influenza-like illness (ILI) in an outpatient setting have been regarded as a good indicator of influenza virus activity in the community. As ILI-like symptoms may be caused by etiologies other than influenza, and influenza virus activity in the tropics and subtropics is less predictable than in temperate regions, the correlation between of ILI and influenza virus activity in tropical and subtropical regions is less well defined.Methodology and principal findingsIn this study, we used wavelet analysis to investigate the relationship between seasonality of influenza virus activity and consultation rates of ILI reported separately by General Out-patient Clinics (GOPC) and General Practitioners (GP). During the periods 1998-2000 and 2002-2003, influenza virus activity exhibited both annual and semiannual cycles, with one peak in the winter and another in late spring or early summer. But during 2001 and 2004-2006, only annual cycles could be clearly identified. ILI consultation rates in both GOPC and GP settings share a similar non-stationary seasonal pattern. We found high coherence between ILI in GOPC and influenza virus activity for the annual cycle, but this was only significant (p<0.05) during the periods 1998-1999 and 2002-2006. For the semiannual cycle high coherence (p<0.05) was also found significant during the period 1998-1999 and year 2003 when two peaks of influenza were evident. Similarly, ILI in GP setting is also associated with influenza virus activity for both the annual and semiannual cycles. On average, oscillation of ILI in GP and of ILI in GOPC preceded influenza virus isolation by approximately four and two weeks, respectively.ConclusionsOur findings suggest that consultation rates of ILI precede the oscillations of laboratory surveillance by at least two weeks and can be used as a predictor for influenza epidemics in Hong Kong. The validity of our model for other tropical regions needs to be explored.

Project description:BackgroundThe vast majority of individuals with familial hypercholesterolaemia in the general population remain unidentified worldwide. Recognising patients most likely to have the condition, to enable targeted specialist assessment and treatment, could prevent major coronary morbidity and mortality. We aimed to evaluate a clinical case-finding algorithm, the familial hypercholesterolaemia case ascertainment tool (FAMCAT), and compare it with currently recommended methods for detection of familial hypercholesterolaemia in primary care.MethodsIn this external validation study, FAMCAT regression equations were applied to a retrospective cohort of patients aged 16 years or older with cholesterol assessed, who were randomly selected from 1500 primary care practices across the UK contributing to the QResearch database. In the main analysis, we assessed the ability of FAMCAT to detect familial hypercholesterolaemia (ie, its discrimination) and compared it with that of other established clinical case-finding approaches recommended internationally (Simon Broome, Dutch Lipid Clinic Network, Make Early Diagnosis to Prevent Early Deaths [MEDPED] and cholesterol concentrations higher than the 99th percentile of the general population in the UK). We assessed discrimination by area under the receiver operating curve (AUROC; ranging from 0·5, indicating pure chance, to 1, indicating perfect discrimination). Using a probability threshold of more than 1 in 500 (prevalence of familial hypercholesterolaemia), we also assessed sensitivity, specificity, positive predictive values, and negative predictive values in the main analysis.FindingsA sample of 750 000 patients who registered in 1500 UK primary care practices that contribute anonymised data to the QResearch database between Jan 1, 1999, and Sept 1, 2017, was randomly selected, of which 747 000 patients were assessed. FAMCAT showed a high degree of discrimination (AUROC 0·832, 95% CI 0·820-0·845), which was higher than that of Simon Broome criteria (0·694, 0·681-0·703), Dutch Lipid Clinic Network criteria (0·724, 0·710-0·738), MEDPED criteria (0·624, 0·609-0·638), and screening cholesterol concentrations higher than the 99th percentile (0·581, 0·570-0·591). Using a 1 in 500 probability threshold, FAMCAT achieved a sensitivity of 84% (1028 predicted vs 1219 observed cases) and specificity of 60% (443 949 predicted vs 745 781 observed non-cases), with a corresponding positive predictive value of 0·84% and a negative predictive value of 99·2%.InterpretationFAMCAT identifies familial hypercholesterolaemia with greater accuracy than currently recommended approaches and could be considered for clinical case finding of patients with the highest likelihood of having hypercholesterolaemia in primary care.FundingUK National Institute for Health Research School for Primary Care Research.

Project description:Coronary artery disease (CAD), the most common manifestation of cardiovascular disease, remains the most common cause of mortality in the United States. Risk assessment is key for primary prevention of coronary events and coronary artery calcium (CAC) scoring using computed tomography (CT) is one such non-invasive tool. Despite the proven clinical value of CAC, the current clinical practice implementation for CAC has limitations such as the lack of insurance coverage for the test, need for capital-intensive CT machines, specialized imaging protocols, and accredited 3D imaging labs for analysis (including personnel and software). Perhaps the greatest gap is the millions of patients who undergo routine chest CT exams and demonstrate coronary artery calcification, but their presence is not often reported or quantitation is not feasible. We present two deep learning models that automate CAC scoring demonstrating advantages in automated scoring for both dedicated gated coronary CT exams and routine non-gated chest CTs performed for other reasons to allow opportunistic screening. First, we trained a gated coronary CT model for CAC scoring that showed near perfect agreement (mean difference in scores = -2.86; Cohen's Kappa = 0.89, P < 0.0001) with current conventional manual scoring on a retrospective dataset of 79 patients and was found to perform the task faster (average time for automated CAC scoring using a graphics processing unit (GPU) was 3.5 ± 2.1 s vs. 261 s for manual scoring) in a prospective trial of 55 patients with little difference in scores compared to three technologists (mean difference in scores = 3.24, 5.12, and 5.48, respectively). Then using CAC scores from paired gated coronary CT as a reference standard, we trained a deep learning model on our internal data and a cohort from the Multi-Ethnic Study of Atherosclerosis (MESA) study (total training n = 341, Stanford test n = 42, MESA test n = 46) to perform CAC scoring on routine non-gated chest CT exams with validation on external datasets (total n = 303) obtained from four geographically disparate health systems. On identifying patients with any CAC (i.e., CAC ≥ 1), sensitivity and PPV was high across all datasets (ranges: 80-100% and 87-100%, respectively). For CAC ≥ 100 on routine non-gated chest CTs, which is the latest recommended threshold to initiate statin therapy, our model showed sensitivities of 71-94% and positive predictive values in the range of 88-100% across all the sites. Adoption of this model could allow more patients to be screened with CAC scoring, potentially allowing opportunistic early preventive interventions.

Dataset Information

External validation of the Hong Kong Chinese non-laboratory risk models and scoring algorithm for case finding of prediabetes and diabetes mellitus in primary care.

Aims/introduction

Materials and methods

Results

Conclusion

Publications

External validation of the Hong Kong Chinese non-laboratory risk models and scoring algorithm for case finding of prediabetes and diabetes mellitus in primary care.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets