Independent validation of a model using cell line chemosensitivity to predict response to therapy.
Ontology highlight
ABSTRACT: Background
Methods using cell line microarray and drug sensitivity data to predict patients' chemotherapy response are appealing, but groups may be reluctant to release details to preserve intellectual property. Here we describe a case study to validate predictions while treating the methods as a "black box."Methods
Medical Prognosis Institute (MPI) constructed cell-line-derived sensitivity scores (SSs) and combined scores (CSs) that incorporate clinical variables. MD Anderson researchers evaluated their predictions. We searched the Gene Expression Omnibus (GEO) to identify validation datasets, and we performed statistical evaluation of the agreement between prediction and clinical observation.Results
We identified 3 suitable datasets: GSE16446 (n = 120; binary outcome), GSE17920 (n = 130; binary outcome), and GSE10255 (n = 161; continuous and time-to-event outcomes). The SS was statistically significantly associated with primary treatment responses for all studies (GSE16446: P = .02; GSE17920: P = .02; GSE10255: P = .02). Dichotomized SSs performed no better than chance for GSE16446 and GSE17920, and categorized SSs did not predict disease-free survival (GSE10255). SSs sometimes improved on predictions using clinical variables (GSE16446: P = .05; GSE17920: P = .31; GSE10255: P = .045), but gains were limited (95% confidence intervals for GSE16446 and GSE17920 include 0). The CS did not predict treatment response for GSE16446 (P = .55), but it did for GSE17920 (P < .001). Coefficients of clinical variables provided by MPI for CSs agree with estimates for GSE17920 better than estimates for GSE16446.Conclusions
Model predictions were better than chance in all three datasets. However, these scores added little to existing clinical predictors; statistically significant contributions were likely to be too small to change clinical practice. These findings suggest that discovering better predictors will require both cell line data and a clinical training dataset of patient samples.
SUBMITTER: Wang W
PROVIDER: S-EPMC3955959 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:An increasing number of cryo-electron microscopy (cryo-EM) density maps are being generated with suitable resolution to trace the protein backbone and guide sidechain placement. Generating and evaluating atomic models based on such maps would be greatly facilitated by independent validation metrics for assessing the fit of the models to the data. We describe such a metric based on the fit of atomic models with independent test maps from single particle reconstructions not used in model refinement. The metric provides a means to determine the proper balance between the fit to the density and model energy and stereochemistry during refinement, and is likely to be useful in determining values of model building and refinement metaparameters quite generally.
| S-EPMC3690725 | biostudies-literature
Project description:A total of 20 KYSE human esophageal squamous cell carcinoma cell lines (KYSE-30, -140, -150, -170, -180, -200, -220, -350, -410, -450, -510, -520, -590, -770, -850, -890, -1170, -1190, -1250, and -2270) and a non-cancerous esophageal epithelial cell (HEEC-1)were kindly provided by Dr. Y. Shimada (Kyoto University, Kyoto, Japan). The KYSE cell lines were cultured in RPMI 1640 medium (Life Technologies, Inc., Grand Island, NY) containing 10% heat-inactivated fetal bovine serum (FBS; BioWhittaker, Verviers, Belgium) in a humidified atmosphere of 5% CO2 and maintained in continuous exponential growth by passage every 3 days. HEEC-1 cells were cultured in Keratinocyte SFM medium with growth supplement containing 2.5 mg EGF and 25 mg bovine pituitary extract in 500 mL liquid basal medium (GIBCO BRL, Rockville, MD) and expanded by passage twice in a week. The exponentially growing cultured cells (2 x 10^6) were collected after two-washings with PBS. Total RNA was prepared from the frozen cell pellets using QIAGEN RNeasy mini kit (QIAGEN, Inc., Valencia, CA), and mRNA was purified using MACS mRNA Isolation kit (Miltenyi Biotec, Bergisch Gladbach, Germany) according to the supplier’s protocols. RIKEN human 21K array containing 20,784 clones with positive and negative controls was used to analyze gene expression of 20 KYSE esophageal cancer cell lines using HEEC-1 as reference. The target DNAs used to construct human 21 K array were the glycerol stock of cDNA clones purchased from ResGen (Invitrogen Corporation, Carlsbad, CA)). One-microgram poly(A) RNAs from KYSE cells and the reference cells were labeled with Cy3-dCTP and Cy5-dCTP, respectively, by random-primed reverse transcription. Arrays were laser-scanned using ScanArray 5000TM confocal laser scanner (GSI Lumonics, Billerica, MA), and the images were analyzed using ScanAlyzeTM (Stanford University). All experiments were performed in duplicate (_1 & _2). Keywords: parallel sample
2005-12-31 | GSE2454 | GEO
Project description:A total of 20 KYSE human esophageal squamous cell carcinoma cell lines (KYSE-30, -140, -150, -170, -180, -200, -220, -350, -410, -450, -510, -520, -590, -770, -850, -890, -1170, -1190, -1250, and -2270) were kindly provided by Dr. Y. Shimada (Kyoto University, Kyoto, Japan). The KYSE cell lines were cultured in RPMI 1640 medium (Life Technologies, Inc., Grand Island, NY) containing 10% heat-inactivated fetal bovine serum (FBS; BioWhittaker, Verviers, Belgium) in a humidified atmosphere of 5% CO2 and maintained in continuous exponential growth by passage every 3 days. The exponentially growing cultured cells (2 x 10^6) were collected after two-washings with PBS. Total RNA was prepared from the frozen cell pellets using QIAGEN RNeasy mini kit (QIAGEN, Inc., Valencia, CA). The quality of the RNA was checked using Agilent Technologies 2100 Bioanalyzer (Agilent, Palo Alto, CA). CodeLink Expression Bioarray System (Amersham Bioscience, Tokyo, Japan) was used according to the manufacturer’s protocol. Briefly, first-strand cDNA was generated from 1 µg of total RNA for each cell line using reverse transcriptase and a T7 primer, and then second-strand cDNA was produced using DNA polymerase mix and RNase H. cRNA was generated via an in vitro transcription reacrion using T7 RNA polymerase and biotin-11-UTP (Perkin Elmer, Boston, MA). After quantified by spectrometry and qualified using Agilent Technologies 2100 Bioanalyzer (Agilent), 10 µg of cRNA was fragmented and hybridized to a Uniset Human 20K I Bioarray containing 19,981 human probes with 108 positive and 300 negative bacterial control probes. After hybridization, the arrays were rinsed and labeled with Streptavidin-Cy5, scanned using Agilent DNA Microarray Scanner (Agilent), then analyzed with CodeLink Expression Analysis Software ver.2.3. Expression levels were normalized to the median expression value of the whole array spots except for the bacterial controls. Keywords: parallel sample
2005-12-31 | GSE2447 | GEO
Project description:BackgroundPredicting patient drug response based on a patient's molecular profile is one of the key goals of precision medicine in breast cancer (BC). Multiple drug response prediction models have been developed to address this problem. However, most of them were developed to make sensitivity predictions for multiple single drugs within cell lines from various cancer types instead of a single cancer type, do not take into account drug properties, and have not been validated in cancer patient-derived data. Among the multi-omics data, gene expression profiles have been shown to be the most informative data for drug response prediction. However, these models were often developed with individual genes. Therefore, this study aimed to develop a drug response prediction model for BC using multiple data types from both cell lines and drugs.MethodsWe first collected the baseline gene expression profiles of 49 BC cell lines along with IC50 values for 220 drugs tested in these cell lines from Genomics of Drug Sensitivity in Cancer (GDSC). Using these data, we developed a multiple-layer cell line-drug response network (ML-CDN2) by integrating a one-layer cell line similarity network based on the pathway activity profiles and a three-layer drug similarity network based on the drug structures, targets, and pan-cancer IC50 profiles. We further used ML-CDN2 to predict the drug response for new BC cell lines or patient-derived samples.ResultsML-CDN2 demonstrated a good predictive performance, with the Pearson correlation coefficient between the observed and predicted IC50 values for all GDSC cell line-drug pairs of 0.873. Also, ML-CDN2 showed a good performance when used to predict drug response in new BC cell lines from the Cancer Cell Line Encyclopedia (CCLE), with a Pearson correlation coefficient of 0.718. Moreover, we found that the cell line-derived ML-CDN2 model could be applied to predict drug response in the BC patient-derived samples from The Cancer Genome Atlas (TCGA).ConclusionsThe ML-CDN2 model was built to predict BC drug response using comprehensive information from both cell lines and drugs. Compared with existing methods, it has the potential to predict the drug response for BC patient-derived samples.
| S-EPMC8166022 | biostudies-literature
Project description:A total of 20 KYSE human esophageal squamous cell carcinoma cell lines (KYSE-30, -140, -150, -170, -180, -200, -220, -350, -410, -450, -510, -520, -590, -770, -850, -890, -1170, -1190, -1250, and -2270) were kindly provided by Dr. Y. Shimada (Kyoto University, Kyoto, Japan). The KYSE cell lines were cultured in RPMI 1640 medium (Life Technologies, Inc., Grand Island, NY) containing 10% heat-inactivated fetal bovine serum (FBS; BioWhittaker, Verviers, Belgium) in a humidified atmosphere of 5% CO2 and maintained in continuous exponential growth by passage every 3 days. The exponentially growing cultured cells (2 x 10^6) were collected after two-washings with PBS. Total RNA was prepared from the frozen cell pellets using QIAGEN RNeasy mini kit (QIAGEN, Inc., Valencia, CA). The quality of the RNA was checked using Agilent Technologies 2100 Bioanalyzer (Agilent, Palo Alto, CA). CodeLink Expression Bioarray System (Amersham Bioscience, Tokyo, Japan) was used according to the manufacturerâs protocol. Briefly, first-strand cDNA was generated from 1 µg of total RNA for each cell line using reverse transcriptase and a T7 primer, and then second-strand cDNA was produced using DNA polymerase mix and RNase H. cRNA was generated via an in vitro transcription reacrion using T7 RNA polymerase and biotin-11-UTP (Perkin Elmer, Boston, MA). After quantified by spectrometry and qualified using Agilent Technologies 2100 Bioanalyzer (Agilent), 10 µg of cRNA was fragmented and hybridized to a Uniset Human 20K I Bioarray containing 19,981 human probes with 108 positive and 300 negative bacterial control probes. After hybridization, the arrays were rinsed and labeled with Streptavidin-Cy5, scanned using Agilent DNA Microarray Scanner (Agilent), then analyzed with CodeLink Expression Analysis Software ver.2.3. Expression levels were normalized to the median expression value of the whole array spots except for the bacterial controls. To explore the genes responsible for chemosensitivity in cancer cells, expression profiles of various cancer cell lines were examined. Statistically comparing them with the chemosensitivity measured by in vitro MTT assay in each cell line, several candidate genes were selected and predicition models for anticancer efficacy were established using their expression levels.
2010-06-05 | E-GEOD-2447 | biostudies-arrayexpress
Project description:A total of 20 KYSE human esophageal squamous cell carcinoma cell lines (KYSE-30, -140, -150, -170, -180, -200, -220, -350, -410, -450, -510, -520, -590, -770, -850, -890, -1170, -1190, -1250, and -2270) and a non-cancerous esophageal epithelial cell (HEEC-1)were kindly provided by Dr. Y. Shimada (Kyoto University, Kyoto, Japan). The KYSE cell lines were cultured in RPMI 1640 medium (Life Technologies, Inc., Grand Island, NY) containing 10% heat-inactivated fetal bovine serum (FBS; BioWhittaker, Verviers, Belgium) in a humidified atmosphere of 5% CO2 and maintained in continuous exponential growth by passage every 3 days. HEEC-1 cells were cultured in Keratinocyte SFM medium with growth supplement containing 2.5 mg EGF and 25 mg bovine pituitary extract in 500 mL liquid basal medium (GIBCO BRL, Rockville, MD) and expanded by passage twice in a week. The exponentially growing cultured cells (2 x 10^6) were collected after two-washings with PBS. Total RNA was prepared from the frozen cell pellets using QIAGEN RNeasy mini kit (QIAGEN, Inc., Valencia, CA), and mRNA was purified using MACS mRNA Isolation kit (Miltenyi Biotec, Bergisch Gladbach, Germany) according to the supplierâs protocols. RIKEN human 21K array containing 20,784 clones with positive and negative controls was used to analyze gene expression of 20 KYSE esophageal cancer cell lines using HEEC-1 as reference. The target DNAs used to construct human 21 K array were the glycerol stock of cDNA clones purchased from ResGen (Invitrogen Corporation, Carlsbad, CA)). One-microgram poly(A) RNAs from KYSE cells and the reference cells were labeled with Cy3-dCTP and Cy5-dCTP, respectively, by random-primed reverse transcription. Arrays were laser-scanned using ScanArray 5000TM confocal laser scanner (GSI Lumonics, Billerica, MA), and the images were analyzed using ScanAlyzeTM (Stanford University). All experiments were performed in duplicate (_1 & _2). To explore the genes responsible for chemosensitivity in cancer cells, expression profiles of various cancer cell lines were examined. Statistically comparing them with the chemosensitivity measured by in vitro MTT assay in each cell line, several candidate genes were selected and predicition models for anticancer efficacy were established using their expression levels.
2010-06-05 | E-GEOD-2454 | biostudies-arrayexpress
Project description:BackgroundEnvironment inside even a small tumor is characterized by total (anoxia) or partial oxygen deprivation, (hypoxia). It has been shown that radiotherapy and some conventional chemotherapies may be less effective in hypoxia, and therefore it is important to investigate how different drugs act in different microenvironments. In this study we perform a large screening of the effects of 19 clinically used or experimental chemotherapeutic drugs on five different cell lines in conditions of normoxia, hypoxia and anoxia.MethodsA panel of 19 commercially available drugs: 5-fluorouracil, acriflavine, bortezomib, cisplatin, digitoxin, digoxin, docetaxel, doxorubicin, etoposide, gemcitabine, irinotecan, melphalan, mitomycin c, rapamycin, sorafenib, thalidomide, tirapazamine, topotecan and vincristine were tested for cytotoxic activity on the cancer cell lines A2780 (ovarian), ACHN (renal), MCF-7 (breast), H69 (SCLC) and U-937 (lymphoma). Parallel aliquots of the cells were grown at different oxygen pressures and after 72 hours of drug exposure viability was measured with the fluorometric microculture cytotoxicity assay (FMCA).ResultsSorafenib, irinotecan and docetaxel were in general more effective in an oxygenated environment, while cisplatin, mitomycin c and tirapazamine were more effective in a low oxygen environment. Surprisingly, hypoxia in H69 and MCF-7 cells mostly rendered higher drug sensitivity. In contrast ACHN appeared more sensitive to hypoxia, giving slower proliferating cells, and consequently, was more resistant to most drugs.ConclusionsA panel of standard cytotoxic agents was tested against five different human cancer cell lines cultivated at normoxic, hypoxic and anoxic conditions. Results show that impaired chemosensitivity is not universal, in contrast different cell lines behave different and some drugs appear even less effective in normoxia than hypoxia.
| S-EPMC3707755 | biostudies-literature
Project description:In vitro human cell line models have been widely used for cancer pharmacogenomic studies to predict clinical response, to help generate pharmacogenomic hypothesis for further testing, and to help identify novel mechanisms associated with variation in drug response. Among cell line model systems, immortalized cell lines such as Epstein-Barr virus (EBV)-transformed lymphoblastoid cell lines (LCLs) have been used most often to test the effect of germline genetic variation on drug efficacy and toxicity. Another model, especially in cancer research, uses cancer cell lines such as the NCI-60 panel. These models have been used mainly to determine the effect of somatic alterations on response to anticancer therapy. Even though these cell line model systems are very useful for initial screening, results from integrated analyses of multiple omics data and drug response phenotypes using cell line model systems still need to be confirmed by functional validation and mechanistic studies, as well as validation studies using clinical samples. Future models might include the use of patient-specific inducible pluripotent stem cells and the incorporation of 3D culture which could further optimize in vitro cell line models to improve their predictive validity.
| S-EPMC4358765 | biostudies-literature
Project description:BackgroundCurrently available biomarkers are imperfect in their ability to predict responses to the multiple first-line treatment options available for patients with advanced non-small cell lung cancer (NSCLC). Having an early pharmacodynamic marker of treatment resistance may help redirect patients onto more effective alternative therapies. We sought to determine if changes in circulating tumor DNA (ctDNA) levels after initiation of first-line pembrolizumab±chemotherapy in NSCLC would enable early prediction of response prior to radiological assessment.MethodsPlasma collected from patients with advanced NSCLC prior to and serially after starting first-line pembrolizumab±platinum doublet chemotherapy was analyzed by next-generation sequencing using enhanced tagged-amplicon sequencing of hotspots and coding regions from 36 genes. Early change in ctDNA allele fraction (AF) was correlated with radiographic responses and long-term clinical outcomes.ResultsAmong 62 patients who received first-line pembrolizumab±platinum/pemetrexed and underwent ctDNA assessment, 45 had detectable ctDNA alterations at baseline. The median change in AF at the first follow-up (at a median of 21 days after treatment initiation) was -90.1% (range -100% to +65%) among patients who subsequently had a radiologic response (n=18), -19.9% (range: -100% to +1884%) among stable disease cases (n=15), and +28.8% (range: -100% to +410%) among progressive disease cases (n=12); p=0.003. In addition, there was a significant correlation between the percent change in ctDNA at the first follow-up and the percent change in tumor target lesions from baseline (R=0.66, p<0.001). AF decrease between the pretreatment and first on-treatment blood draw was associated with significantly higher response rate (60.7% vs 5.8%, p=0.0003), and significantly longer median progression-free survival (8.3 vs 3.4 months, HR: 0.29 (95% CI: 0.14 to 0.60), p=0.0007) and median overall survival (26.2 vs 13.2 months, HR: 0.34 (95% CI: 0.15 to 0.75), p=0.008) compared with cases with an AF increase.ConclusionIn patients with advanced NSCLC, rapid decreases in ctDNA prior to radiological assessment correlated with clinical benefit. These results suggest a potential role for ctDNA as an early pharmacodynamic biomarker of response or resistance to immunotherapies.
| S-EPMC7996662 | biostudies-literature
Project description:Response process validation is a crucial source of test validity. The expected cognitive load scale was created based on the reflection of the mental effort by which borderline students solve an item defined by experts. The stem length affects the students' extraneous cognitive load. The purposes of this study were to develop an exam for medical students and corroborate the response process validity by analyzing the correlation between the expected cognitive load, stem length, and the difficulty. This was a correlational study. Five medical teachers as the experts and 183 third-year medical students were enrolled from the Faculty of Medicine, Prince of Songkla University, Thailand. The instruments used were a medical physiology exam and a three-level expected cognitive load evaluation form judged by medical teachers. Data were analyzed using an explanatory item response model. The test consists of 20 items and 21 possible scores. The median score was 8, with a quartile deviation of 1.5. Nine items had long stems (more than two lines). Sixteen items were judged as high (level 2 or 3) expected cognitive load. When adding the expected cognitive load in a Rasch model, the expected cognitive load significantly correlated with item difficulty. In the Rasch model that included both the expected cognitive load and stem length, a long stem had a greater effect on item difficulty than low expected cognitive load. However, the Rasch model showed the best fit. The long stem had a stronger correlation with test difficulty than expected cognitive load, which indirectly implied response process validity. We suggest incorporating stem length and expected cognitive load to create an appropriate distribution of the difficulty of the entire test.
| S-EPMC9737731 | biostudies-literature