Unknown,Transcriptomics,Genomics,Proteomics

Dataset Information

Systematic evaluation of variability in ChIP-chip experiments using predefined DNA targets

ABSTRACT: The most widely used method for detecting genome-wide protein-DNA interactions is chromatin immunoprecipitation on tiling microarrays, commonly known as ChIP-chip. Here, we conducted the first objective analysis of tiling array platforms, amplification procedures, and signal detection algorithms in a simulated ChIP-chip experiment. Mixtures of human genomic DNA and spike-ins comprised of nearly 100 human sequences at various concentrations were hybridized to four tiling array platforms by eight independent groups. Blind to the number of spike-ins, their locations, and the range of concentrations, each group made predictions of the spike-in locations. We found that microarray platform choice is not the primary determinant of overall performance. In fact, variation in performance between labs, protocols and algorithms within the same array platform was greater than the variation in performance between array platforms. However, each array platform had unique performance characteristics that varied with tiling resolution and the number of replicates, which have implications for cost versus detection power. Long oligonucleotide arrays were slightly more sensitive at detecting very low enrichment. On all platforms, simple sequence repeats and genome redundancy tended to result in false positives. LM-PCR and WGA, the most popular sample amplification techniques, reproduced relative enrichment levels with high fidelity. Performance among signal detection algorithms was heavily dependent on array platform. The spike-in DNA samples and the data presented here provide a stable benchmark against which future ChIP platforms, protocol improvements, and analysis methods can be evaluated. This SuperSeries is composed of the following subset Series: GSE9732: Spike-in Experiment for ChIP-chip Simulation GSE9842: Systematic evaluation of variability in simulated ChIP-chip experiments GSE9848: Systematic evaluation of variability in simulated ChIP-chip experiments Kevin_Encode GSE9849: Systematic evaluation of variability in simulated ChIP-chip experiments Myles_Encode GSE10004: ENCODE Spike-In, Yale Group GSE10076: ENCODE spikein, amplified DNA samples, NimbleGen arrays GSE10090: ENCODE spikein, nonamplified DNA samples, NimbleGen arrays GSE10112: Systematic evaluation of variability in simulated ChIP-chip experiments Keywords: SuperSeries For data usage terms and conditions, please refer to http://www.genome.gov/27528022 and http://www.genome.gov/Pages/Research/ENCODE/ENCODEDataReleasePolicyFinal2008.pdf Refer to individual Series

ORGANISM(S): Homo sapiens

SUBMITTER: Jason Lieb

PROVIDER: E-GEOD-10114 | biostudies-arrayexpress |

REPOSITORIES: biostudies-arrayexpress

ACCESS DATA

Publications

Systematic evaluation of variability in ChIP-chip experiments using predefined DNA targets.

Johnson David S DS Li Wei W Gordon D Benjamin DB Bhattacharjee Arindam A Curry Bo B Ghosh Jayati J Brizuela Leonardo L Carroll Jason S JS Brown Myles M Flicek Paul P Koch Christoph M CM Dunham Ian I Bieda Mark M Xu Xiaoqin X Farnham Peggy J PJ Kapranov Philipp P Nix David A DA Gingeras Thomas R TR Zhang Xinmin X Holster Heather H Jiang Nan N Green Roland D RD Song Jun S JS McCuine Scott A SA Anton Elizabeth E Nguyen Loan L Trinklein Nathan D ND Ye Zhen Z Ching Keith K Hawkins David D Ren Bing B Scacheri Peter C PC Rozowsky Joel J Karpikov Alexander A Euskirchen Ghia G Weissman Sherman S Gerstein Mark M Snyder Michael M Yang Annie A Moqtaderi Zarmik Z Hirsch Heather H Shulha Hennady P HP Fu Yutao Y Weng Zhiping Z Struhl Kevin K Myers Richard M RM Lieb Jason D JD Liu X Shirley XS

Genome research 20080207 3

The most widely used method for detecting genome-wide protein-DNA interactions is chromatin immunoprecipitation on tiling microarrays, commonly known as ChIP-chip. Here, we conducted the first objective analysis of tiling array platforms, amplification procedures, and signal detection algorithms in a simulated ChIP-chip experiment. Mixtures of human genomic DNA and "spike-ins" comprised of nearly 100 human sequences at various concentrations were hybridized to four tiling array platforms by eigh ...[more]

PMID: 18258921

Similar Datasets

Project description:The goals of the study were to assess array platform performance and analysis algorithm performance. The most widely used method for detecting genome-wide protein-DNA interactions is chromatin immunoprecipitation on tiling microarrays, commonly known as ChIP-chip. Here, we conducted the first objective analysis of tiling array platforms, amplification procedures, and signal detection algorithms in a simulated ChIP-chip experiment. Mixtures of human genomic DNA and "spike-ins" comprised of nearly 100 human sequences at various concentrations were hybridized to four tiling array platforms by eight independent groups. Blind to the number of spike-ins, their locations, and the range of concentrations, each group made predictions of the spike-in locations. We found that microarray platform choice is not the primary determinant of overall performance. In fact, variation in performance between labs, protocols and algorithms within the same array platform was greater than the variation in performance between array platforms. However, each array platform had unique performance characteristics that varied with tiling resolution and the number of replicates, which have implications for cost versus detection power. Long oligonucleotide arrays were slightly more sensitive at detecting very low enrichment. On all platforms, simple sequence repeats and genome redundancy tended to result in false positives. LM-PCR and WGA, the most popular sample amplification techniques, reproduced relative enrichment levels with high fidelity. Performance among signal detection algorithms was heavily dependent on array platform. The spike-in DNA samples and the data presented here provide a stable benchmark against which future ChIP platforms, protocol improvements, and analysis methods can be evaluated. Keywords: ChIP-chip, competition For data usage terms and conditions, please refer to http://www.genome.gov/27528022 and http://www.genome.gov/Pages/Research/ENCODE/ENCODEDataReleasePolicyFinal2008.pdf DNA was spiked-in to a background DNA sample. Same DNA samples used in the arrays in this Series; these are technical array replicates.

Project description:The goals of the study were to assess array platform performance and analysis algorithm performance. The most widely used method for detecting genome-wide protein-DNA interactions is chromatin immunoprecipitation on tiling microarrays, commonly known as ChIP-chip. Here, we conducted the first objective analysis of tiling array platforms, amplification procedures, and signal detection algorithms in a simulated ChIP-chip experiment. Mixtures of human genomic DNA and "spike-ins" comprised of nearly 100 human sequences at various concentrations were hybridized to four tiling array platforms by eight independent groups. Blind to the number of spike-ins, their locations, and the range of concentrations, each group made predictions of the spike-in locations. We found that microarray platform choice is not the primary determinant of overall performance. In fact, variation in performance between labs, protocols and algorithms within the same array platform was greater than the variation in performance between array platforms. However, each array platform had unique performance characteristics that varied with tiling resolution and the number of replicates, which have implications for cost versus detection power. Long oligonucleotide arrays were slightly more sensitive at detecting very low enrichment. On all platforms, simple sequence repeats and genome redundancy tended to result in false positives. LM-PCR and WGA, the most popular sample amplification techniques, reproduced relative enrichment levels with high fidelity. Performance among signal detection algorithms was heavily dependent on array platform. The spike-in DNA samples and the data presented here provide a stable benchmark against which future ChIP platforms, protocol improvements, and analysis methods can be evaluated. Keywords: ChIP-chip, competition, artificial DNA For data usage terms and conditions, please refer to http://www.genome.gov/27528022 and http://www.genome.gov/Pages/Research/ENCODE/ENCODEDataReleasePolicyFinal2008.pdf DNA samples had spike-in DNA added to simulate peaks in ChIP-chip experiments. Same DNA samples used in the arrays in this Series; these are technical array replicates.

Project description:The most widely-used method for detecting and measuring genome-wide protein-DNA interactions is chromatin immunoprecipitation on tiling microarrays, commonly known as ChIP-chip. Many tiling array platforms, amplification methods, and analysis algorithms exist for ChIP-chip, but a rigorous assessment of the relative performance of these factors has not been reported. In a multi-lab simulation of a ChIP-chip experiment, we conducted the first objective analysis of tiling array platforms and analysis algorithms. We designed a complex mixture of human genomic DNA with a "spike-in" comprised of nearly 100 human sequences at various concentrations. Eight independent groups hybridized these mixtures to four different tiling array platforms. The groups were blind to the composition of the spike-in mix, the range of concentrations covered, or how many sequences it contained. Still blind to the key, each group made predictions of the spike-in locations based on their measurements. The results reveal that all commercial tiling array platforms perform well, although each platform and analysis algorithm has distinct performance characteristics. Simple sequence repeats and genome redundancy tend to result in false positives on oligonucleotide platforms. We also compare genome-wide platforms with regard to performance and cost. The spike-in DNA samples and the resulting array data presented in our study provide a stable benchmark against which future ChIP platforms, protocol improvements, and analysis methods can be evaluated. Keywords: Spike in Control For data usage terms and conditions, please refer to http://www.genome.gov/27528022 and http://www.genome.gov/Pages/Research/ENCODE/ENCODEDataReleasePolicyFinal2008.pdf With the availability of sequenced genomes and whole-genome tiling microarrays, many researchers have conducted experiments using ChIP-chip and related methods to study genome-wide protein-DNA interactions1-9. These are powerful yet challenging techniques, which are comprised of many steps that can introduce variability in the final results. One potentially important factor is the relative performance of different types of tiling arrays. Currently the most popular platforms for performing ChIP-chip experiments are PCR-product based tiling arrays spotted in academic laboratories and commercial oligonucleotide-based tiling arrays from Affymetrix, NimbleGen, and Agilent. A second factor known to introduce variation is the DNA amplification protocol, which is often required because the low DNA yield from a ChIP experiment prevents direct detection on microarrays. A third factor is the algorithm used for detecting regions of enrichment from the tiling array data. A number of algorithms have been developed, but until this report there was no benchmark dataset to systematically evaluate them. In this study, we used a spike-in experiment to systematically evaluate the effects of tiling microarrays, amplification protocols, and data analysis algorithms on ChIP-chip results. There are other potentially important factors that from a practical standpoint are more difficult to systematically control and evaluate, and are not assessed here. These include the experimenter, the amount of starting material used, size of DNA fragments after shearing, DNA labeling method, and hybridization conditions. There have been several studies evaluating the performance of gene expression microarrays and analysis algorithms10-13. However, because tiling arrays must cover large genomic regions, they have different probe properties and high probe densities, and therefore present different biochemical and informatics challenges. Thus the results from the expression array spike-in experiments are not necessarily directly relevant to tiling array experiments. One recent study compared the performance of array-based (ChIP-chip) and sequence-based (ChIP-PET) technologies on a real ChIP experiment14. However, because this was an exploratory experiment, the list of absolute “true positive” targets was and is unknown. Since this experiment was performed without a key, the sensitivity and specificity of each technology had to be estimated retrospectively by qPCR validation of targets predicted from each platform. In our experiment, eight independent research groups at locations worldwide hybridized two different mixtures of DNA to one of four tiling array platforms, and predicted genome location and concentration of the spike-in sequences using a total of 13 different algorithms. Throughout the process, the research groups were entirely blind to the contents of the spike-in mixtures. Using the spike-in key, we analyzed several performance parameters for each platform, algorithm, and amplification method. While all commercial platforms performed well, we found that each had unique performance characteristics. We examined the implications of these results in planning human genome-wide experiments, in which trade-offs between probe density and cost are important.

Project description:The most widely-used method for detecting genome-wide protein-DNA interactions is chromatin immunoprecipitation on tiling microarrays, commonly known as ChIP-chip. Here, we conducted the first objective analysis of tiling array platforms and analysis algorithms in a simulated ChIP-chip experiment. Mixtures of human genomic DNA and "spike-ins" comprised of nearly 100 human sequences at various concentrations were hybridized to four tiling array platforms by eight independent groups. Blind to the number of spike-ins, their locations, and the range of concentrations, each group made predictions of the spike-in locations. All commercial tiling array platforms performed well, although each platform and analysis algorithm had distinct performance and cost characteristics. Simple sequence repeats and genome redundancy tend to result in false positives on oligonucleotide platforms. The spike-in DNA samples and the resulting array data presented here provide a stable benchmark against which future ChIP platforms, protocol improvements, and analysis methods can be evaluated. Keywords: chip-ChIP simulation For data usage terms and conditions, please refer to http://www.genome.gov/27528022 and http://www.genome.gov/Pages/Research/ENCODE/ENCODEDataReleasePolicyFinal2008.pdf For each replicate array, we labeled 1Âµg of spike-in sample and 1Âµg of control sample. The Bioprime Plus Array CGH labeling Module (Invitrogen Catolog number 18095-014) was used. The spike-in was labeled with the red channel dye (Alexa Fluor-647) and the control was labeled with the green channel dye (Alexa Fluor-555) in two of the replicates. A dye swap was performed for the third replicate. These samples were then competitively hybridized to three replicate 244k arrays from Agilent, (AMADID 25150451). We hybridized the samples to the arrays using the Agilent Array CGH protocol, with some modifications. Briefly, labeled DNA was combined with Cot-1 DNA, blocking reagent, and hybridization buffer. The hybridizations were carried out at 60Â°C. The arrays were scanned using an Agilent dual laser scanner, and the images were processed using Agilent Feature Extraction Software.

Project description:Recent genome-scale ChIP-chip studies of transcription factors have shown that a low percentage of experimentally determined binding sites contain the consensus motif for the immunoprecipitated factor. In most cases, differences between in vivo target sites that contain or lack a consensus motif have not been explored. We have previously shown that most sites to which E2F family members are bound in vivo do not contain E2F consensus motifs. The main purpose of this study was to develop an understanding of how E2F binding specificity is achieved in vivo. In particular, we have addressed how E2F family members are recruited to core promoter regions that lack a consensus motif and are excluded from other regions that contain a consensus motif. Using promoter and ENCODE arrays, we have shown that the predominant factors specifying whether E2F is recruited to an in vivo binding site are a) the site must be in a core promoter and b) the promoter region must be utilized as a promoter by the transcriptional machinery in that particular cell type. We have tested three models for recruitment of E2F to core promoters lacking a consensus site, including a) indirect recruitment, b) looping to the core promoter mediated by an E2F bound to a distal consensus motif, and c) assisted binding of E2F to a site that weakly resembles an E2F consensus motif within the core promoter. To test these models, we developed a new in vivo assay, termed eChIP, which allows analysis of transcription factor binding to isolated promoter fragments. Our findings suggest that in vivo a) the presence of a consensus motif is not sufficient to recruit E2Fs, b) E2Fs can bind to isolated regions that lack a consensus motif, and c) binding can require regions other than the best match to the E2F PWM in the core promoter. Keywords: E2F, ChIP-chip, transcription factor binding, consensus motifs 37 ChIP-chip arrays (of these, 14 array sets are biological duplicates). 22 samples are included in this series, the rest can be found in supplementary info to the following papers: Xu 2007, Jin 2006, Komashko 2008

Dataset Information

Systematic evaluation of variability in ChIP-chip experiments using predefined DNA targets

Publications

Systematic evaluation of variability in ChIP-chip experiments using predefined DNA targets.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets