Dataset Information

Considerations for peptide and protein error rate control in large-scale targeted DIA analyses: plasma analysis

ABSTRACT: Liquid chromatography coupled to tandem mass spectrometry has become the main method for high-throughput identification and quantification of peptides and the inferred proteins. Discovery proteomics commonly employs data-dependent acquisition in combination with spectrum-centric analysis. The accumulation of data generated from thousands of samples by this method has approached saturation coverage of different proteomes. Recently, as a result of technological advances, methods based on data acquisition strategies compatible with peptide-centric scoring have also reached similar proteome coverage in individual runs, and scalability. This is exemplified by SWATH-MS, which combines data-independent acquisition (DIA) with targeted data extraction of groups of transitions uniquely detecting a peptide. As the data matrices generated by these experiments continue to grow with respect to both the number of peptides identified per sample and the number of samples analyzed per study, challenges for error rate control have emerged. Here, we discuss the adaptation of statistical concepts developed for discovery proteomics based on spectrum-centric scoring to large-scale DIA experiments analyzed with peptide-centric scoring strategies, and provide some guidance on their application. We propose that, in order to increase the quality and reproducibility of published proteomic results, well-established confidence criteria should be reported at each level as we progress from spectral evidence to identified or detected peptides and inferred proteins. These confidence criteria should equally be applied to proteomic analyses based on spectrum- and peptide-centric scoring strategies.

INSTRUMENT(S): TripleTOF 5600

ORGANISM(S): Homo Sapiens (human)

TISSUE(S): Blood Plasma

SUBMITTER: Isabell Bludau

LAB HEAD: Ruedi Aebersold

PROVIDER: PXD006625 | Pride | 2017-08-03

REPOSITORIES: Pride

ACCESS DATA

Dataset's files

Source:

			Action	DRS
	CAL_nonparam_experimentwide_scored_pep001_concatenated.txt	Txt
	CAL_nonparam_global_protein_list_unique.txt	Txt
	CAL_nonparam_global_transition_group_list_unique.txt	Txt
	CAL_nonparam_report_grouped_by_FullPeptideName.pdf	Pdf
	CAL_nonparam_report_grouped_by_ProteinName.pdf	Pdf

Items per page:

1 - 5 of 26

Publications

Statistical control of peptide and protein error rates in large-scale targeted data-independent acquisition analyses.

Rosenberger George G Bludau Isabell I Schmitt Uwe U Heusel Moritz M Hunter Christie L CL Liu Yansheng Y MacCoss Michael J MJ MacLean Brendan X BX Nesvizhskii Alexey I AI Pedrioli Patrick G A PGA Reiter Lukas L Röst Hannes L HL Tate Stephen S Ting Ying S YS Collins Ben C BC Aebersold Ruedi R

Nature methods 20170821 9

Liquid chromatography coupled to tandem mass spectrometry (LC-MS/MS) is the main method for high-throughput identification and quantification of peptides and inferred proteins. Within this field, data-independent acquisition (DIA) combined with peptide-centric scoring, as exemplified by the technique SWATH-MS, has emerged as a scalable method to achieve deep and consistent proteome coverage across large-scale data sets. We demonstrate that statistical concepts developed for discovery proteomics ...[more]

PMID: 28825704

Publication: 1/2

Similar Datasets

Project description:TARGET (Tumour characterisation to Guide Experimental Targeted therapy) seeks to optimise the pathway for molecular characterisation of all patients entering early phase cancer trials to inform clinical decision-making on optimal therapy. Performance status (PS) was developed to assess a patient’s ability to perform a variety of activities to further inform clinical decision making on optimal therapy including appropriate inclusion in clinical trials. However, the quality of present algorithms to assess performance status are limited and based on a semi-quantitative clinician assessment. In particular, a common eligibility criterion for entry into early phase cancer clinical trials is a life expectancy of >3 or 6 months. Here we investigate proteomics as a means of more objective and quantitative assessment of both performance status and thus likely prognosis prior to clinical trial enrolment. Improved patient stratification at enrolment would reduce the number of patients unnecessarily exposed to potentially toxic drugs and decrease withdrawal from trials. Plasma samples from patients enrolled into the TARGET trial were analysed using the mass spectrometry (MS) technique: Sequential window acquisition of all theoretical fragment ion spectra (SWATH) MS. SWATH-MS was used on a discovery cohort of 73 patients to identify proteins that could differentiate patients into either a good or poor prognosis. A three-protein panel showed a stronger prediction of overall survival (p = 0.000086) compared to PS (p = 0.001). This panel was then tested against a validation cohort of 77 patients. The panel was determined as being a significant (p = 0.000451) predictor of overall survival whereas PS was not significant. The panel had a receiver operating characteristic curve area under the curve (AUC) of 0.73 in the validation set; the AUC of PS was 0.54. This signature can now be developed further in larger patient populations to assess its utility in a clinical setting.

Project description:The statistical validation of peptide and protein identifications in mass spectrometry proteomics is a critical step in the analytical workflow. This is particularly important in discovery experiments to ensure only confident identifications are accumulated for downstream analysis and biomarker consideration. However, the inherent nature of discovery proteomics experiments leads to scenarios where the search space will inflate substantially due to the increased number of potential proteins that are being queried in each sample. In these cases, issues will begin to arise when the machine learning algorithms that are trained on an experiment specific basis cannot accurately distinguish between correct and incorrect identifications and will struggle to accurately control the false discovery rate. Here, we propose an alternative validation algorithm trained on a curated external data set of 2.8 million extracted peakgroups that leverages advanced machine learning techniques to create a generalizable peakgroup scoring (GPS) method for data independent acquisition (DIA) mass spectrometry. By breaking the reliance on the experimental data at hand and instead training on a curated external dataset, GPS can confidently control the false discovery rate while increasing the number of identifications and providing more accurate quantification in different search space scenarios. To first test the performance of GPS in a standard experimental environment and to provide a benchmark against other methods, a novel spike-in data set with known varying concentrations was analyzed. When compared to existing methods GPS increased the nunmber of identifications by 5-18\% and was able to provide more accurate quantification by increasing the number of ratio validated identifications by 24-74\%. To evaluate GPS in a larger search space, a novel data set of 141 blood plasma samples from patients developing acute kidney injury after sepsis was searched with a human tissue spectral library (10000+ proteins). Using GPS, we were able to provide a 207-377\% increase in the number of candidate differentially abundant proteins compared to the existing methods while maintaining competitive numbers of global identifications. Finally, using an optimized human tissue library and workflow we were able to identify 1205 proteins from the 141 plasma samples and increase the number of candidate differentially abundant proteins by 70.87\%. With the addition of machine learning aided differential expression, we were able to identify potential new biomarkers for stratifying subphenotypes of acute kidney injury in sepsis. These findings suggest that by using a generalized model such as GPS in tandem with a massive scale spectral library it is possible to expand the boundaries of discovery experiments in DIA proteomics. GPS is open source and freely available on github at (\url{https://github.com/InfectionMedicineProteomics/gps})

Project description:Spectral library search (SLS) is a major approach for peptide identification from tandem mass spectrometry data, offering a complementary approach to conventional database search. Moreover, with the emergence of spectrum prediction models, proteomics database search is progressively becoming more like spectral library search of predicted peptide spectra. The performance of peptide identification algorithms thus frequently depends on how well the underlying Spectrum-Spectrum Matching (SSM) scoring functions distinguish true and false positive matches. However, detailed comparative studies evaluating the performance of SSM scoring functions remain limited by the absence of comprehensive benchmark datasets. We propose new methods to build benchmarks that assess the effectiveness and robustness of SSM scoring functions. The resulting benchmark dataset is composed of (i) a set of 476,063 precursors used to construct 8 query spectrum sets with different levels of noise added to "ideal" and real experimental spectra, and (ii) three spectral libraries with different spectra for the same 3,065,819 precursors: experimental spectra, annotated/de-noised spectra and predicted spectra. The benchmark set was then used to evaluate 9 common spectrum preprocessing scenarios, followed by the evaluation of 3 standard SSM scoring functions, Cosine, Projected-Cosine (commonly used for the analysis of chimeric/mixture spectra), and Jensen-Shannon divergence, and 2 additional scoring functions used in state-of-the-art SLS tools: SpectraST and EntropyScore. The results revealed that scoring spectrum-spectrum matches is still an important open problem, with the best recall for typical SLS searches still assessed to be poor at just ~70% at the typical 1% error rate. Overall, SpectraST performed best for spectra with little-to-no noise, but JS-divergence performed better in some cases as it was found to be most resistant to noise. Conversely, the performance of Cosine and Entropy score was found to be generally lower than previously reported, with Projected-Cosine performing especially poorly in most cases. However, the performance of the SSM scoring functions was also found to depend quite significantly on the minimum number of matching peaks required for each SSM, with benchmark results showing that the scoring functions' performance and relative ranking can be very significantly affected by how this important parameter is set. The resulting benchmark dataset can be used to test and support the development of SSM scoring functions and the proposed benchmark construction approach, providing a foundation that can be extended for additional types of spectrum-spectrum matching.