Citation: Käll L, Vitek O (2011) Computational Mass Spectrometry–Based Proteomics. PLoS Comput Biol 7(12): e1002277. doi:10.1371/journal.pcbi.1002277
Editor: Fran Lewitter, Whitehead Institute, United States of America
Published: December 1, 2011
Copyright: © 2011 Käll, Vitek. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: Funding was provided by NSF CAREER grant DBI-1054826 to OV http://www.nsf.gov/awardsearch/showAward.do?AwardNumber=1054826 and the Swedish Research council. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Goals and Challenges of Proteomics
Proteomics is defined as the system-wide characterization of all the proteins in an organism in terms of their sequence, localization, abundance, post-translational modifications, and biomolecular interactions. Modern proteomic investigations are increasingly quantitative and comprehensive . Examples include the relative quantification of over 4,000 proteins in haploid and diploid yeast, which identified the pheromone signaling pathway as enriched in differential abundance ; determination of site- and time-specific dynamics of more than 6,000 phosphorylation sites of HeLa cells stimulated with epidermal growth factor ; and characterization of 232 multiprotein complexes in Saccharomyces cerevisiae, which proposed new cellular roles for 344 proteins . Such investigations are now successfully utilized in functional biology , , genomics , , and biomedical research .
Challenges of proteomic studies stem from the complexity of the proteome and to its broad dynamic range. For example, the human genome contains around 20,000 protein coding genes. Their translation, combined with splicing or proteolysis, yields an estimated 50,000–500,000 proteins, and over 10 million different protein forms can be derived by somatic DNA rearrangements and post-translational modifications . The abundance of protein species in human plasma spans more than 10 orders of magnitude . Unlike oligonucleotides, proteins cannot be amplified, and therefore the objectives of proteomics are achieved by sensitive and scalable technologies identifying and quantifying proteins . The overall mass spectrometry–based proteomic workflow is summarized in Figure 1.
Figure 1. Quantitative mass spectrometry–based proteomic workflow.
The workflow requires a tight integration of biological and experimental (red) and computational and statistical (yellow) analysis steps.doi:10.1371/journal.pcbi.1002277.g001
Quantitative proteomic investigations are conducted in the context of biological variation , technical variation due to sample processing and spectral acquisition, and ambiguities of spectral interpretation. Statistical experimental design ,  accounts for these sources of variation. The first goal of experimental design is to avoid biases ,  (i.e., systematic errors in interpretation) by clearly defining the populations of interest, matching the individuals with respect to the confounding factors, randomizing the selection of matched individuals from the population, and randomizing sample allocation to the processing steps. The second goal is to ensure efficiency (i.e., minimal random variation and uncertainty for a given cost) by choosing an appropriate number of biological and technical replicates, and by allocating the replicates to experimental resources in balanced blocks. The steps of the statistical experimental design are summarized in Figure 2.
Figure 2. Experimental design.
Statistical experimental design consists of (a) defining the populations of interest, (b) randomly selecting biological replicates from the population and (optionally) matching confounding factors, (c) randomly allocating biological samples to spectral acquisition and (optionally) grouping the samples in balanced blocks for joint profiling, and (d) (optionally) acquiring technical replicate measurements on the biological samples. Replication, randomization, and blocking are necessary to avoid biases and maximize the efficiency of the experiment.doi:10.1371/journal.pcbi.1002277.g002
Mass Spectrometry–Based Measurements
Global Label-Free LC-MS/MS Workflow
Mass spectrometry is currently the only technology for protein identification and quantification that is both high-accuracy and high-throughput –. Although many alternatives exist, shotgun liquid chromatography coupled with tandem mass spectrometry (LC-MS/MS; overview in Figure 3) is most frequently used. Mass spectrometry is better amenable to characterizing peptides; therefore, LC-MS/MS starts by enzymatically digesting proteins into a peptide mixture. Next, liquid chromatography (LC) separates the peptides, and the separated peptides are ionized and further separated by the mass spectrometer according to their mass-to-charge ratio in a mass spectrum (MS). The mass spectra obtained from the same sample at different elution times form an LC-MS run, and intensities of MS peaks, are related to peptide abundance. For identification, the mass spectrometer isolates the biological material of selected MS peaks, subjects it to collision energy or another type of fragmentation, and separates the resulting fragments in a secondary (MS/MS) mass spectrum. The distances between the MS/MS peaks are used to infer the amino acid sequence of the parent MS peak. Since abundant MS1 peaks are more likely to be selected for fragmentation, relative peptide quantification can also be achieved by counting the number of identified MS/MS spectra.
Figure 3. Mass spectrometry–based measurements.
(a) Sample processing. Label-free quantification requires minimal sample manipulation, and acquires spectra from each sample in a separate mass spectrometry run. Label-based quantification varies in the timing and type of the labeling steps, but always simultaneously profiles two or more biological samples within a run. (b) Global label-free workflows achieve relative quantification by comparing counts of MS/MS spectra, or intensities of MS peaks between runs. Global label-based workflows compare intensities of reporter MS/MS fragments (iTRAQ) or MS peaks (SILAC, synthetic peptides). (c) Targeted workflows are an alternative to global quantification. They are most sensitive, but require an a priori knowledge of the proteins of interest, and of the technological characteristics of their peptides. Label-free targeted experiments compare intensities of transitions between runs, and label-based experiments within a run.doi:10.1371/journal.pcbi.1002277.g003
An LC-MS/MS experiment can identify and quantify thousands of proteins in complex mixtures. It requires minimal manipulation of the sample, and minimal prior information regarding its composition. However, the workflow has a number of deficiencies. Enzymatic digestion increases the complexity of the mixture. For example, a proteome comprising 5,000 proteins is expected to yield over 250,000 tryptic peptides, and minor cleavage and fragmentations of abundant proteins can obscure major events of low-abundant proteins, complicating the interpretation . Dynamic range of mass spectrometers is limited to 3–4 orders of magnitude, and the direct LC-MS/MS analysis is biased towards most abundant peptides . Technical variation can further undermine the identification and the quantification steps. A variety of extensions to this basic workflow have therefore been proposed.
Overcoming Between-Run Variation: Label-Based Quantification
The LC-MS/MS workflow is enhanced by labeling samples from different conditions metabolically (e.g., with SILAC , where stable isotopes are included in the growth medium of an organism), or chemically (e.g., with iTRAQ  or TMT , where reacting chemical labels are applied during sample processing). Samples with different labels are combined and analyzed by a mass spectrometer within a single LC-MS run. Peaks from the samples are subsequently recognized by label-induced mass shifts in MS (SILAC) or MS/MS (iTRAQ, TMT) spectra, and used for relative quantification. Labeling enables within-run comparisons of protein abundance, and improves the precision of quantification. Experimental design can further gain efficiency through optimal allocation of samples to the labels, e.g., in reciprocal or reference designs  or by using labeled synthetic peptides as references. However, labeling requires extra sample manipulation and increases the complexity of the sample.
Overcoming Limits of Dynamic Range: Targeted Workflows
The complexity of a biological mixture can be overcome by fractionation ; however, this severely undermines the throughput. A valuable alternative is selected reaction monitoring (SRM) (also referred to as multiple reaction monitoring, MRM), a targeted workflow where the mass spectrometer isolates a set of pre-defined peptides and their fragments during mass analysis –. The resulting peptide-fragment pairs (called transitions) are used for quantification. Since the isolation is highly specific, SRM enables the most sensitive mass spectrometry–based quantification currently available. For example, proteins expressed with fewer than 50 copies/cell were quantified in total yeast lysates . As shown in Figure 3, SRM can be conducted in conjunction with both label-free and label-based workflows. The drawback of targeted workflows is that they only quantify a priori known proteins, require optimized experimental protocols, and limit the number of measurements per run to a few hundreds. Further technological developments  and optimal experimental designs  will help alleviate these drawbacks.
Computation and Statistics
Identification of Peptides and Proteins
The computational and statistical analyses of the acquired spectra are illustrated in Figure 4. With the shotgun LC-MS/MS workflow, the first step is to identify sequences of amino acids that correspond to the MS/MS spectra. This has received much attention from both algorithmic and statistical viewpoints –37. A predominant approach is the database search, which compares each observed spectrum to the theoretical spectra predicted from a genomic sequence database (or to the previously identified experimental spectra in a library ), and reports the best-scoring peptide-spectrum match (PSM). Emerging alternatives are de novo identifications and hybrid searches , .
Figure 4. Computation and statistics.
Analysis of the acquired spectra includes (a, b) signal processing, (c, d) significance analysis, and (e–h) downstream analysis. Methods in (a–d) must reflect the technological properties of the workflows. Methods in (e–h) are technology-independent and are similar to the analysis of gene expression microarrays, but their use is affected by uncertainty in protein identities and the incomplete sampling of the proteome.doi:10.1371/journal.pcbi.1002277.g004
Due to the stochastic nature of the MS/MS spectra , and to deficiencies of scoring functions and databases, the best-scoring PSMs are not necessarily correct. Statistical characterization of the identifications is necessary, and is now required by most journals . This problem is frequently formalized as controlling the false discovery rate (FDR) in the list of reported PSMs , . Representative methods for controlling FDR are two-group models, which view the reported PSMs as a mixture of correct and incorrect identifications , and methods utilizing decoy databases . Typically, only around 30% of MS/MS spectra are confidently identified, and developing improved methods is an active area of research.
The task of identification extends to inferring peptides and proteins in the sample from the identified MS/MS spectra. This is challenging due to the “many-to-many” mapping of peptides to proteins, and of MS/MS spectra to peptides. Inference must enable parsimonious results, while maintaining the sensitivity and characterizing the confidence in the identifications. The problem of protein inference is not entirely solved. For example, arguments exist in favor  and against  reporting single-peptide protein identifications, and in favor  and against  the exclusive use of protease-specific peptides.
A typical experiment generates hundreds of thousands of MS/MS spectra, and open-source and commercial pipelines such as the Trans-Proteomic Pipeline  streamline spectral handling and interpretation through common infrastructure.
Quantification of Spectral Features
The next step in quantitative label-free LC-MS/MS experiments is to locate and quantify MS peaks, annotate them with peptide and sequence identities, and establish the correspondence of peaks between runs . Label-based workflows with MS quantification (e.g., SILAC) search for pairs of peaks with known mass shifts that correspond to a same peptide. Workflows with MS/MS quantification (e.g., iTRAQ) locate and quantify reporter MS/MS fragments. All these tasks can be made difficult by irregular, overlapped, and missing peaks, chromatographic variations between runs, and incomplete and incorrect identifications. As a result, only a subset of the identified proteins is typically quantified . A variety of signal processing software tools are reviewed in , and the representative ones are OpenMS  for label-based quantification and MaxQuant  for quantification with SILAC.
Targeted SRM experiments sidestep the need for identifying and aligning peaks, and signal processing focuses on peak detection, quantification, and annotation. However, difficulties can arise with overlapped or suppressed signals or incorrectly calibrated transitions, and computational methods can help filter out poor quality transitions , . Pipelines such as Skyline ,  and ATAQS  streamline these tasks.
Frequently, sample handling induces differences in the quantitative signals between runs, and global between-run normalization is necessary to distinguish true biological changes from these artifacts. Two common approaches to global normalization are sample-based and control-based. Sample-based normalization, e.g., quantile normalization or normalization based on the total ion current, makes the best use of the data, but assumes that the majority of features do not change in abundance . Control-based normalization in preferred in experiments with few measurements or many biological changes.
Finding Differentially Abundant Proteins
Typical statistical goals of quantitative proteomics are protein quantification, i.e., estimation of protein concentration in a sample on a relative or absolute scale, and class comparison, i.e., determination of proteins that change in average abundance between conditions. To achieve this, it is often necessary to summarize the quantitative information across all the features that pertain to a protein. One such approach is spectral counting , which is based on the insight that in global LC-MS/MS peaks from abundant proteins are more frequently selected for fragmentation, and uses the number of identified MS/MS spectra as a proxy for the abundance. The approach involves minimal signal processing; however, it requires specialized statistical modeling, is limited to finding large changes among abundant proteins, and is most successful with mixtures of low complexity, e.g., for determination of protein complexes .
Alternative approaches are based on summarizing signals from quantified spectral peaks. With other technologies such as gene expression microarrays, similar summarization is performed by some form of averaging, e.g., with Robust Multiarray Averaging (RMA) . Unfortunately, averaging fails to produce accurate results in mass spectrometry–based proteomics. Length, charge, and other chemical properties of peptides greatly affect the quality of the signals, and averaging obscures these difference in information content.
A more successful summarization requires probabilistic modeling, which represents all features of a protein and characterizes their variation. A diverse range of such models has been proposed, and there is no single generally accepted procedure. The models differ in using raw or log-transformed intensities, comparing groups in terms of ratios or differences, and using general-purpose  or specialized  classes of statistical models. Important aspects are accurate representation of the experimental design and of within-run groupings of peaks in label-based workflows, treatment of missing data (e.g., using specialized  or general-purpose ,  techniques), incorporating confidence in feature identifications , expanding the scope of conclusions to the underlying populations or restricting it to the selected samples , and controlling the FDR in the list of differentially abundant proteins. In some cases, e.g., in samples enriched in post-translational modifications, changes in peak intensities can be due to both differential abundance and differential modifications. Comparisons at the feature level are then more appropriate; however, they should be adjusted for the overall changes in protein abundance .
Given the diversity of experimental designs and analysis steps, all these tasks can rarely be performed in a fully automated fashion, and consultations with statisticians are highly recommended.
The high-throughput nature of proteomic data is similar to that of gene expression microarrays, and many downstream analysis methods can also be applied in proteomics . In particular, all analyses benefit from data visualization . Unsupervised class discovery helps find functionally related proteins, or biological samples homogeneous with respect to the quantitative protein profiles. Supervised class prediction, e.g., prediction of the disease status of a patient based on his or her protein abundance , and its thorough validation , are the required steps for discovery of biomarkers of disease.
Enrichment analysis tests whether pre-specified sets of proteins, e.g., those sharing a function, change in abundance more systematically than as expected by chance. This is referred to as pathway analysis when the protein set forms a pathway. The analysis investigates hypotheses that are more directly relevant to the biological function, and can help detect small but consistent changes in abundance within the set. Many enrichment analysis methods exist and are systematically reviewed in , , and representative examples are the hypergeometric (equivalently, Fisher's exact) test and Gene Set Enrichment Analysis (GSEA) . A particular challenge in proteomics is to map the protein identitifiers to gene-centric knowledge bases. The tools for this task are reviewed in , and a representative one is DAVID .
A frequently asked question is the correlation between the expression of protein-coding genes and the abundances of the corresponding proteins –. Many studies reported that in bacteria and uni-cellular eukaryotes, proteins and mRNA exhibit moderate correlation in a steady state (Pearson correlation of the order of 0.4), but it improves to the order of 0.6–0.7 for proteins that are directly affected by a relevant condition or a stress . An even lower correlation has been historically reported for multi-cellular eukaryotes; however, technological improvements now also point to a steady state correlation in human samples of the order of 0.4 .
The moderate correlation of transcript and protein abundance indicates a major role of post-translational regulation in the activity of the cell. Therefore, the best functional insight can be obtained by combining measurements across technologies, and searching for broader groups of genes, proteins, and metabolites forming regulatory relationships , . Such integrative studies are increasingly appearing , . They remain challenging, however, due to the complexity of the underlying processes, incomplete sampling of the proteome, uncertainty in protein identities and difficulties of resolving multiple proteomic, genomic, and technological identifiers across platforms. New specialized methods and algorithms are needed to address these challenges.
Despite the challenges, mass spectrometry–based proteomics continues to bring high promise for basic science and clinical research . Several studies recently demonstrated that with appropriate care and training, it is now possible to accurately and reproducibly identify and quantify proteins across laboratories and instrument platforms –. In shotgun proteomics, most repeatable peptide identifications corresponded to enzyme-specific cleavage sites, intense MS peaks, and proteins that generated many distinct peptides. Targeted quantification could reproducibly detect low µg/ml protein concentrations in unfractionated plasma.
To date, only 65% of all predicted human proteins have been reliably observed by mass spectrometry . Therefore, future experimental developments will focus on improving the sensitivity, reproducibility, and comprehensiveness of protein identifications, and the sensitivity and accuracy of quantification. All studies consistently emphasize the key role of computation . Future computational efforts will involve the development of proteome-centric knowledge bases such as neXtProt (http://www.nextprot.org/), repositories of experimental data, and the development of methods for optimal experimental design and data interpretation. Venues such as RECOMB Satellite Conference on Computational Proteomics  aim at closing the communication gap between biologists, chemists, and statisticians, and enable integrative and collaborative research.
This material was first presented as a tutorial at ISMB 2010 and 2011. We thank the organizers for the opportunity to present the tutorial. We thank O'Reilly Science Art (http://www.oreillyscienceart.com/) for help preparing the figures.
- 1. Beck M, Claassen M, Aebersold R (2011) Comprehensive proteomics. Curr Opin Biotechnol 22: 3–8.
- 2. de Godoy LMF, Olsen JV, Cox J, Nielsen ML, Hubner NC, et al. (2008) Comprehensive mass-spectrometry-based proteome quantification of haploid versus diploid yeast. Nature 455: 1251.
- 3. Olsen JV, Blagoev B, Gnad F, Macek B, Kumar C, et al. (2006) Global, in vivo, and site-specific phosphorylation dynamics in signaling networks. Cell 127: 635–648.
- 4. Gavin AC, Bösche M, Krause R, Grandi P, Marzioch M, et al. (2002) Functional or ganization of the yeast proteome by systematic analysis of protein complexes. Nature 415: 141–147.
- 5. Cox J, Mann M (2011) Quantitative, high-resolution proteomics for data-driven systems biology. Annu Rev Biochem 80: 273–299.
- 6. Gstaiger M, Aebersold R (2009) Applying mass spectrometry-based proteomics to genetics, genomics and network biology. Nat Rev Genet 10: 617–627.
- 7. Castellana N, Bafna V (2010) Proteogenomics to discover the full coding content of genomes: A computational perspective. J Proteomics 73: 2124–2135.
- 8. Ansong C, Purvine S, Adkins J, Lipton M, Smith R (2008) Proteogenomics: needs and roles to be filled by proteomics in genome annotation. Brief Funct Genomic Proteomic 7: 50–62.
- 9. Hanash S, Taguchi A (2010) The grand challenge to decipher the cancer proteome. Nat Rev Cancer 10: 652–660.
- 10. Uhlen M, Ponten F (2005) Antibody-based proteomics for human tissue profiling. Mol Cell Proteomics 4: 384.
- 11. Anderson NL, Anderson NG (2002) The human plasma proteome: history, character, and diagnostic prospects. Mol Cell Proteomics 1: 845.
- 12. Ahrens CH, Brunner E, Qeli E, Basler K, Aebersold R (2010) Generating and navigating proteome maps using mass spectrometry. Nat Rev Mol Cell Biol 11: 789–801.
- 13. Corzett TH, Fodor IK, Choi MW, Walsworth VL, Turteltaub KW, et al. (2010) Statistical analysis of variation in the human plasma proteome. J Biomed Biotechno1 2010: 258494.
- 14. Oberg AL, Vitek O (2009) Statistical design of quantitative mass spectrometry-based proteomic experiments. J Proteome Res 8: 2144–2156.
- 15. Valledor L, Jorrín J (2010) Back to the basics: maximizing the information obtained by quantitative two dimensional gel electrophoresis analyses by an appropriate experimental design and statistical analyses. J Proteomics 74: 1–18.
- 16. Ransohoff DF (2005) Bias as a threat to the validity of cancer molecular-marker research. Nat Rev Cancer 5: 142.
- 17. Hu J, Coombes KR, Morris JS, Baggerly KA (2005) The importance of experimental design in proteomic mass spectrometry experiments: some cautionary tales. Brief Funct Genomic Proteomic 3: 322–331.
- 18. Mallick P, Kuster B (2010) Proteomics: a pragmatic perspective. Nat Biotechnol 28: 695–709.
- 19. Walther TC, Mann M (2010) Mass spectrometry-based proteomics in cell biology. J Cell Biol 190: 491.
- 20. Domon B, Aebersold R (2010) Options and considerations when selecting a quantitative proteomics strategy. Nat Biotechnol 28: 710–721.
- 21. Duncan MW, Aebersold R, Caprioli RM (2010) The pros and cons of peptide-centric proteomics. Nat Biotechnol 28: 659–664.
- 22. Mann M, Michalski A, Cox J (2011) More than 100,000 detectable peptide species elute in single shotgun proteomics runs but the majority is inaccessible to data dependent LC MS/MS. J Proteome Res 10: 1785–1793.
- 23. Ong SE, Mann M (2006) A practical recipe for stable isotope labeling by amino acids in cell culture (SILAC). Nat Biotechnol 1: 2650–2660.
- 24. Ross PL, Huang YN, Marchese JN, Williamson B, Parker K, et al. (2004) Multiplexed protein quantitation in saccharomyces cerevisiae using amine-reactive isobaric tagging reagents. Mol Cell Proteomics 3: 1154–1169.
- 25. Thompson A, Schäfer J, Kuhn K, Kienle S, Schwarz J, et al. (2003) Tandem mass tags: a novel quantification strategy for comparative analysis of complex protein mixtures by MS/MS. Anal Chem 75: 1895–1904.
- 26. Geiger T, Wisniewski JR, Cox J, Zanivan S, Kruger M, et al. (2011) Use of stable isotope labeling by amino acids in cell culture as a spike-in standard in quantitative proteomics. Nat Protoc 6: 147–157.
- 27. Rifai N, Gillette MA, Carr SA (2006) Protein biomarker discovery and validation: the long and uncertain path to clinical utility. Nat Biotechnol 24: 971–983.
- 28. Yocum AK, Chinnaiyan AM (2009) Current affairs in quantitative targeted proteomics: Multiple reaction monitoring-mass spectrometry. Brief Funct Genomic Proteomic 8: 145–157.
- 29. Kitteringham NR, Jenkins RE, Lane CS, Elliott VL, Park BK (2009) Multiple reaction monitoring for quantitative biomarker analysis in proteomics and metabolomics. J Chromatogr B 877: 1229–1239.
- 30. Pan S, Aebersold R, Chen R, Rush J, Goodlett DR, et al. (2009) Mass spectrometry based targeted protein quantification: methods and applications. J Proteome Res 8: 787–797.
- 31. Lange V, Picotti P, Domon B, Aebersold R (2008) Selected reaction monitoring for quantitative proteomics: a tutorial. Mol Sys Biol 4: 1–14.
- 32. Picotti P, Bodenmiller B, Mueller LN, Domon B, Aebersold R (2009) Full dynamic range proteome analysis of S. cerevisiae by targeted proteomics. Cell 138: 795–806.
- 33. Picotti P, Rinner O, Stallmach R, Dautel F, Farrah T, et al. (2010) High-throughput generation of selected reaction-monitoring assays for proteins and proteomes. Nat Methods 7: 43–6.
- 34. Bertsch A, Jung S, Zerck A, Pfeifer N, Nahnsen S, et al. (2010) Optimal de novo design of MRM experiments for rapid assay development in targeted proteomics. J Proteome Res 9: 2696–2704.
- 35. Granholm V, Käll L (2011) Quality assessments of peptide?spectrum matches in shotgun proteomics. Proteomics 11: 1086–1093.
- 36. Nesvizhskii AI (2010) A survey of computational methods and error rate estimation procedures for peptide and protein identification in shotgun proteomics. J Proteomics 73: 2092–2123.
- 37. Nesvizhskii AI, Vitek O, Aebersold R (2007) Analysis and validation of proteomic data generated by tandem mass spectrometry. Nat Methods 4: 787–797.
- 38. Lam H, Aebersold R (2011) Building and searching tandem mass (MS/MS) spectral libraries for peptide identification in proteomics. Methods 54: 424–431.
- 39. Jeong K, Kim S, Bandeira N, Pevzner PA (2011) Gapped spectral dictionaries and their applications for database searches of tandem mass spectra. Mol Cell Proteomics 10: M110.002220.
- 40. Dasari S, Chambers M, Slebos R, Zimmerman L, Ham A, et al. (2010) TagRecon: high-throughput mutation identification through sequence tagging. J Proteome Res 9: 1716–1726.
- 41. Venable JD, Yates JR (2004) Impact of ion trap tandem mass spectra variability on the identification of peptides. Anal Chem 76: 928–2937.
- 42. Carr S, Aebersold R, Baldwin M, Burlingame A, Clauser K, et al. (2004) The need for guidelines in publication of peptide and protein identification data. Mol Cell Proteomics 3: 531.
- 43. Käll L, Storey J, MacCoss M, Noble W (2008) Assigning significance to peptides identified by tandem mass spectrometry using decoy databases. J Proteome Res 7: 29–34.
- 44. H C, I NA (2008) False discovery rates and related statistical concepts in mass spectrometry-based proteomics. J Proteome Res 7: 47–50.
- 45. Keller A, Nesvizhskii AI, Kolker E, Aebersold R (2002) Empirical statistical model to estimate the accuracy of peptide identifications made by MS/MS and database search. Anal Chem 74: 5383–5392.
- 46. Moore R, Young M, Lee T (2002) Qscore: an algorithm for evaluating SEQUEST database search results. J Am Soc Mass Spectrom 13: 378–386.
- 47. Gupta N, Pevzner PA (2009) False discovery rates of protein identifications: a strike against the two-peptide rule. J Proteome Res 8: 4173–4181.
- 48. Reiter L, Claassen M, Schrimpf S, Jovanovic M, Schmidt A, et al. (2009) Protein identification false discovery rates for very large proteomics data sets generated by tandem mass spectrometry. Mol Cell Proteomics 8: 2405.
- 49. Olsen JV, Ong SE, Mann M (2004) Trypsin cleaves exclusively C-terminal to arginine and lysine residues. Mol Cell Proteomics 3: 608–614.
- 50. Gupta N, Hixson KK, Culley DE, Smith RD, Pevzner PA (2010) Analyzing protease specificity and detecting in vivo proteolytic events using tandem mass spectrometry. Proteomics 10: 2833–2844.
- 51. Deutsch EW, Mendoza L, Shteynberg D, Farrah T, Lam H, et al. (2010) A guided tour of the Trans-Proteomic Pipeline. Proteomics 10: 1150–1159.
- 52. America AHP, Cordewener JHG (2008) Comparative LC-MS: a landscape of peaks and valleys. Proteomics 8: 731–749.
- 53. Schulze WX, Usadel B (2010) Quantitation in mass-spectrometry-based proteomics. Annu Rev Plant Biol 61: 491–516.
- 54. Mueller LN, Brusniak MY, Mani DR, Aebersold R (2008) An assessment of software solutions for the analysis of mass spectrometry based quantitative proteomics data. J Proteome Res 7: 51–61.
- 55. Sturm M, Bertsch A, Gröpl C, Hildebrandt A, Hussong R, et al. (2008) OpenMS – An open-source software framework for mass spectrometry. BMC Bioinformatics 9: 1–11.
- 56. Cox J, Mann M (2008) MaxQuant enables high peptide identification rates, individualized p.p.b.-range mass accuracies and proteome-wide protein quantification. Nat Biotechnol 26: 1367–1372.
- 57. Abbatiello S, Mani DR, Keshishian H, Carr S (2010) Automated detection of inaccurate and imprecise transitions in peptide quantification by multiple reaction monitoring mass spectrometry. Clin Chem 56: 291.
- 58. Reiter L, Rinner O, Picotti P, Hüttenhain R, Beck M, et al. (2011) mProphet: automated data processing and statistical validation for large-scale SRM experiments. Nat Methods 8: 430.
- 59. MacLean B, Tomazela D, Shulman N, Chambers M, Finney G, et al. (2010) Skyline: an open source document editor for creating and analyzing targeted proteomics experiments. Bioinformatics 26: 966.
- 60. Cham Mead JA, Bianco L, Bessant C (2010) Free computational resources for designing selected reaction monitoring transitions. Proteomics 10: 1106–1126.
- 61. Brusniak MYK, Kwok ST, Christiansen M, Campbell D, Reiter L, et al. (2011) ATAQS: a computational software tool for high throughput transition optimization and validation for selected reaction monitoring mass spectrometry. BMC Bioinformatics 12: 78–93.
- 62. Callister SJ, Barry RC, Adkins JN, Johnson ET, Qian WJ, et al. (2006) Normalization approaches for removing systematic biases associated with mass spectrometry and label-free proteomics. J Proteome Res 5: 277–286.
- 63. Lundgren DH, Hwang S, Wu L, Han DK (2010) Role of spectral counting in quantitative proteomics. Expert Rev Proteomics 7: 39–53.
- 64. Choi H, Larsen B, Lin ZY, Breitkreutz A, Mellacheruvu D, et al. (2010) SAINT: probabilistic scoring of affinity purification-mass spectrometry data. Nat Methods 8: 70.
- 65. Irizarry RA, Hobbs B, Collin F, Beazer-Barclay YD, Antonellis KJ, et al. (2003) Exploration, normalization, and summaries of high density oligonucleotide array probe level data. Biostatistics 4: 249–264.
- 66. Clough T, Key M, Ott I, Ragg S, Schadow G, et al. (2009) Protein quantification in label-free LC-MS experiments. J Proteome Res 8: 5275–5284.
- 67. Griffin NM, Yu J, Long F, Oh P, Shore S, et al. (2010) Label-free, normalized quantification of complex mass spectrometry data for proteomic analysis. Nat Biotechnol 28: 83–89.
- 68. Karpievitch Y, Stanley J, Taverner T, Huang J, Adkins JN, et al. (2009) A statistical framework for protein quantitation in bottom-up MS-based proteomics. Bioinformatics 25: 2028–2034.
- 69. Liew AW, Law NF, Yan H (2010) Missing value imputation for gene expression data: computational techniques to recover missing data from available information. Brief Bioinform 12: 498–513.
- 70. Aittokallio T (2010) Dealing with missing values in large-scale studies: microarray data imputation and beyond. Brief Bioinform 11: 253–264.
- 71. Li YF, Arnold RJ, Tang H, Radivojac P (2010) The importance of peptide detectability for protein identification, quantification, and experiment design in MS/MS proteomics. J Proteome Res 9: 6288–6297.
- 72. Wu R, Dephoure N, Haas W, Huttlin EL, Zhai B, et al. (2011) Correct interpretation of comprehensive phosphorylation dynamics requires normalization by protein expression changes. Mol Cell Proteomics 10: M111.009654.
- 73. Kumar C, Mann M (2009) Bioinformatics analysis of mass spectrometry-based proteomics data sets. FEBS Letters 583: 1703–1721.
- 74. Gehlenborg N, O'Donoghue SI, Baliga NS, Goesmann A, Hibbs MA, et al. (2010) Visualization of omics data for systems biology. Nat Methods 7: S56.
- 75. Clarke R, Ressom HW, Wang A, Xuan J, Liu MC, et al. (2008) The properties of high-dimensional data spaces: implications for exploring gene and protein expression data. Nat Rev Cancer 8: 37–49.
- 76. Boulesteix AL, Sauerbrei W (2011) Added predictive value of high-throughput molecular data to clinical data and its validation. Brief Bioinform 12: 215–229.
- 77. Emmert-Streib F, Glazko GV (2011) Pathway analysis of expression data: deciphering functional building bocks of complex diseases. PLoS Comp Biol 7: e1002053. doi:10.1371/journal.pcbi.1002053.
- 78. Ackermann M, Strimmer K (2009) A general modular framework for gene set enrichment analysis. BMC Bioinformatics 10: 47.
- 79. Subramanian A, Tamayo P, Mootha VK, Mukherjee S, Ebert BL, et al. (2005) Gene set enrichment analysis: a knowledge-based approach for interpreting genome-wide expression profiles. Proc Natl Acad Sci U S A 102: 15545–15550.
- 80. Huang D, Sherman BT, Lempicki R (2009) Bioinformatics enrichment tools: paths toward the comprehensive functional analysis of large gene lists. Nucleic Acids Res 37: 1–13.
- 81. Huang DW, Sherman BT, Lempicki RA (2009) Systematic and integrative analysis of large gene lists using david bioinformatics resources. Nat Protocols 4: 44–57.
- 82. de Sousa Abreu R, Penalva LO, Marcotte EM, Vogel C (2009) Global signatures of protein and mRNA expression levels. Mol BioSystems 5: 1512–1526.
- 83. Maier T, Guell M, Serrano L (2009) Correlation of mRNA and protein in complex biological samples. FEBS Lett 583: 3966–3973.
- 84. Nie L, Wu G, Culley DE, Scholten JCM, Zhang W (2007) Integrative analysis of transcriptomic and proteomic data: challenges, solutions and applications. Crit Rev Biotechnol 27: 63–75.
- 85. Schwanhäusser B, Busse D, Li N, Dittmar G, Schuchhardt J, et al. (2011) Global quantification of mammalian gene expression control. Nature 473: 337–342.
- 86. Joyce AR, Palsson BØ (2006) The model organism as a system: integrating ‘omics’ data sets. Nat Rev Mol Cell Biol 7: 198–210.
- 87. Sharan R, Ulitsky I, Shamir R (2007) Network-based prediction of protein function. Mol Syst Biol 3: 88–101.
- 88. Nibbe RK, Koyuturk M, Chance MR (2010) An integrative -omics approach to identify functional sub-networks in human colorectal cancer. PLoS Comp Biol 6: e1000639. doi:10.1371/journal.pcbi.1000639.
- 89. Huang SS, Fraenkel E (2010) Integration of proteomic, transcriptional, and interactome data reveals hidden signaling components. Sci Signal 2: ra40.
- 90. Nilsson T, Mann M, Aebersold R, Yates JR III, Bairoch A, et al. (2010) Mass spectrometry in high-throughput proteomics: ready for the big time. Nat Methods 7: 681–685.
- 91. Tabb DL, Vega-Montoto L, Rudnick P, Variyath A, Ham A, et al. (2010) Repeatability and reproducibility in proteomic identifications by liquid chromatography-tandem mass spectrometry. J Proteome Res 9: 761–776.
- 92. Bell A, Deutsch E, Au C, Kearney R, Beavis R, et al. (2009) A HUPO test sample study reveals common problems in mass spectrometry–based proteomics. Nat Methods 6: 423–430.
- 93. Addona TA, Abbatiello SE, Schilling B, Skates SJ, Mani DR, et al. (2009) Multi-site assessment of the precision and reproducibility of multiple reaction monitoring-based measurements of proteins in plasma. Nat Biotechnol 27: 633–864.
- 94. Aebersold R (2009) A stress test for mass spectrometry-based proteomics. Nat Methods 6: 411–412.
- 95. Bandeira N, Nesvizhskii A, McIntosh M (2011) Advancing next-generation proteomics through computational research. J Proteome Res 10: 2895–2895.