A HUPO test sample study reveals common problems in mass spectrometry-based proteomics

Alexander W. Bell; Eric W. Deutsch; Gavin Meredith; Juan Antonio Vizca�no; Peter Sheffield; Phillip Gray; Mahbod Hajivandi; Marshall Pope; Paul Predki; Majlinda Kullolli; Maria Hincapie; William Stephen Hancock; Wei Jia; Catherine E. Au; Lina Song; Lei Li; Junying Wei; Bing Yang; Jinglan Wang; Wantao Ying; Yangjun Zhang; Yun Cai; Xiaohong Qian; Fuchu He; Robert E. Kearney; Helmut Meyer; Christian Stephan; Martin Eisenacher; Katrin Marcus; Elmar Langenfeld; Caroline May; Steven A. Carr; Rushdy Ahmad; Wenhong Zhu; Jeffrey W. Smith; Ron Beavis; Samir M. Hanash; Jason J. Struthers; Hong Wang; Qing Zhang; Yanming An; Radoslav Goldman; Elisabet Carlsohn; Sjoerd van der Post; Kenneth E. Hung; David A. Sarracino; Salvatore Sechi; Kenneth Parker; Bryan Krastins; Raju Kucherlapati; Sylvie Bourassa; Guy G. Poirier; Eugene A. Kapp; Heather Patsiouras; Robert L. Moritz; Richard J. Simpson; Benoit Houle; Thomas Nilsson; Sylvie LaBoissiere; Pavel Metalnikov; Vivian Nguyen; Tony Pawson; Catherine C. L. Wong; Daniel Cociorva; J.R. Yates; Ana Lopez-Campistrous; Paul Semchuk; Yueju Wang; John J. M. Bergeron; Peipei Ping; Giuliano Elia; Michael J. Dunn; Kieran Wynne; Angela K. Walker; John R. Strahler; Philip Andrews; Brian L. Hood; William L. Bigbee; Thomas P. Conrads; Thomas A. Beardslee; Derek Smith; Christoph H. Borchers; Gilles A. Lajoie; Sean C. Bendall; Kaye D. Speicher; David W. Speicher; Masanori Fujimoto; Kazuyuki Nakamura; Young-Ki Paik; Sang Yun Cho; Thomas Chappell; Min-Seok Kwon; Hyoung-Joo Lee; Seul-Ki Jeong; An Sung Chung; Christine A. Miller; Rudolf Grimm; Katy Williams; Craig Dorschel; Jayson A. Falkner; Lennart Martens

doi:10.1038/nmeth.1333

A HUPO test sample study reveals common problems in mass spectrometry-based proteomics

Alexander W. Bell, Eric W. Deutsch, Gavin Meredith, Juan Antonio Vizca�no, Peter Sheffield, Phillip Gray, Mahbod Hajivandi, Marshall Pope, Paul Predki, Majlinda Kullolli, Maria Hincapie, William Stephen Hancock, Wei Jia, Catherine E. Au, Lina Song, Lei Li, Junying Wei, Bing Yang, Jinglan Wang, Wantao YingYangjun Zhang, Yun Cai, Xiaohong Qian, Fuchu He, Robert E. Kearney, Helmut Meyer, Christian Stephan, Martin Eisenacher, Katrin Marcus, Elmar Langenfeld, Caroline May, Steven A. Carr, Rushdy Ahmad, Wenhong Zhu, Jeffrey W. Smith, Ron Beavis, Samir M. Hanash, Jason J. Struthers, Hong Wang, Qing Zhang, Yanming An, Radoslav Goldman, Elisabet Carlsohn, Sjoerd van der Post, Kenneth E. Hung, David A. Sarracino, Salvatore Sechi, Kenneth Parker, Bryan Krastins, Raju Kucherlapati, Sylvie Bourassa, Guy G. Poirier, Eugene A. Kapp, Heather Patsiouras, Robert L. Moritz, Richard J. Simpson, Benoit Houle, Thomas Nilsson, Sylvie LaBoissiere, Pavel Metalnikov, Vivian Nguyen, Tony Pawson, Catherine C. L. Wong, Daniel Cociorva, J.R. Yates, Ana Lopez-Campistrous, Paul Semchuk, Yueju Wang, John J. M. Bergeron, Peipei Ping, Giuliano Elia, Michael J. Dunn, Kieran Wynne, Angela K. Walker, John R. Strahler, Philip Andrews, Brian L. Hood, William L. Bigbee, Thomas P. Conrads, Thomas A. Beardslee, Derek Smith, Christoph H. Borchers, Gilles A. Lajoie, Sean C. Bendall, Kaye D. Speicher, David W. Speicher, Masanori Fujimoto, Kazuyuki Nakamura, Young-Ki Paik, Sang Yun Cho, Thomas Chappell, Min-Seok Kwon, Hyoung-Joo Lee, Seul-Ki Jeong, An Sung Chung, Christine A. Miller, Rudolf Grimm, Katy Williams, Craig Dorschel, Jayson A. Falkner, Lennart Martens

Research output: Contribution to journal › Article › peer-review

297 Citations (Scopus)

Abstract

We performed a test sample study to try to identify errors leading to irreproducibility, including incompleteness of peptide sampling, in liquid chromatography-mass spectrometry-based proteomics. We distributed an equimolar test sample, comprising 20 highly purified recombinant human proteins, to 27 laboratories. Each protein contained one or more unique tryptic peptides of 1,250 Da to test for ion selection and sampling in the mass spectrometer. Of the 27 labs, members of only 7 labs initially reported all 20 proteins correctly, and members of only 1 lab reported all tryptic peptides of 1,250 Da. Centralized analysis of the raw data, however, revealed that all 20 proteins and most of the 1,250 Da peptides had been detected in all 27 labs. Our centralized analysis determined missed identifications (false negatives), environmental contamination, database matching and curation of protein identifications as sources of problems. Improved search engines and databases are needed for mass spectrometry-based proteomics.

Original language	English
Pages (from-to)	423-430
Number of pages	8
Journal	Nature Methods
Volume	6
Issue number	6
DOIs	https://doi.org/10.1038/nmeth.1333
Publication status	Published - 2009
Externally published	Yes

Access to Document

10.1038/nmeth.1333

Cite this

Bell, A. W., Deutsch, E. W., Meredith, G., Vizca�no, J. A., Sheffield, P., Gray, P., Hajivandi, M., Pope, M., Predki, P., Kullolli, M., Hincapie, M., Hancock, W. S., Jia, W., Au, C. E., Song, L., Li, L., Wei, J., Yang, B., Wang, J., ... Martens, L. (2009). A HUPO test sample study reveals common problems in mass spectrometry-based proteomics. Nature Methods, 6(6), 423-430. https://doi.org/10.1038/nmeth.1333

@article{d60c6e30a55249ebbae809f07b748606,

title = "A HUPO test sample study reveals common problems in mass spectrometry-based proteomics",

abstract = "We performed a test sample study to try to identify errors leading to irreproducibility, including incompleteness of peptide sampling, in liquid chromatography-mass spectrometry-based proteomics. We distributed an equimolar test sample, comprising 20 highly purified recombinant human proteins, to 27 laboratories. Each protein contained one or more unique tryptic peptides of 1,250 Da to test for ion selection and sampling in the mass spectrometer. Of the 27 labs, members of only 7 labs initially reported all 20 proteins correctly, and members of only 1 lab reported all tryptic peptides of 1,250 Da. Centralized analysis of the raw data, however, revealed that all 20 proteins and most of the 1,250 Da peptides had been detected in all 27 labs. Our centralized analysis determined missed identifications (false negatives), environmental contamination, database matching and curation of protein identifications as sources of problems. Improved search engines and databases are needed for mass spectrometry-based proteomics.",

author = "Bell, {Alexander W.} and Deutsch, {Eric W.} and Gavin Meredith and Vizca�no, {Juan Antonio} and Peter Sheffield and Phillip Gray and Mahbod Hajivandi and Marshall Pope and Paul Predki and Majlinda Kullolli and Maria Hincapie and Hancock, {William Stephen} and Wei Jia and Au, {Catherine E.} and Lina Song and Lei Li and Junying Wei and Bing Yang and Jinglan Wang and Wantao Ying and Yangjun Zhang and Yun Cai and Xiaohong Qian and Fuchu He and Kearney, {Robert E.} and Helmut Meyer and Christian Stephan and Martin Eisenacher and Katrin Marcus and Elmar Langenfeld and Caroline May and Carr, {Steven A.} and Rushdy Ahmad and Wenhong Zhu and Smith, {Jeffrey W.} and Ron Beavis and Hanash, {Samir M.} and Struthers, {Jason J.} and Hong Wang and Qing Zhang and Yanming An and Radoslav Goldman and Elisabet Carlsohn and {van der Post}, Sjoerd and Hung, {Kenneth E.} and Sarracino, {David A.} and Salvatore Sechi and Kenneth Parker and Bryan Krastins and Raju Kucherlapati and Sylvie Bourassa and Poirier, {Guy G.} and Kapp, {Eugene A.} and Heather Patsiouras and Moritz, {Robert L.} and Simpson, {Richard J.} and Benoit Houle and Thomas Nilsson and Sylvie LaBoissiere and Pavel Metalnikov and Vivian Nguyen and Tony Pawson and Wong, {Catherine C. L.} and Daniel Cociorva and J.R. Yates and Ana Lopez-Campistrous and Paul Semchuk and Yueju Wang and Bergeron, {John J. M.} and Peipei Ping and Giuliano Elia and Dunn, {Michael J.} and Kieran Wynne and Walker, {Angela K.} and Strahler, {John R.} and Philip Andrews and Hood, {Brian L.} and Bigbee, {William L.} and Conrads, {Thomas P.} and Beardslee, {Thomas A.} and Derek Smith and Borchers, {Christoph H.} and Lajoie, {Gilles A.} and Bendall, {Sean C.} and Speicher, {Kaye D.} and Speicher, {David W.} and Masanori Fujimoto and Kazuyuki Nakamura and Young-Ki Paik and Cho, {Sang Yun} and Thomas Chappell and Min-Seok Kwon and Hyoung-Joo Lee and Seul-Ki Jeong and Chung, {An Sung} and Miller, {Christine A.} and Rudolf Grimm and Katy Williams and Craig Dorschel and Falkner, {Jayson A.} and Lennart Martens",

year = "2009",

doi = "10.1038/nmeth.1333",

language = "English",

volume = "6",

pages = "423--430",

journal = "Nature Methods",

issn = "1548-7091",

publisher = "Springer, Springer Nature",

number = "6",

}

Bell, AW, Deutsch, EW, Meredith, G, Vizca�no, JA, Sheffield, P, Gray, P, Hajivandi, M, Pope, M, Predki, P, Kullolli, M, Hincapie, M, Hancock, WS, Jia, W, Au, CE, Song, L, Li, L, Wei, J, Yang, B, Wang, J, Ying, W, Zhang, Y, Cai, Y, Qian, X, He, F, Kearney, RE, Meyer, H, Stephan, C, Eisenacher, M, Marcus, K, Langenfeld, E, May, C, Carr, SA, Ahmad, R, Zhu, W, Smith, JW, Beavis, R, Hanash, SM, Struthers, JJ, Wang, H, Zhang, Q, An, Y, Goldman, R, Carlsohn, E, van der Post, S, Hung, KE, Sarracino, DA, Sechi, S, Parker, K, Krastins, B, Kucherlapati, R, Bourassa, S, Poirier, GG, Kapp, EA, Patsiouras, H, Moritz, RL, Simpson, RJ, Houle, B, Nilsson, T, LaBoissiere, S, Metalnikov, P, Nguyen, V, Pawson, T, Wong, CCL, Cociorva, D, Yates, JR, Lopez-Campistrous, A, Semchuk, P, Wang, Y, Bergeron, JJM, Ping, P, Elia, G, Dunn, MJ, Wynne, K, Walker, AK, Strahler, JR, Andrews, P, Hood, BL, Bigbee, WL, Conrads, TP, Beardslee, TA, Smith, D, Borchers, CH, Lajoie, GA, Bendall, SC, Speicher, KD, Speicher, DW, Fujimoto, M, Nakamura, K, Paik, Y-K, Cho, SY, Chappell, T, Kwon, M-S, Lee, H-J, Jeong, S-K, Chung, AS, Miller, CA, Grimm, R, Williams, K, Dorschel, C, Falkner, JA & Martens, L 2009, 'A HUPO test sample study reveals common problems in mass spectrometry-based proteomics', Nature Methods, vol. 6, no. 6, pp. 423-430. https://doi.org/10.1038/nmeth.1333

TY - JOUR

T1 - A HUPO test sample study reveals common problems in mass spectrometry-based proteomics

AU - Bell, Alexander W.

AU - Deutsch, Eric W.

AU - Meredith, Gavin

AU - Vizca�no, Juan Antonio

AU - Sheffield, Peter

AU - Gray, Phillip

AU - Hajivandi, Mahbod

AU - Pope, Marshall

AU - Predki, Paul

AU - Kullolli, Majlinda

AU - Hincapie, Maria

AU - Hancock, William Stephen

AU - Jia, Wei

AU - Au, Catherine E.

AU - Song, Lina

AU - Li, Lei

AU - Wei, Junying

AU - Yang, Bing

AU - Wang, Jinglan

AU - Ying, Wantao

AU - Zhang, Yangjun

AU - Cai, Yun

AU - Qian, Xiaohong

AU - He, Fuchu

AU - Kearney, Robert E.

AU - Meyer, Helmut

AU - Stephan, Christian

AU - Eisenacher, Martin

AU - Marcus, Katrin

AU - Langenfeld, Elmar

AU - May, Caroline

AU - Carr, Steven A.

AU - Ahmad, Rushdy

AU - Zhu, Wenhong

AU - Smith, Jeffrey W.

AU - Beavis, Ron

AU - Hanash, Samir M.

AU - Struthers, Jason J.

AU - Wang, Hong

AU - Zhang, Qing

AU - An, Yanming

AU - Goldman, Radoslav

AU - Carlsohn, Elisabet

AU - van der Post, Sjoerd

AU - Hung, Kenneth E.

AU - Sarracino, David A.

AU - Sechi, Salvatore

AU - Parker, Kenneth

AU - Krastins, Bryan

AU - Kucherlapati, Raju

AU - Bourassa, Sylvie

AU - Poirier, Guy G.

AU - Kapp, Eugene A.

AU - Patsiouras, Heather

AU - Moritz, Robert L.

AU - Simpson, Richard J.

AU - Houle, Benoit

AU - Nilsson, Thomas

AU - LaBoissiere, Sylvie

AU - Metalnikov, Pavel

AU - Nguyen, Vivian

AU - Pawson, Tony

AU - Wong, Catherine C. L.

AU - Cociorva, Daniel

AU - Yates, J.R.

AU - Lopez-Campistrous, Ana

AU - Semchuk, Paul

AU - Wang, Yueju

AU - Bergeron, John J. M.

AU - Ping, Peipei

AU - Elia, Giuliano

AU - Dunn, Michael J.

AU - Wynne, Kieran

AU - Walker, Angela K.

AU - Strahler, John R.

AU - Andrews, Philip

AU - Hood, Brian L.

AU - Bigbee, William L.

AU - Conrads, Thomas P.

AU - Beardslee, Thomas A.

AU - Smith, Derek

AU - Borchers, Christoph H.

AU - Lajoie, Gilles A.

AU - Bendall, Sean C.

AU - Speicher, Kaye D.

AU - Speicher, David W.

AU - Fujimoto, Masanori

AU - Nakamura, Kazuyuki

AU - Paik, Young-Ki

AU - Cho, Sang Yun

AU - Chappell, Thomas

AU - Kwon, Min-Seok

AU - Lee, Hyoung-Joo

AU - Jeong, Seul-Ki

AU - Chung, An Sung

AU - Miller, Christine A.

AU - Grimm, Rudolf

AU - Williams, Katy

AU - Dorschel, Craig

AU - Falkner, Jayson A.

AU - Martens, Lennart

PY - 2009

Y1 - 2009

N2 - We performed a test sample study to try to identify errors leading to irreproducibility, including incompleteness of peptide sampling, in liquid chromatography-mass spectrometry-based proteomics. We distributed an equimolar test sample, comprising 20 highly purified recombinant human proteins, to 27 laboratories. Each protein contained one or more unique tryptic peptides of 1,250 Da to test for ion selection and sampling in the mass spectrometer. Of the 27 labs, members of only 7 labs initially reported all 20 proteins correctly, and members of only 1 lab reported all tryptic peptides of 1,250 Da. Centralized analysis of the raw data, however, revealed that all 20 proteins and most of the 1,250 Da peptides had been detected in all 27 labs. Our centralized analysis determined missed identifications (false negatives), environmental contamination, database matching and curation of protein identifications as sources of problems. Improved search engines and databases are needed for mass spectrometry-based proteomics.

AB - We performed a test sample study to try to identify errors leading to irreproducibility, including incompleteness of peptide sampling, in liquid chromatography-mass spectrometry-based proteomics. We distributed an equimolar test sample, comprising 20 highly purified recombinant human proteins, to 27 laboratories. Each protein contained one or more unique tryptic peptides of 1,250 Da to test for ion selection and sampling in the mass spectrometer. Of the 27 labs, members of only 7 labs initially reported all 20 proteins correctly, and members of only 1 lab reported all tryptic peptides of 1,250 Da. Centralized analysis of the raw data, however, revealed that all 20 proteins and most of the 1,250 Da peptides had been detected in all 27 labs. Our centralized analysis determined missed identifications (false negatives), environmental contamination, database matching and curation of protein identifications as sources of problems. Improved search engines and databases are needed for mass spectrometry-based proteomics.

U2 - 10.1038/nmeth.1333

DO - 10.1038/nmeth.1333

M3 - Article

C2 - 19448641

SN - 1548-7091

VL - 6

SP - 423

EP - 430

JO - Nature Methods

JF - Nature Methods

IS - 6

ER -

A HUPO test sample study reveals common problems in mass spectrometry-based proteomics

Abstract

Access to Document

Fingerprint

Cite this