Assessment of peer review products and reviewer performance of the Center for Independent Experts to strengthen the National Marine Fisheries Service's scientific quality assurance

Manoj Shivlani, William Michaels, Stephen K. Brown, David J Die, David Sampson

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Since 1998, the Center for Independent Experts (CIE), an independent peer review program, has conducted over 150 peer reviews of National Marine Fisheries Service (NMFS) assessments and products. The CIE peer review process has contributed to NMFS' efforts in improving the reliability and integrity of the agency's scientific information, and it is expected that NMFS' use of the CIE will increase in the future. Two assessments of the CIE program and reviewer performance, respectively, were conducted to evaluate the effectiveness of the program, as perceived by the NMFS centers that requested CIE reviews and chairs that oversaw the performance of CIE reviewers at individual reviews. Results from both assessments concluded that the CIE process is an effective peer review model for providing a pool of highly qualified and independent experts that strengthen NMFS's scientific quality assurance mission, that CIE reviewer participation during panel reviews were equally important products in comparison to the independent peer review reports, and that the strength of the CIE peer review process was its independence.

Original languageEnglish
Title of host publicationWMSCI 2009 - The 13th World Multi-Conference on Systemics, Cybernetics and Informatics, Jointly with the 15th International Conference on Information Systems Analysis and Synthesis, ISAS 2009 - Proc.
Pages298-299
Number of pages2
Volume1
StatePublished - Dec 1 2009
Event13th World Multi-Conference on Systemics, Cybernetics and Informatics, WMSCI 2009, Jointly with the 15th International Conference on Information Systems Analysis and Synthesis, ISAS 2009 - Orlando, FL, United States
Duration: Jul 10 2009Jul 13 2009

Other

Other13th World Multi-Conference on Systemics, Cybernetics and Informatics, WMSCI 2009, Jointly with the 15th International Conference on Information Systems Analysis and Synthesis, ISAS 2009
CountryUnited States
CityOrlando, FL
Period7/10/097/13/09

Fingerprint

Fisheries
Quality assurance

Keywords

  • Fisheries
  • Independent peer review
  • Magnuson-Stevens Act (MSA)
  • National Marine Fisheries Service (NMFS)

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications
  • Information Systems

Cite this

Shivlani, M., Michaels, W., Brown, S. K., Die, D. J., & Sampson, D. (2009). Assessment of peer review products and reviewer performance of the Center for Independent Experts to strengthen the National Marine Fisheries Service's scientific quality assurance. In WMSCI 2009 - The 13th World Multi-Conference on Systemics, Cybernetics and Informatics, Jointly with the 15th International Conference on Information Systems Analysis and Synthesis, ISAS 2009 - Proc. (Vol. 1, pp. 298-299)

Assessment of peer review products and reviewer performance of the Center for Independent Experts to strengthen the National Marine Fisheries Service's scientific quality assurance. / Shivlani, Manoj; Michaels, William; Brown, Stephen K.; Die, David J; Sampson, David.

WMSCI 2009 - The 13th World Multi-Conference on Systemics, Cybernetics and Informatics, Jointly with the 15th International Conference on Information Systems Analysis and Synthesis, ISAS 2009 - Proc.. Vol. 1 2009. p. 298-299.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Shivlani, M, Michaels, W, Brown, SK, Die, DJ & Sampson, D 2009, Assessment of peer review products and reviewer performance of the Center for Independent Experts to strengthen the National Marine Fisheries Service's scientific quality assurance. in WMSCI 2009 - The 13th World Multi-Conference on Systemics, Cybernetics and Informatics, Jointly with the 15th International Conference on Information Systems Analysis and Synthesis, ISAS 2009 - Proc.. vol. 1, pp. 298-299, 13th World Multi-Conference on Systemics, Cybernetics and Informatics, WMSCI 2009, Jointly with the 15th International Conference on Information Systems Analysis and Synthesis, ISAS 2009, Orlando, FL, United States, 7/10/09.
Shivlani M, Michaels W, Brown SK, Die DJ, Sampson D. Assessment of peer review products and reviewer performance of the Center for Independent Experts to strengthen the National Marine Fisheries Service's scientific quality assurance. In WMSCI 2009 - The 13th World Multi-Conference on Systemics, Cybernetics and Informatics, Jointly with the 15th International Conference on Information Systems Analysis and Synthesis, ISAS 2009 - Proc.. Vol. 1. 2009. p. 298-299
Shivlani, Manoj ; Michaels, William ; Brown, Stephen K. ; Die, David J ; Sampson, David. / Assessment of peer review products and reviewer performance of the Center for Independent Experts to strengthen the National Marine Fisheries Service's scientific quality assurance. WMSCI 2009 - The 13th World Multi-Conference on Systemics, Cybernetics and Informatics, Jointly with the 15th International Conference on Information Systems Analysis and Synthesis, ISAS 2009 - Proc.. Vol. 1 2009. pp. 298-299
@inproceedings{ca875f326d9f4357a0e9c17dff91663f,
title = "Assessment of peer review products and reviewer performance of the Center for Independent Experts to strengthen the National Marine Fisheries Service's scientific quality assurance",
abstract = "Since 1998, the Center for Independent Experts (CIE), an independent peer review program, has conducted over 150 peer reviews of National Marine Fisheries Service (NMFS) assessments and products. The CIE peer review process has contributed to NMFS' efforts in improving the reliability and integrity of the agency's scientific information, and it is expected that NMFS' use of the CIE will increase in the future. Two assessments of the CIE program and reviewer performance, respectively, were conducted to evaluate the effectiveness of the program, as perceived by the NMFS centers that requested CIE reviews and chairs that oversaw the performance of CIE reviewers at individual reviews. Results from both assessments concluded that the CIE process is an effective peer review model for providing a pool of highly qualified and independent experts that strengthen NMFS's scientific quality assurance mission, that CIE reviewer participation during panel reviews were equally important products in comparison to the independent peer review reports, and that the strength of the CIE peer review process was its independence.",
keywords = "Fisheries, Independent peer review, Magnuson-Stevens Act (MSA), National Marine Fisheries Service (NMFS)",
author = "Manoj Shivlani and William Michaels and Brown, {Stephen K.} and Die, {David J} and David Sampson",
year = "2009",
month = "12",
day = "1",
language = "English",
isbn = "1934272582",
volume = "1",
pages = "298--299",
booktitle = "WMSCI 2009 - The 13th World Multi-Conference on Systemics, Cybernetics and Informatics, Jointly with the 15th International Conference on Information Systems Analysis and Synthesis, ISAS 2009 - Proc.",

}

TY - GEN

T1 - Assessment of peer review products and reviewer performance of the Center for Independent Experts to strengthen the National Marine Fisheries Service's scientific quality assurance

AU - Shivlani, Manoj

AU - Michaels, William

AU - Brown, Stephen K.

AU - Die, David J

AU - Sampson, David

PY - 2009/12/1

Y1 - 2009/12/1

N2 - Since 1998, the Center for Independent Experts (CIE), an independent peer review program, has conducted over 150 peer reviews of National Marine Fisheries Service (NMFS) assessments and products. The CIE peer review process has contributed to NMFS' efforts in improving the reliability and integrity of the agency's scientific information, and it is expected that NMFS' use of the CIE will increase in the future. Two assessments of the CIE program and reviewer performance, respectively, were conducted to evaluate the effectiveness of the program, as perceived by the NMFS centers that requested CIE reviews and chairs that oversaw the performance of CIE reviewers at individual reviews. Results from both assessments concluded that the CIE process is an effective peer review model for providing a pool of highly qualified and independent experts that strengthen NMFS's scientific quality assurance mission, that CIE reviewer participation during panel reviews were equally important products in comparison to the independent peer review reports, and that the strength of the CIE peer review process was its independence.

AB - Since 1998, the Center for Independent Experts (CIE), an independent peer review program, has conducted over 150 peer reviews of National Marine Fisheries Service (NMFS) assessments and products. The CIE peer review process has contributed to NMFS' efforts in improving the reliability and integrity of the agency's scientific information, and it is expected that NMFS' use of the CIE will increase in the future. Two assessments of the CIE program and reviewer performance, respectively, were conducted to evaluate the effectiveness of the program, as perceived by the NMFS centers that requested CIE reviews and chairs that oversaw the performance of CIE reviewers at individual reviews. Results from both assessments concluded that the CIE process is an effective peer review model for providing a pool of highly qualified and independent experts that strengthen NMFS's scientific quality assurance mission, that CIE reviewer participation during panel reviews were equally important products in comparison to the independent peer review reports, and that the strength of the CIE peer review process was its independence.

KW - Fisheries

KW - Independent peer review

KW - Magnuson-Stevens Act (MSA)

KW - National Marine Fisheries Service (NMFS)

UR - http://www.scopus.com/inward/record.url?scp=84867255810&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84867255810&partnerID=8YFLogxK

M3 - Conference contribution

SN - 1934272582

SN - 9781934272589

VL - 1

SP - 298

EP - 299

BT - WMSCI 2009 - The 13th World Multi-Conference on Systemics, Cybernetics and Informatics, Jointly with the 15th International Conference on Information Systems Analysis and Synthesis, ISAS 2009 - Proc.

ER -