Overview
The National Institutes of Health (NIH) has proposed changes to how the agency reports outcomes from peer review of grant applications. Under the current system, each reviewed application receives an overall impact score, averaged among scores assigned by peer reviewers. This score is shared with both the investigator who submitted the grant and the NIH advisory council or board responsible for making funding recommendations.
Under the proposed changes, review scores would no longer be released to investigators, program staff or advisory councils. Instead, grants will be placed into one of three categories based on their impact score:
- Most competitive. The top 25%of impact scores.
- Competitive. Impact score within the top 26% to50%.
- Not discussed. Score above 50%or applications not discussed.
Key Concerns from APS
- Withholding overall impact scores will diminish the role of peer review in funding decisions. Scientific merit, as judged by subject matter experts, must remain the primary factor in grant funding decisions.
- The proposed changes reduce transparency and accountability. Without access to an application’s overall impact score, applicants and stakeholders would have less insight into how funding decisions are made.
- The proposed system would create challenges for early-career researchers. Without access to review scores, less experienced researchers would have fewer opportunities to learn from the review process and refine future applications.
Read the Full APS Comment
The following comments are submitted on behalf of the American Physiological Society (APS) to NOT-OD-26-088, the Request for Information (RFI) on Proposed Changes to Reporting Outcomes from NIH Peer Review.
APS opposes NIH’s proposal to withhold the overall impact scores assigned to grant applications from applicants, institutions, program officers and advisory councils. The RFI states that the goal of this policy is to fully implement the Unified Funding Strategy, which calls for policies that consider factors including breadth of topics, investigator career stage, scientific priorities and broad distribution of funds, in addition to scientific merit. However, the government already achieves this goal while still providing overall impact scores through second level review. There is a difference between reducing the weight placed on a score and withholding it altogether, and the overall impact score provides an important point of reference for understanding how identified strengths and weaknesses are translated into the panel's overall assessment. The score does not need to be treated as a perfect measure of scientific merit or the sole determinant of funding to remain useful. Scores provide important context that can help applicants decide whether to revise and resubmit, substantially rethink a proposal, or redirect limited time toward another opportunity.
Withholding information about overall impact scores will diminish the role of scientific judgement and peer review in funding decisions and allow more room for political influence. While every Presidential administration has priorities that shape broad research agendas, scientific merit as judged by subject matter experts must remain the primary factor in deciding which science is worthy of taxpayer investment. Centering decisions about research funding on scientific merit provides some degree of insulation from political influence, regardless of which party is in office. Withholding the overall impact score from those involved in subsequent funding decisions risks shifting the balance away from peer-reviewed scientific merit, allowing other factors, including political bias, to influence decision-making.
The proposed system would reduce transparency and accountability by withholding critical information about scientific merit. While the Unified Funding Strategy outlines several factors for consideration in funding decisions, there is no rubric defining how much each factor plays a role in decision making. Thus, without an overall impact score, there is no way to know how and why funding decisions are made. This could lead to major differences in how different institutes fund science and runs contrary to the goal of a Unified Funding Strategy. Notably, the proposed system lacks details about who will retain access to the scores after applications have been placed into the proposed categories, whether that information will remain confidential, and how it might be used in the future. Suppressing scientific merit scores during key parts of the review and funding process will only further erode confidence in the U.S. scientific enterprise for both scientists and the broader community.
The proposed system will increase administrative burden. Withholding the overall impact scores from applications will make it harder to discriminate between proposals within each category, thereby dramatically increasing the workload on program staff and advisory councils, who will be making decisions without the benefit of assigned scores. It may also increase burden on applicants who decide to submit additional proposals while they wait to learn whether current applications will be funded or not, with little idea of whether that is likely. This in turn will create more work for volunteer peer reviewers, who will simultaneously find their contributions devalued as their assigned scores serve only to place applications in a given category. A substantial increase in workload under these circumstances is likely to disincentivize reviewers, making it harder to recruit scientists to serve in this role. While imperfect, the current U.S. system of peer review at NIH is arguably the envy of the world, serving as a model for other funding organizations.
The proposed system creates concerns about equity for early career researchers. Established investigators often have years of experience with study sections, previous submissions, experienced colleagues, and institutional grants infrastructure to help interpret qualitative feedback. Trainees and early-career investigators have much less accumulated knowledge. Providing applicants with less information may therefore make outcomes more dependent on access to strong mentorship and well-resourced professional networks, potentially widening rather than reducing disparities. From a trainee perspective, preserving access to scores alongside the qualitative review supports transparency, learning, and more informed decisions about future submissions.
This proposal was developed by an internal working group of unnamed NIH leaders who did not consult the community in developing the proposal. This is counter to the NIH’s stated goal of increasing transparency and accountability, and also out of line with previous changes to the peer review process which involved iterative consultation with the scientific community.
Why It Matters
Although imperfect, the peer review process at NIH ensures that scientific merit remains the central factor in grant funding decisions. The current system has driven decades U.S. scientific excellence and led to significant advances in medical treatment and prevention. Withholding overall impact scores weakens the role of scientific judgment, creates additional administrative burden, disadvantages early-career investigators, and removes critical transparency and accountability from the most important function of the nation’s premier scientific agency.
Stay Connected
Stay engaged with APS advocacy efforts.