STAR METRICS

STAR METRICS (Science and Technology for America's Reinvestment: Measuring the EffecT of Research on Innovation, Competitiveness and Science) is a partnership (STAR METRICS Consortium) between United States federal science agencies and research institutions to document the return on investment, research impact, and social outcomes of federally funded research and development. The federal consortium comprises the White House Office of Science and Technology Policy (OSTP), the National Institutes of Health (NIH), the National Science Foundation, (NSF), the US Department of Agriculture, (USDA), and the US Environmental Protection Agency,(EPA). NIH is the host agency for the consortium, which is governed by an Executive Committee and an advisory interagency working group. Dr. Sally Rockey, Deputy Director of Extramural Research, NIH is the Lead Entity Executive for the STAR METRICS consortium. A trademark application has been filed for ""STAR METRICS"" by the US Department of Health and Human Services and is pending with the USPTO.

It was announced by OSTP on 28 May 2010 in a press release titled "STAR METRICS: New Way to Measure the Impact of Federally Funded Research".[1]

Pilot

A pilot was undertaken by the following seven institutions in a Federal Demonstration Partnership:[2]

History

The imperative for the launch of STAR METRICS was the passing of the post-global financial crisis American Recovery and Reinvestment Act of 2009 (ARRA), which included a stimulus package for research and development because it was widely believed that investments in science and research would stimulate economic growth. Part of the bill required recipients to report quarterly on job creation.[3][4][5][6] The ARRA reporting requirements are distinct from STAR METRICS. The latter was established to provide evidence that investment in research had a positive effect on the economy, because there is little thoroughly conclusive evidence that this is actually the case - even though it is a generally accepted assumption.[4]

In 2010 STAR METRICS was given a five year commitment from agencies, and NIH and NSF committed $1 million combined.[7][8] Other federal funders that have joined are the United States Department of Energy, Environmental Protection Agency, and Department of Agriculture. Research institutions voluntarily join the consortium.

The formal governance was put in place in January 2012, with NIH hosting the project.[8]

The goal of the program was set to develop measures for the impact of federal investments on science, society, the workforce and the economy. To this end, a database was set up of all federally funded researchers and cleaned to ensure no confusions of people with the same or similar names etc. were made. This database was then used to match with other accessible databases such as public records of patents, institutional financial records, payroll data, as well as more traditional scientific output indicators such as scientific citations.[4][9]

Outcomes

An attraction of STAR METRICS project was that it would scrape data from existing reports, databases, and the internet for the information it needed, much like the Lattes Platform in Brazil.[7][10]

STAR METRICS quickly started tracking job creation from ARRA and non-ARRA research grants at 70 universities, and subsequently moved on to tracking other outcomes of investment in research.[5]

See also

References

  1. ↑ STAR METRICS: New Way to Measure the Impact of Federally Funded Research, White House Office of Science and Technology Policy
  2. ↑ FDP, STAR METRICS page
  3. ↑ Julia Lane (25 March 2010). "Let's make science metrics more scientific". Nature 464 (7288): 488–489. doi:10.1038/464488a.
  4. ↑ 4.0 4.1 4.2 Colin Macilwain (9 June 2010). "Science economics: What science is really worth". Nature 465: 682–684. doi:10.1038/465682a.
  5. ↑ 5.0 5.1 Colin Macilwain (28 September 2011). "A multi-billion dollar injection: Stimulus—response". Nature 477: 524–525. doi:10.1038/477524a.
  6. ↑ Gali Halevi (March 2012). Research Trends (27) http://www.researchtrends.com/issue-27-march-2012/scientific-evaluation-and-metrics-an-interview-with-julia-lane/. Missing or empty |title= (help)
  7. ↑ 7.0 7.1 David Kramer (August 2010). "Initiative aims to quantify the paybacks from basic research". Physics Today: 20.
  8. ↑ 8.0 8.1
  9. ↑ Julia Lane, Stefano Bertuzzi (11 February 2011). "Measuring the Results of Science Investments". Science 331: 678–680. doi:10.1126/science.1201865.
  10. ↑ "EU looks to US model for measuring R&D impact". EurActiv. 16 April 2010.

External links