Peer Review

Metrics-Toolkit.org | Helping you use metrics responsibly

Material Detail page

Reviewed:: May 21, 2020 by Sociology

Bookmark

Ratings

Overall Rating:

Content Quality:

Effectiveness:

Ease of Use:

Overview:: The Metrics Toolkit provides evidence-based information about research metrics across disciplines, including how each metric is calculated, where you can find it and how each should (and should not) be applied. You'll also find examples of how to use metrics in grant applications, CVs, and promotion dossiers. The Metric Toolkit was developed thanks to the 2016 Force11 PitchIt! innovation grant, as well as support from Oregon Health & Sciences University (OHSU).
Type of Material:: Reference material.
Recommended Uses:: Individual researchers can track impact and use the information for grant applications, CVs, or promotion dossiers. Institutions can track the impact of the research across all disciplines for their faculty/researchers. It could be introduced in capstone or advanced/graduate research methods courses to demonstrate how to track and use the data to promote their accomplishments. it may be used in courses geared to preparing individuals to seek employment towards the end of a degree or for continuing education for professionals who are seeking career movement.
Technical Requirements:: The student or professional should also have knowledge of basic statistics and software that can calculate the metrics.
Identify Major Learning Goals:: This is a reference tool to provide an overview to researchers and institutions of a variety of sources available to track individual and institutional impact based on their research (e.g., number of citations).
Target Student Population:: College Upper Division, Graduate School, Professional.
Prerequisite Knowledge or Skills:: Some understanding of research methods and statistical analysis. Ability to use the internet and a browser that can connect to links on calculating the various metrics.

Content Quality

Rating:
Strengths:: This site provides general information about sources available to track the impact of research and ideas of individuals, groups, and institutions. Links to metric sources are included and critiqued. Detailed examples are provided to demonstrate the use of metrics in CVs, grant applications, and promotion dossiers.
Concerns:: Most of the information explaining the metrics is found on the linked pages and is of varying clarity and completeness.

Potential Effectiveness as a Teaching Tool

Rating:
Strengths:: This reference material is a good place to start to understand how to use metrics to document the research impact of individuals or instititutions. The examples of their use in grant applications, promotion dossiers, and CVS are outstanding.
Concerns:: Some of the sources may require an institutional/individual license. Some Universities may already have metric programs for use by faculty, researchers, and institutional research. The Filter function was a bit unclear and could use some illustrations and directions.

Ease of Use for Both Students and Faculty

Rating:
Strengths:: The site has a concise statement on the purpose of the site. It is easy to navigate. The information on each metric source is consistent for easy comparisons. The links to metric sites are operational. Some additional directions and a few examples on how to use the material would bridge any gaps in understanding.
Concerns:: There are two tabs - Explore Metrics and Choose Metrics. They seem to access the same information. The Choose Metrics provides a filter to search for specific metrics for particular material -- journal articles, book reviews, etc. More directions needed for beginners.

Other Issues and Comments:: I would have liked more examples under their Use Cases that demonstrate how different metrics are being used across disciplines.
Creative Commons: