Peer Review

Signal Detection Theory Tutorial

Material Detail page

Reviewed:: Jan 10, 2010 by Statistics

Bookmark

Ratings

Overall Rating:

Content Quality:

Effectiveness:

Ease of Use:

Overview:: This online tutorial introduces the topic of Signal Detection Theory (SDT). The tutorial explains the theory behind signal detection, covers several SDT measures of performance, and also introduces Receiver Operating Characteristics (ROCs). The tutorial uses a JAVA applet to show the relationships between the measures of performance. The tutorial is designed for those at the introductory level but also includes information for more advanced students and researchers.
Type of Material:: Tutorial, containing JAVA applet, examples, and questions.
Recommended Uses:: This can be used in class as a demonstration by the instructor or a lecture aid. It can also be used outside of class as part of a lab or homework assignment, or as a way for students to review material and practice applying what they are learning in class about Signal Detection Theory. T
Technical Requirements:: Web browser with java and java script enabled
Identify Major Learning Goals:: Be able to find and explain the quantities d and criterion and the receiver operating characteristics. Understand the theory behind signal detection, different SDT measures of performance, basic vocabulary related to SDT, and Receiver Operating Characteristics (ROCs). Engage in opportunities for self-assessment.
Target Student Population:: Students must understand hypothesis testing, normal curves, and p-values. An upper-level undergraduate student or a graduate student would find this accessible.
Prerequisite Knowledge or Skills:: Basic understanding of hypothesis testing, p-values, and z-scores.

Content Quality

Rating:
Strengths:: Each concept is defined, and then described with an example. There is discussion about how the different measures work together. The tutorial breaks down a complex concept and explains that concept in terms that are easy for beginners to understand. There are many graphics to accompany different explanations, and students have opportunities throughout the tutorial to practice what they are learning and test themselves.
Concerns:: Many introductory statistics textbooks present normal distribution tables that give left-tail probabilities, but the p-value converter within this tutorial asks for a right-tail probability. Might that end up confusing students?

Potential Effectiveness as a Teaching Tool

Rating:
Strengths:: Offers a clear description of the concepts being discussed. The information here is very well written, and accurate instructions are provided. The tutorial includes instructor's notes for how to use this tool in a variety of different ways in and outside the classroom. The tutorial encourages students to be active participants in the learning process by providing them with many opportunities to stop and check their understanding before proceeding to other content.
Concerns:: It might be helpful to include more "real world" examples so students can see how Signal Detection Theory applies to their every day lives. This is especially important since the overview for this tutorial notes that "Every day we have to make decisions about uncertain events." Providing more examples of such events and working through those examples might engage students. Also, it would be helpful to know more about just where this might fit into the curriculum in a course, and to see some example assignments students might be given outside of class that would use this tutorial.

Ease of Use for Both Students and Faculty

Rating:
Strengths:: It's very easy to navigate. Each page has a link at the bottom to the previous page, the index, and the next page. There are many links along the way where students can get help if they need it or more information about how to use different tools. Information is broken down into different sections and clearly labeled. There doesn't appear to be too much going on all at once on a page that might distract users or make it difficult for them to find relevant information.
Concerns:: None.

Other Issues and Comments:: I'm not sure if I would use this in class, simply because I don't have room in my schedule to add another topic. But in a class where it fits, it would be a good homework assignment.
Creative Commons: