Obtaining formative feedback in the classroom is a powerful ingredient for supporting student learning (Trumbull and Lash, 2013). By knowing in real-time the degree to which students understand concepts and can engage in higher-order thinking around course material, instructors can nuance their approaches to foster learning. Audience response systems (ARS) can help with these assessments by measuring student progress toward desired learning objectives. The use of ARS typically involves students answering questions for which immediate feedback is provided, like clickers, polling technologies, and index cards. These and other tools can be implemented in a variety of class types including large lecture courses and seminar-style classes, and can be used with individual, team, or group assignments.
Examples
- Poll Everywhere - PollEverywhere is a cloud based polling solution designed to allow instructors to collect students responses in real time, or after a class or assignment. Students use a laptop, cell phone, or other device to answer questions of varying types, and instructors obtain real-time feedback on learning. Software like this can be popular for its accessibility to many populations of students, real-time statistical data, and options for anonymity. Instructors should consider how to manage the classroom as they introduce the use of electronic devices in the classroom. Further, to promote an equitable experience, instructors can consider how to accommodate students who may not have access to a smart phone or computer or have the ability to use the necessary software. Instructors can obtain a Yale licensed account by contacting the Poorvu Center. Attend a Poll Everywhere workshop in the Poorvu Center to learn how you can build polls and integrate them into your course materials. Request a consultation with a Poorvu Center staff member to discuss Poll Everywhere.
- Colored Index Cards - A simpler version of clickers is ABC index cards. Instructors can use a different colored note card for each answer option and provide a set to each student or group. As with other methods, instructors can develop a series of questions and students can respond by holding up the appropriate card. Using this type of audience response system, students are held more accountable to their more publicly displayed choices. Additionally, index cards can be collected and reused.
- Folded Paper - Another simple ARS involves using folded paper with A, B, C, D options. A template can be found here: Colored ABC Card. Using this tool, students fold the paper to the correct response and hold it up for viewing, similar to the colored index card approach. The templates may be colored-printed and disseminated to students at the beginning of the semester to bring to class each day.
Recommendations
- Use best practices in designing multiple choice questions - If instructors assess students using multiple choice questions, resources exist for designing quality multiple choice questions that follow best practices, including testing for concepts over content, consistent structures, and clearly differentiated answers.
- Assess prior knowledge and modify instruction - Research indicates many ways in which students' prior knowledge and previously developed conceptions inform and affect the ways they learn new knowledge (Ambrose, et. al, 2010). In general, ARS can be implemented to assess students’ prior knowledge on a particular concept, gauging where students stand in their learning and helping instructors modify their approach accordingly.
- Conduct pre-/post- assessments - ARS may be implemented as pre-/post- assessments. This approach activates prior knowledge by re-assessing students with the same or similar questions after instruction, in order to monitor learning progression.
- Engage in problem solving - In class sessions where students solve problems with single solutions such as in a science, math or engineering course, instructors can implement clickers to assess whether students have arrived at the correct answer. For courses featuring problems with a variety of solutions (medicine, philosophy, management), systems like colored cards can be scaled up to measure general progress or differing strategies that students or groups are deploying.
- Implement during teamwork - To promote student engagement in learning, students can work in teams and respond to polling questions in a competitive fashion. This social learning experience and competitive format has been shown to motivate student learning and improve learning outcomes.
- Accessibility Awareness - Instructors utilizing software, clickers, and related technology should be aware of student accessibility concerns, and provide dynamic policies to support students who are technologically inexperienced or barred from maintaining their own electronic devices.
References
Ambrose, S., Bridges, M., Lovett, M., DiPietro, M., & Norman, M (2010). How Learning Works: 7 Research – Based Principles for Smart Teaching. San Francisco: Jossey-Bass.
