As we pass the middle of the term, instructors are asked to think about course evaluations that students complete at the end of the term (November 19-December 10). Twelve days before evaluations open, U-M instructors are invited to preview evaluation questions and create a few of their own if they wish. What principles or goals might guide you in that process?

In this blog post, we review the university-wide questions that appear on end-of-semester evaluations, and we offer guidance on how to make the most of instructor-created questions. These principles can also be used to create questions for feedback that you collect at other times of the semester. In addition, this previous CRLT blog post provides strategies for increasing student response rates, and this Registrar's site contains details about the course evaluation process.

Overview of Fall 2021 Standard Questions

Fall 2021 forms will revert to questions that do not focus on the pandemic. These include eight required items (rated on a scale of “Strongly Agree” to “Strongly Disagree” for all but one, as noted below):

• This course advanced my understanding of the subject matter.
• My interest in the subject has increased because of this course.
• I knew what was expected of me in this course.
• I had a strong desire to take this course.
• As compared with other courses of equal credit, the workload for this course was (Much Lighter, Lighter, Typical, Heavier, Much Heavier)
• The instructor seemed well prepared for class meetings.
• The instructor explained material clearly.
• The instructor treated students with respect.

These questions provide some general comparison with other courses and are often included in administrative decisions (e.g, promotion, tenure, contract renewal).

Please note: The former University-wide questions known as “Q1” (This is an excellent course) and “Q2” (This instructor was an excellent instructor) may be included as school/college level questions in some units, but are no longer on the University-wide form.

Guidance for Instructor-Created Questions

U-M's course evaluations also allow for up to five optional, instructor-created questions. You can add up to three multiple-choice questions and up to two short-answer questions. This can be a great opportunity to ask students to consider specific features of your class (e.g., choice of course materials, particular learning activities, instructional technologies, or guest speakers) in their feedback.

In forming customized questions, some best practices include the following:

• Write questions that focus on one thing only. For example, a bad question would be “How useful were the instructional materials and activities for this course?” This question asks about two things (materials and activities). Focusing on the one thing that is most pressing to you will garner clearer feedback.
• Be specific. Students will be able to provide better feedback to more specific questions. For example, getting student input on the usefulness of a particular activity, or asking them to share the most important point(s) they learned during the semester, can provide useful information for future course planning.
• Focus on relevant and actionable concepts. Students may receive up to 150 questions across their courses in a sample semester of five courses. Making sure that questions are relevant (and do not also appear in the standard questions listed above or in departmental questions) will increase the likelihood that students will answer them. Similarly, it is advisable to ask questions about aspects of the course over which you have control.
• Choose the best format: Multiple-choice questions are easy and quick to answer and analyze, offer consistent responses, and allow for easy comparison. However, the choices you offer may put answers into students' minds, or they may not include the answer students wish to give (a good reason to avoid yes/no questions entirely). Short-answer questions take longer for students to complete and for you to analyze, but they permit an unlimited range of answers and give insights into student thinking. In general, it is best to reserve short-answer responses for questions that do not have easily delimited choices or for which you want to give students space to explain their thinking.

If you would like to talk with a CRLT consultant about forming questions to get feedback from students, we would welcome your request at crltassessment@umich.edu.