Validating the REGRESS (REsearch on Global Regression Expectations in StatisticS) Quiz Among UMich Public Health Graduate Students

Validating the REGRESS (REsearch on Global Regression Expectations in StatisticS) Quiz Among UMich Public Health Graduate Students

Academic Year:
2013 - 2014 (June 1, 2013 through May 31, 2014)
Funding Requested:
$3,000.00
Project Dates:
-
Applicant(s):
Overview of the Project:
Understanding statistics is becoming increasingly important in a data saturated world. Demand could surpass supply by more than 140,000 in deep analytical positions by 2018. This growing demand prompted employers to request that colleges "place more emphasis" on critical thinking and analytic reasoning, complex problem solving, and quantitative reasoning. Statistics courses, even at the introductory level, teach and instill these traits in students to help them become successful professionals. At the University of Michigan, we attempt to arm public health students with statistical tools by requiring a few introductory statistical courses in graduate school. There is not, however, much statistical education research of how effective these courses are, verifying that students with broad backgrounds leave their programs understanding the fundamentals of statistical analysis. This project aims to validate the REGRESS (REsearch on Global Regression Expectations in StatisticS) quiz for public health graduate students completing a course on regression. Validation will help to verify that students understand the fundamental concepts of regression and interpretation, skills which are indispensable and in high demand in many fields. Validation includes establishing normative levels in a graduate student population and investigating how success on the REGRESS quiz corresponds to course grades. Furthermore, students' perspectives on the value of the quiz will be qualitatively assessed. Finally, I am hopeful that I will teach this course again next year, consequently adapting the course based on the students' performance and evaluation of the REGRESS quiz, and thus, have the opportunity to implement the quiz after course modification.
Final Report Fields
Project Objectives:

1. To implement the REGRESS quiz in Biostat 513 in winter semesters 2013 and 2014. 2. To use the quiz as both a learning tool for the students and as an evaluation of curriculum for the professor. 3. To disseminate this experience and information to the biostatistics department, the University of Michigan, and a larger statistics audience via presentations, poster, and a manuscript.

Project Achievements:

This project helped students in understanding their linear regression strengths and weaknesses in a simple, relatively quick 27 item quiz. Moreover, by implementing this quiz, I was able to have an objective measure of understanding of the students and modify course material. Based on the 2013 Biostat 513 group, I modified course lectures by including clickers and 3-5 clicker questions in each class to focus on concepts which students had preformed poorly. The 2014 cohort scored higher on average due to this intervention and the students gave very positive reviews about including clickers. I intend to continue to modify the course based on REGRESS performance (there is still more to be desired in terms of performance on the REGRESS). Therefore, I believe this project has positively impacted Biostatistics 513 and the public health students enrolled for 2013, 2014 and the future.

Continuation:
Yes. I am continuing to work with Felicity Enders, PhD, from Mayo Clinic who developed the REGRESS tool. We have plans to modify the tool and to have other institutions implement it to continue to validate it. We were unable to submit our panel discussion for the Joint Statistical Meetings this year, but intend to do so in 2015 to share our experience. I will continue to use the REGRESS in the classroom as it is a great learning tool for the students.
Dissemination:
I have shared with some of my colleagues about using this quiz and subsequently incorporating clickers into my classroom. I intend to share in greater detail with my department soon. I presented a poster at the Enriching Scholarship Keynote Event. Dr. Enders and I wrote a manuscript about our experience and it is currently under review at the journal of Clinical and Translational Science. We also intend to submit a panel discussion with a few other statisticians interested in statistics teaching and learning in the health sciences to the 2015 Joint Statistical Meetings.