Enhancing Multiple Choice Tests Using Item Response Theory
This presentation demonstrates the utility of introducing an Item Response Theory (IRT) methodology, specifically the Rasch model, to complement Classical Test Theory (CTT) in the development and calibration of multiple-choice exams. Given the development and advances within IRT-methods and the prevalence of CTT in test development efforts conducted throughout the State, this presentation aims to demonstrate how modern IRT-based methods could be used alongside CTT to address current limitations in practice and improve the overall psychometric quality of multiple-choice exams. This presentation will show data from two prior administrations of multiple-choice exams to demonstrate how, through a consideration of examinee “ability”, the Rasch Model can: provide various sources of validity evidence, localize exam measurement precision, optimize exam length through eliminating redundant items, and equate test forms. The presenter will then draw some conclusions on the Rasch model’s feasibility, comparative ease of use to CTT, and expected challenges in implementation.
DATE: June 21st, 2018
TIME: 10:30 am – 11:30 am (lunch to follow after)
- $15.00 for nonmembers
- $10.00 for members
- $5.00 for students
1075 West Capitol Ave West Sacramento, CA 95691
Lenise’s Cafe & Lenise’s Cafe Express
- $10 per person which includes choice of full sandwich or half wrap, chips, drink, and cookies.
- Chips will be an assorted variety and cookies (in-house baked chocolate chip cookies).
- Lunch will follow after the event. Please feel free to stay for lunch and network with PTC-NC members and non-members.
Jorge has over five years of experience in selection with the State of California. He currently works in the Testing and Selection Unit at the Department of Justice, where he has worked on the development, validation and administration of multiple forms of exams and selection instruments. He is currently the President Elect of PTC-NC and earned his Master’s degree in Industrial/Organizational Psychology from Sacramento State University.
To attend the event, please fill out the event registration below: