ISU Physician Assistant Program

PA Program Research Projects

Title: Improving PACKRATand PANCE Exam Scores by Requiring Student Use of an Online Medical Question Bank
Sponsoring Organizations: Idaho State University Department of Physician Assistant Studies and Medical School of South Carolina, Physician Assistant Program
Dates: Data collection occured in the 2008-2009 school year. This is a pilot study which we hope to expand into a national study. Results of this pilot study will submitted for presentation at the 2009 PAEA conference in Portland, Oregon.
Principle Investigator: Bernadette Howlett, M.S., PhD
Assistant Professor of Research, Idaho State University, Department of Physician Assistant Studies
Co-PI's
  • Paul Jacques, DHSc, PA-C, Medical University of South Carolina, Physician Assistant Program
  • Cathryn Erickson, Health and Nutrition Sciences Bachelor's student, Physician Assistant Studies Student Research Assistant.
Type: Descriptive, non-random, retrospective control study
Funding: The two sponsoring programs are funding the direct costs of this project.
Human Subjects: This study has been approved by the Human Subjects committee of Idaho State University and is pending approval by the Medical University of South Carolina.
Abstract: Statement of the Problem: Curricula in most physician assistant (PA) training programs include a greater amount of information than there is time to deliver it. This is due to the nature of medicine with its ever expanding breadth and depth of knowledge. The national board examination for physician assistants covers a selected range of topics in which programs must assure students are competent. The enormous scope of medical subject matter presents a challenge to PA programs in avoiding the tempation to "teach to the test." Curricular emphasis needs to be on developing skilled clinicians who possess not only the needed fund of basic medical knowledge, but also the necessary cognitive and communication skills to be effective and ethical healthcare providers. Administering valid assessments is particularly challening in today's medical training environment. One potential solution is the use of online medical question banks (such as Exam Master Online). These systems include questions written by subject matter experts that are aligned with the national certifying examination. As such, an online medical question bank may not only address the curricular need, but might also improve student scores on the PACKRAT (Physician Assistant Clinical Knowledge Rating and Assessment Tool) and the PANCE (Physician Assistant National Certifying Examination). This study explores the theoretical frameworks of assessment and instructional alignment.

Participants in this study will be students attending Physician Assistant programs that use Exam Master Online (EMO). At this time, two schools have agreed to participate: Idaho State University and Medical University of South Carolina. All students in these two programs will participate by taking exams administered through EMO. Student records will be deidentified before they are submitted to the study. Only aggregate data will be reported. The student data comes from examinations that have previously been administered as a normal component of the curriculum.

Background: The research question to be explored in this study is to determine whether the use of Exam Master is correlated with: a) student exam scores on the PACKRAT; and, b) student exam scores on the PANCE.

The PACKRAT is a preliminary test used to assess how well a PA student will score on the National Board Exam. The National Board Exam is a manditory test which all PA students must pass before they are permitted to practice as a physician assistant. Preparing students to succeed in these exams it critical. There are many resources available to help prepare students to take these exams, one of which is an online testing system known as Exam Master Online.

Exam Master is an online question bank which helps to prepare students to take these tests. It provides students with numerous practice exams which simulate the National Board Exam in content and question construction. It allows students to take multiple exams and review their results. It is an exceptional training tool which may be correlated to higher exam scores on both the PACKRAT and the PANCE.

Preliminary data compiled by the ISU and Medical University of South Carolina Physician Assistant programs indicates that the use of Exam Master improves student exam scores on the PAKRAT exam. In May of 2009, 47 ISU PA students took the PACKRAT exam. Thirty-three of the 47 students scored above the national average, a feat that has never been accomplished by ISU's PA program.

There is strong anecdotal evidence to suggest that Exam Master improves student scores on the PACKRAT and possibly on the PANCE, because PACKRAT scores are highly predictive of student's scores on the PANCE. Therefore, it is the goal of this project, to assess this hypothesis by using data collected by other universities who also use Exam Master.

Contact Information: Bernadette Howlett
Research Assistant Professor
howlbern@isu.edu
208-282-3841

Cathryn Erickson
Student Research Assistant
martcath@isu.edu
208-282-3841

Phone: (208) 282-4726 | Fax: (208) 282-4969 | pa@isu.edu
Pocatello Physical Address: 1021 S. Red Hill Road, Red Hill Building #40, Pocatello, Idaho
Pocatello Mailing Address: 921 S. 8th Ave. Stop 8253, Pocatello, ID 83209-8253
ISU-Meridian Health Science Center Physical & Mailing Address: 1311 E. Central Dr., Meridian, ID 83642