• Lawson DM
• Lawson MA

• Association of Chiropractic Colleges / congresses

Methods: The diagnostic imaging examination consisted of 16 cases: 8 PowerPoint and 8 booklet images, with 3 multiple-choice questions per case. Two different examinations were used, A and B with all cases and questions being common to both examinations. The morning group of candidates was assessed with PowerPoint examination A and Booklet examination B. The afternoon group (uncontaminated by the morning group of candidates) was examined with PowerPoint examination B and Booklet examination A. The cross over study was done to determine if the booklet examination scores were equivalent to the PowerPoint examinations. For this examination, the images from the PowerPoint presentations were printed in booklet form. This resulted in a lower resolution in the booklets than can be achieved by printing directly from image files. Internal consistency was estimated with Cronbach’s Alpha. Analysis of variance (ANOVA) was performed on morning and afternoon candidate scores to determine of one method of examination was significantly different. Descriptive statistics were also calculated for the four examination groups. Candidate feedback was reviewed.

Results: Eighty-two candidates were assessed, 42 in the morning group, and 40 in the afternoon group. Estimates of internal consistency for the examinations (Alpha) ranged from 0.64 to 0.71. The four examination groups, and their mean percentage scores, were: 1) PowerPoint A, 87%; 2) Booklet A, 88%; 3) PowerPoint B, 91%; and 4) Booklet B, 92%. Both morning and afternoon candidates scored higher on the booklet forms of the examination. The analysis of variance found no differences between the performance of candidates between booklet and PowerPoint forms (F=2.18, p=0.10). Feedback from candidates included the expected concern over image quality, but also feedback that candidates preferred the booklets as they could set their own pace. Some candidates experienced wavering attention during the PowerPoint presentation when easier cases were on the screen for the same amount of time as more difficult cases.

Discussion: Although assessment of competency is not a popularity contest, it is important to consider candidates response to changes in testing procedures and to ensure such changes do not negatively impact the performance of candidates. Even though the booklet images did not have as high a resolution as possible from direct printing of image files, candidates were not disadvantaged by the move to booklet form, and many candidates voluntarily provided feedback that they preferred the booklet form. This research project is limited somewhat by the sample size, both from the perspective of candidate numbers and items on the test.

This abstract is reproduced with the permission of the publisher.