Index to Chiropractic Literature
Index to Chiropractic Literature
My ICL     Sign In
Thursday, April 25, 2024
Index to Chiropractic LiteratureIndex to Chiropractic LiteratureIndex to Chiropractic Literature
Share:


For best results switch to Advanced Search.
Article Detail
 Return to Search Results
ID 26068
  Title Development of a student grading rubric and testing for interrater agreement in a doctor of chiropractic competency program
URL https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6759009/
Journal J Chiropr Educ. 2019 Oct;33(2):140-144
Author(s)
Subject(s)
Peer Review Yes
Publication Type Article
Abstract/Notes

Objective: Clinical competency is integral to the doctor of chiropractic program and is dictated by the Council of Chiropractic Education accreditation standards. These meta-competencies, achieved through open-ended tasks, can be challenging for interrater agreement among multiple graders. We developed and tested interrater agreement of a newly created analytic rubric for a clinical case-based education program.

Methods: Clinical educators and research staff collaborated on rubric development and testing over four phases. Phase 1 tailored existing institutional rubrics to the new clinical case-based program using a 4-level scale of proficiency. Phase 2 tested the performance of the pilot rubric using 16 senior intern assessments graded by four instructors using pre-established grading keys. Phases 3 and 4 refined and retested rubric versions 1 and 2 on 16 and 14 assessments, respectively.

Results: Exact, adjacent, and pass/fail agreements between six pairs of graders were reported. The pilot rubric achieved 46% average exact, 80% average adjacent, and 63% pass/fail agreements. Rubric version 1 yielded 49% average exact, 86% average adjacent, and 70% pass/fail agreements. Rubric version 2 yielded 60% average exact, 93% average adjacent, and 81% pass/fail agreements.

Conclusion: Our results are similar to those of other rubric interrater reliability studies. Interrater reliability improved with later versions of the rubric likely attributable to rater learning and rubric improvement. Future studies should focus on concurrent validity and comparison of student performance with grade point average and national board scores.

Author keywords: Education, Chiropractic, Validation Studies as Topic

Author affiliations: KW, MS: Research Department, Life Chiropractic College West,Hayward, California, United States; KK, RP, LS: Health Center, Life Chiropractic College West; JM: Radiology Department, Life Chiropractic College West 

This abstract is reproduced with the permission of the pubisher. Click on the above link for free full text. PubMed Record

 
   Text (Citation) Tagged (Export) Excel
 
Email To
Subject
 Message
Format
HTML Text     Excel



To use this feature you must register a personal account in My ICL. Registration is free! In My ICL you can save your ICL searches in My Searches, and you can save search results in My Collections. Be sure to use the Held Citations feature to collect citations from an entire search session. Read more search tips.

Sign Into Existing My ICL Account    |    Register A New My ICL Account
Search Tips
  • Enclose phrases in "quotation marks".  Examples: "low back pain", "evidence-based"
  • Retrieve all forms of a word with an "asterisk*", also called a wildcard or truncation.  Example: "chiropract*" retrieves chiropractic, chiropractor, chiropractors
  • Register an account in My ICL to save search histories (My Searches) and collections of records (My Collections)
Advanced Search Tips