Index to Chiropractic Literature
Index to Chiropractic Literature
My ICL     Sign In
Thursday, March 4, 2021
Index to Chiropractic LiteratureIndex to Chiropractic LiteratureIndex to Chiropractic Literature
Share:


For best results switch to Advanced Search.
Article Detail
Return to Search Results
ID 26394
  Title Designing tests from question pools with efficiency, reliability, and integrity
URL https://journal.parker.edu/index.php/jcc/article/view/128
Journal J Contemp Chiropr. 2020 ;3(1):92-100
Author(s)
Subject(s)
Peer Review Yes
Publication Type Article
Abstract/Notes

Objective: This article provides resources for educators performing online assessments to curb cheating. We will focus on a method to prevent cheating known as “peer-to-peer sharing” (P2PS), where students take the test together without supervision. Using probability theory, we develop the framework for rigorously analyzing P2PS for given parameters of question pool size, assessment size, and class size.

Methods: The development was as follows: (1) We define “integrity” and “reliability” of online assessments in the context of P2PS; (2) we derive formulas for both reliability and integrity; (3) we address the question of how large a question bank should be to attain a specified level of reliability and integrity, paying special attention of efficiency: (4) we provide a table with sample results for common classroom scenarios to help educators devise efficient question banks; and (5) we include summary charts of cheating methods and strategies. Theoretical models are used to characterize the probabilistic scenario we explore. We use the cumulative distribution function of the hypergeometric function to model this relationship. This model was verified using computer simulations.

Results: Probability theory was used to both define and derive formulas for “reliability” and “integrity” of an online assessment. Charts were created that include question pool size, question number, integrity and reliability for a given student class size.

Conclusion: Educators can use the Tables in this article to determine a reasonable question pool size and amount of questions for an assessment to obtain the integrity and reliability they desire given class size. Summary charts of cheating methods and strategies are included from the literature to provide resources for further exploration of management of cheating and promoting test integrity and reliability. It is difficult to achieve both reliability and integrity if a large portion of the class cheats unless the question pool is very large. 

Author keywords: Classroom Assessment, Cheating, Testing Procedures

Author affiliations: MM: Palmer Chiropractic College, Port Orange, Florida, United States; MB: Embry-Riddle Aeronautical University, Daytona [Beach], Florida, United States

This abstract is reproduced with the permission of the publisher. Click on the above link for free full text. Online access only.  PDF Version


 

   Text (Citation) Tagged (Export) Excel
 
Email To
Subject
 Message
Format
HTML Text     Excel



To use this feature you must register a personal account in My ICL. Registration is free! In My ICL you can save your ICL searches in My Searches, and you can save search results in My Collections. Be sure to use the Held Citations feature to collect citations from an entire search session. Read more search tips.

Sign Into Existing My ICL Account    |    Register A New My ICL Account
Search Tips
  • Enclose phrases in "quotation marks".  Examples: "low back pain", "evidence-based"
  • Retrieve all forms of a word with an asterisk*, also called a wildcard or truncation.  Example: chiropract* retrieves chiropractic, chiropractor, chiropractors
  • Register an account in My ICL to save search histories (My Searches) and collections of records (My Collections)
Advanced Search Tips