Examining the Effects of Testwiseness Using the FCI and CSEM

Testwiseness is generally defined as the set of cognitive strategies used by a student and intended to improve their score on a test regardless of the test's subject matter. To improve our understanding of the potential effect size of several elements of testwiseness we analyze student performance on questions present in the Force Concept Inventory (FCI) and Conceptual Survey on Electricity and Magnetism (CSEM) that contain distractors, the selection of which can be related to the use of testwiseness strategies. Additionally we examine the effects of the position of a distractor on its likelihood to be selected in 5-option multiple choice question. Finally we present a brief overview of the existence of the examined testwiseness effects present in a number of standardized physics assessments.