Since a main goal of this work is to develop a CKT assessment instrument that can be scored efficiently and used as an indicator system on a large scale, we only developed discrete, automatically-scorable items. They included several item types: single-select multiple choice, multiple-select multiple choice, grid, and drag-and-drop items.
CKT Matter Item Overview
Here we provide examples of various CKT assessment items about matter and its interactions that we developed and piloted during this project. Each CKT item:
- is aligned to one of the five matter topics and one of the seven WOTS instructional tool categories.
- includes an opening scenario that describes an instructional situation and provides relevant information, such as information about students, learning goals, a classroom, or where the activity is located within an instructional sequence.
- may also include various static stimuli such as copies of students’ written work or images of science instructional materials, as well as more dynamic stimuli such as video or audio snippets providing access to student talk or work or showing students interacting with one another or teachers in an instructional setting.
CKT Matter Item Features
Each CKT item example document includes four sections:
- Section 1 (item information) provides details about the item type and grade band, as well as identifies the WOTS instructional tool, science teaching practice, and content topic with which the item is best aligned.
- Section 2 (item content) includes the teacher-focused instructional scenario, the item stem, and the response information.
- Section 3 (key information) identifies the item’s intended correct response and provides a written rationale for both the item key and the distracters.
- Section 4 (pilot information) provides results from piloting the specific CKT item with a sample of pre-service elementary teachers in the United States, including the proportion correct, the item-total correlation, and the median item response time.
These CKT matter item examples are accessible to registered users and appear below when logged into the website. Click the link in the top right menu to create an account if you have not done so already.