{"id":6966,"date":"2020-11-04T17:41:28","date_gmt":"2020-11-04T17:41:28","guid":{"rendered":"https:\/\/www.mission-us.org\/timesnap\/?page_id=6966"},"modified":"2022-08-10T16:39:06","modified_gmt":"2022-08-10T16:39:06","slug":"research-outcomes","status":"publish","type":"page","link":"https:\/\/www.mission-us.org\/timesnap\/research-outcomes\/","title":{"rendered":"Research & Outcomes"},"content":{"rendered":"\n
\n
\n
\n \"\"\n
\n

Research & Outcomes<\/h1>\n <\/div>\n <\/div>\n <\/div>\n <\/header>\n\n\n\n

TimeSnap Research Study Overview<\/h2>\n\n\n\n
\n <\/span>PDF of complete study<\/a>\n <\/div>\n \n\n\n\n

TimeSnap is an interactive experience created under a Phase II Small Business Innovation Research (SBIR) grant administered by the US Department of Education s Institute for Education Sciences (IES). Originally created for VR, TimeSnap supplements traditional history teaching by giving students an immersive deep dive into a historical period and problem, and giving teachers curricular supports for deepening students understanding through discussion, writing and further study.<\/p>\n\n\n\n

Between December 2019 and February 2020, EDC s Center for Children and Technology conducted a classroom study of the TimeSnap VR interactive with 101 students in 6 classrooms. Students in the treatment classes (n=55) played the TimeSnap interactive on the Boston Massacre then completed related classroom activities. Students in the comparison classes (n=46) conducted a traditional document-based lesson on the same topic.<\/p>\n\n\n\n

This document presents top-level findings from EDC s classroom study. Download the
full study for more detailed description of the study s methods and results.<\/p>\n\n\n\n

Summary of Findings<\/h2>\n\n\n\n

Students who studied the Boston Massacre using TimeSnap and related classroom materials showed gains in historical knowledge, concepts, and skills compared to their peers who studied the Boston Massacre via traditional paper-based methods. Specifically, three gains are discussed below:<\/p>\n\n\n\n

\n
\n
  • \n
    \n

    TimeSnap students showed statistically greater gains in historical knowledge of the Boston Massacre, compared to peers in traditional classrooms.<\/p>\n <\/div>\n <\/li>\n

  • \n
    \n

    TimeSnap students showed greater grasp of two key concepts\u2014historical causation, and historical perspective\u2014than peers in traditional classrooms. <\/p>\n <\/div>\n <\/li>\n

  • \n
    \n

    After using TimeSnap, students displayed stronger document analysis skills when confronted with a novel visual source, particularly in observing visual details, and identifying the author\u2019s viewpoint. <\/p>\n <\/div>\n <\/li>\n <\/div>\n <\/section>\n\n\n\n

    Historical knowledge of the Boston Massacre<\/h3>\n\n\n\n

    The TimeSnap group showed significantly greater change on a 5-item measure of historical knowledge of the Boston Massacre than did the comparison group. All students were administered 5 historical knowledge items (See Figure 2 below) before and after the intervention. A difference of means analysis was performed on the scores (one-sample t-tests of pre-post change scores).<\/p>\n\n\n\n

    Figure 1 shows that the TimeSnap group saw statistically significant pre-post change on items 2, 3, 4 and 5. No statistically significant pre-post change emerged for the comparison group. The mean change score for the TimeSnap group was .19 compared to .04 for the comparison group (t=-2.7, p<.01). The Cohen’s d value is .54, which indicates a medium effect size.<\/p>\n\n\n\n

    \"\"
    FIGURE 1: TimeSnap Students\u2019 Improvement on Knowledge Items. Historical knowledge items that show significant pre-post change, Treatment group (n=56)<\/figcaption><\/figure>\n\n\n\n

    Grasp of Historical Thinking: Multicausality & Historical Perspective<\/h3>\n\n\n\n

    In addition to content knowledge, TimeSnap students showed significant improvement on two pre-post items measuring historical thinking. Comparison students showed no improvement on these items. Figure 2 below shows pre-post changes in the number of TimeSnap students who agreed or disagreed on a four-point scale with two statements:<\/p>\n\n\n\n

    QUESTION 1: Important events in history typically have a single cause.

    QUESTION 4: When eye-witnesses see the same event, they generally agree on what happened.<\/h4>\n\n\n\n

    Before using TimeSnap, students were more likely to agree with Q1, saying that historical events tend to have a single cause. After TimeSnap, students were more likely to disagree with the statement\u2014suggesting they now had a more multi-causal view of historical events.<\/p>\n\n\n\n

    \"\"
    FIGURE 2: Pre-Post Improvement in TimeSnap students\u2019 Historical Thinking. Historical thinking items that show significant pre-post change, Treatment group (n=56)<\/figcaption><\/figure>\n\n\n\n

    Similarly, before using TimeSnap students were more likely to agree that \u201cwhen eyewitnesses see the same event, they tend to agree on what happened,” while afterward more of them disagreed with this statement (Q4). These data are consistent with the idea that using TimeSnap gave students a deeper appreciation of the different viewpoints and perspectives that people, including eyewitnesses, bring to historical events.<\/p>\n\n\n\n

    Stronger Document Analysis Skills<\/h3>\n\n\n\n

    Finally, students using TimeSnap out-performed comparison students on a document analysis task, in ways that suggest the VR app and classroom lessons may be effective in building student document analysis skills, such as closely observing details and using these details to infer the author\u2019s viewpoint or perspective. Post-test Document Analysis Task. The post-test asked all students to analyze the following version of a 1774 engraving, Bostonians Paying The Excise Man, or Tarring and Feathering (Figure 3). Students responded to four prompts that asked them to:<\/p>\n\n\n\n