Friedman, A. M., & Heafner, T.L. (2007). You think for me, so I don’t have to. Contemporary Issues in Technology and Teacher Education [Online serial], 7(3). Retrieved from http://www.citejournal.org/volume-7/issue-3-07/social-studies/you-think-for-me-so-i-dont-have-to-the-effect-of-a-technology-enhanced-inquiry-learning-environment-on-student-learning-in-11th-grade-united-states-histor

“You Think for Me, So I Don’t Have To.” The Effect of a Technology-Enhanced, Inquiry Learning Environment on Student Learning in 11th-Grade United States History

by Adam M. Friedman, Wake Forest University; & Tina L. Heafner, University of North Carolina at Charlotte

Abstract

In a study investigating the effects of student engagement in inquiry learning through the development of Web sites, nearly every student reported having enjoyed the project, and the majority scored an A or B for their project grade. However, neither enjoyment nor high achievement on this performance task necessarily translated into high scores on the unit test. Therefore, this paper explores why success in a technology rich inquiry environment did not translate to measurable changes in student learning. Results demonstrated that students were not accustomed to this type of pedagogy and that the assessment did not match the task.

For over a decade, social studies educators and researchers have strongly advocated the use of technology, particularly the Internet, within social studies instruction (Braun & Risinger, 1999; Hicks & Ewing, 2003; National Council for the Social Studies, 1994). Among the benefits of using the Internet often cited are that it offers instantaneous access to sources previously cumbersome or even unattainable (Cohen & Rosenszweig, 2006; VanFossen & Shiveley, 2000) and that, because the Internet has “transcend[ed] geographical distance, political boundaries, and chronological divisions to become genuinely ‘worldwide,’” it has the potential for students to examine differing perspectives, which is an overriding goal of social studies instruction (Hicks & Ewing, 2003, p. 134). These benefits are available on a wide scale, as an Internet connection is available in virtually every school and 93% of instructional rooms in the United States (Parsad & Jones, 2005, p. 4).

Mason et al., (2000) contended that in order for technology to be integrated effectively, it should be used within the context of social studies content and “extend learning beyond what could be done without technology” (p. 107). Additionally, technology use offers the opportunity for curriculum to be taught in a student-centered manner in which students engage in higher order thinking and undertake “real-world” tasks as they contextualize and synthesize information through exploration and discovery in order to develop their own understanding of the content (International Society for Technology in Education, n.d.). Although multiple pedagogical methods enable these outcomes, inquiry is particularly well suited for helping high school social studies classroom students reach their own deduction of an historical event (Booth, 1993). Inquiry refers to asking questions and finding answers, and is defined by Levstik and Barton (2001) as “the process of asking meaningful questions, finding information, drawing conclusions, and reflecting on possible solutions” (p. 13). In so doing, students are actively engaged in the learning process, instead of being merely presented with factual information as in a more didactic approach.

However, this process is not necessarily easy for teachers or students. In their study of technology integration in an undergraduate history course, Milman and Heinecke (2000) described how the two professors in the course subscribed to a philosophy in which students engaged in inquiry learning as they designed Web sites in order to demonstrate their understanding of the American Civil War. The professors asserted that the learning experience was beneficial. Students were able to engage in higher order thinking as they “managed the complexities of finding primary sources, analyzing historical data, and presenting them through the WWW” (p. 555), The process was “very difficult” for students to undertake, however, as students had to learn both history content and the technical components of designing a Web site (p. 555).

It may be presumed that a task considered “very difficult” to undertake in an upper level undergraduate history course would be even harder in a high school social studies classroom, particularly in light of recent research demonstrating that teachers do not necessarily have access to the requisite equipment for effective technology integration (Friedman, 2006; McGlinn, 2007). Potential barriers notwithstanding, teaching social studies using the Internet to foster the pedagogical approach of inquiry is by no means impossible. Milson (2002) found that his sixth-grade social studies students were able to engage in inquiry tasks; however, students approached this task differently depending on their academic abilities.

The Internet can make available a plethora of evidence and perspectives in an easily attainable format, yet the mere provision of materials does not ensure that students will be able to make sense of these sources. Rather, recent research has called for a “pedagogical interface” on Web sites used in K-12 social studies classrooms as a means of both facilitating the search for relevant material and helping to make the material more understandable (Lee & Clarke, 2003, p. 9). Further, Saye and Brush (1999, 2006) asserted that student learning experiences must be scaffolded in order for students to engage effectively in inquiry learning experiences.

Student Technology Use

Generally speaking, students possess the technical ability to engage in tasks in which they use the Internet and Internet-based resources, as studies have consistently demonstrated that school children desire to use technology, particularly the Internet, and do so frequently (Lenhart & Madden, 2007; Lenhart, Madden, & Hitlin, 2005; Levin & Arafeh, 2002). While Lenhart and Madden’s (2007) piece describes how adolescents utilize the Internet to communicate socially, evidence indicates that students also make use of it educationally. However, this educational use does not necessarily transpire during school hours. Stemming from their study of teenagers’ online behaviors, Levin and Arafeh (2002) asserted that secondary students use the Internet and view it as an integral part of their educational experience, but the majority of “students’ educational use of the Internet occurs outside of the school day, outside of the school building, outside the direction of their teachers” (p. iii).

More recent studies of Internet use among teenagers demonstrate that the vast majority (87%) of adolescents use the Internet and over half (51%) use it on a daily basis (Lenhart et al., 2005). However, rather than simply retrieving information and material from the Internet, many are contributors to the Internet, as well. Lenhart and Madden (2005) reported that the majority of teenagers (57%) provide content to the Internet through the design and development of Web sites, blogs, and digital images. Whether or not it is apparent to students as they create and modify content for the Internet, they engage in inquiry; not only does the development of Internet-based content require synthesis of thoughts and ideas, but it is an active process in which the results are immediately available for the world to view.

Finding the Internet used to foster this type of pedagogy in secondary social studies classrooms is rare. VanFossen (1999-2000), as well as Whitworth and Berson (2003), described Internet use in secondary social studies to consist of students engaging in low level tasks as they access and retrieve factual information. Consequently, given secondary students’ familiarity with the Internet and the Internet’s successful implementation within a college class, it is important to test whether these outcomes could also be achieved in a high school class.

It is also necessary to test the effect of technology use on student achievement, as despite Martorella’s (1997) labeling of technology as social studies’ “sleeping giant” (p. 511) and a wealth of literature documenting technology’s potential as a learning tool, little empirical research exist to validate its effectiveness in K-12 social studies (Friedman & Hicks, 2006). However, Lee and Hicks (2006) noted that researchers must “begin to examine clearly and to detail how technology influences student learning in both K-12 and teacher education settings” (p. 414).

In order to address the impact of technology on student achievement, we undertook a study in which we utilized quasi-experimental design, whereby the same teacher (Ms. Treece, a pseudonym) taught two sections of the same eleventh grade United States history class at Riverfront High School, also a pseudonym (Friedman & Heafner, 2006; Heafner & Friedman, 2007a; 2007b). During the World War II unit, her third block section was the control group while her first block section was the test group. In the control group, Ms. Treece taught the class using the same pedagogical methods as she normally would; in the test group however, students spent the entire unit in their school’s computer lab, engaging in inquiry learning as they answered open-ended, guided questions in order to develop Web sites in which they described, explained, and interpreted the events of World War II by using primary and secondary source documents. At the culmination of the unit, both groups were given the same test in order to compare the impact and effect of different types of instruction on student achievement.

The results of this study showed differences in student achievement between groups, as measured by the multiple-choice, fact-recall unit test. On average, the control group scored 5 points higher than the test group, and there was greater variablity among students within the test class. Comparisons in student performance on the summative test for this unit of study show greater differences in test scores than previous units of study. Additionally, students in the test group scored on average 12 points higher on their Web site project than their unit test (M = 92.19, SD = 9.26, compared to M = 80.8, SD = 12.5), and only two students received a worse score on the Web sites than they did on the test. In terms of traditional measures of student achievement, the use of the Internet to engage in inquiry learning did not significantly and, quantitative data would suggest, did not positively impact student learning. Yet, learning is a much more complicated process than can be deciphered through student grades.

To unravel the intricacies of student learning, a deeper and richer understanding was necessary to evaluate technology’s impact on student attitudes and ability. Therefore, to further explore and understand these facets of student learning, a second set of research questions were posed and are explored in this paper:

  1. What is motivating and enjoyable from a student perspective about a technology rich inquiry environment?
  2. Why was success in this environment not necessarily translated to success on a unit test?

Method

In order to answer questions pertaining to student attitudes and perspectives, on the culminating day of the World War II unit students in the test class were asked to complete a six-item questionnaire, which can be found in Appendix A. The questionnaire contained both Likert-scale and open-ended items. Fifteen of the 16 students in the class participated (one student was absent), and of the respondents six were male and nine were female. The questions pertained to what students liked (and did not like) about the project, in general, what they learned, and whether they would like to undertake a project of this type again. In order to analyze these responses, the researchers used descriptive statistics for the Likert-scale items and grounded theory, as described by Strauss and Corbin (1998), for the qualitative responses. In so doing, the researchers “allow[ed] the theory to emerge” from the student responses, in order to “offer insight, enhance understanding, and provide a meaningful guide to action” (p. 12).

In order to further discriminate between differences in students and the potential effect of Web site creation on student achievement, for the purpose of data analysis students were divided into two groups based on how they rated their enjoyment on this project. Enjoyment was determined by the first question of the questionnaire, which asked students the extent to which they liked the project on a scale of 1 (Hated it!) to 5 (Loved it!). Five students rated this question a 5, an additional five students rated it a 3, four students rated it a 4, and one student rated it a 1, for an average score was 3.8 (SD = 1.15). Qualitative responses offer deeper insight as to the reasons students liked (or disliked) it. Of the 15 surveys, nine (60%) answered this question with a 4 or 5; these students composed one group, and the remaining six students were considered part of the other.

To cross-validate quantitative data, observational field notes, teacher and student interviews, and a summative student questionnaire were collected to determine the impact that technology integration had on student achievement. Data provided evidence to evaluate student like and interest in social studies in addition to student motivations for learning social studies. The researchers (both licensed social studies teachers) were participant observers, as they helped teach the test class the technical components of Web design and created a Web-based resource that contained pertinent primary and secondary sources. In so doing, the researchers collected field notes, as described by Marshall and Rossman (1999). Data were also gathered from the classroom teacher through informal interviews both during and at the conclusion of each of the eight class periods of this project and through a formal interview 4 weeks after the project was completed.

In order to establish themes from the qualitative data to determine what students enjoyed (or did not enjoy) about the project and how it influenced their learning, the researchers individually coded this data with specific attention given to patterns that provided information to help understand the impact of technology on student learning. In order to establish interrater reliability, subsequent to the individual analysis the researchers met to exchange, read, and sort through the initial analyses to identify possible themes collectively, and agreed with the other’s assessment of student responses with 100% unanimity. After themes were identified, data were sorted into domains (as in LeCompte & Schensul, 1999). Specific examples from qualitative data sources were identified and cited to support each of the emergent themes.

Finally, in order to measure the effect of this Web site development on student achievement, it was necessary to know how each had performed antecedent to this project. To this end, we obtained the full record of grades for each student from throughout the marking period. These data were used to determine whether this project had an effect on students who had previously experienced differing achievement levels in social studies.

Results

Contextualizing the Learning Environment

Ms. Treece was in her fourth year teaching, although this was her first at Riverfront High School, and her teaching style was apparent the moment after the bell rang to commence class. Because students lacked prerequisite knowledge of states and capitals, she began each day with a blank map of the United States, pointed to the state, and asked the class “What state is this?” Students were to say the state’s name out loud in unison. This question was typically followed up with, “What’s the capital?” Again, the class as a whole was expected to answer. This pattern was repeated for about four other states (usually in the same region of the country), and if the students had difficulty identifying one of the states, it was then reviewed again. Clearly, she taught her class in a fact-driven, teacher-centered format. She stated that she did so in order to ensure that her students would not only pass, but do well on the end-of-course test.

Riverfront High School prides itself on the end-of-course test scores of its students, which have traditionally been the best of the county’s six high schools. Ms. Treece (as well as her department chairperson) credited this success to common planning, a uniform pacing guide that the entire social studies department uses, and the benchmark mid- and end-of-quarter tests based on the end-of-course test. The pacing guide, a portion of which can be found in Appendix B, details the specific standards to be covered for each instructional day, as well as the facts (such as people, dates, and terms) students are responsible for knowing at the conclusion of each day’s instruction.

Student Attitudes and Interest

The nature of the task, as well as the student and teacher role, was distinctly different from other units of study in this U.S. history course and, for some, their experiences in 11 years of school. Although the students were accustomed to Ms. Treece lecturing fact-driven content, in this unit they had to work through and analyze primary and secondary sources independently in order to develop a Web site. For the students who rated the project a 4 or 5, this difference in instruction was a primary reason behind their high rating, as their reasons revolved around two main themes: that the project was both different and fun. For example, three students (all of whom rated this project a 5) expressed that they “loved it because it was fun,” and another (who rated it a 4) commented that he had “never made a website before so that was cool.” The notion of this project being a break from the ordinary was reflected by a student (who rated it a 4), who wrote that he “liked it because you were able to go at your own pace and it was not a complete bore.” Another student who rated it a 4 commented that she “really enjoyed it better then [sic] sitting in class being lectured.”

The last query on the questionnaire, whether students would like to do this type of project again, was answered similarly. Twelve out of the 15 students stated that they would like to undertake a similar project for a future unit of study, two would not, and one was undecided. The reasons they gave for wanting to replicate this project were similar to the first question responses. Of the 12 students who answered in the affirmative, 10 used the words “enjoyable,” “fun,” or “different.” One student (who rated the project a 3), wrote, “It was fun [and] it was different and better than just sitting around and taking notes.” Another student (who rated the project a 5) wrote that she would “love to do it again because it was [a] fun and hands-on project.” The difference in class structure was also noted, as two students who rated the project a 3 described. This project was “a lot better than lectures,” and “I like getting out of the classroom and I kind of like getting involved.”

The reasons why some students thought of this as a positive experience, however, is reflected in why others found it to be a negative one. Of the five students rating it a 3 and the one rating it a 1, the most common drawback was that it required a greater amount of work than was normally assigned; therefore, they tended to concentrate on completing the specific tasks for the assignment in order to finish and achieve a good grade on the project. One student (who rated it a 3) indicated that she “learned stuff but I concentrated more on just getting the work and criteria in,” which was reflected by another student who expressed that the project “was alot [sic] of stuff to learn in a little time.” Finally, the student who rated this project a 1 stated that “finding images was very time consuming,” and that “the directions were not as direct as I would have liked.”

Time Consuming

Despite the availability of primary and secondary sources for students on a Web site developed by the researchers, many students spent a significant amount of time searching for images using search engines and electronic encyclopedias, particularly Google images (http://www.images.google.com) and Wikipedia (http://www.wikipedia.com). These sites were often the first place students sought information about and images of World War II. Researchers as well as the teacher had to remind students that there had been a Web site designed to provide them with resources to complete their Web site development class.

To understand student reluctance to use the provided Internet resources, the researchers asked why students were seeking other sources of information than the class Web site. Students responded: “I want to find my own pictures,” “I like looking for pictures. It’s fun,” and “I always use this [images.google.com] to find pictures when I do projects for school.” These explanations were reinforced by teacher feedback. For example, one student who had independently located all of his images was praised by the teacher who in previewing his Web site stated, “You deserve the award for the best images.” Student comments reflected a desire for autonomy over project images as well as a dependency upon approaching tasks using the same strategies to which they had become accustomed.

It should be noted, however, that the students who utilized the class Web site for images and information —approximately half of the class—progressed more quickly through the project and were able to spend more time interpreting images and understanding what happened in World War II than did their peers who had spent too much time searching for resources. The student who was praised for his images became so obsessed with finding just the right pictures for each page that he did not complete the project. He complained in the follow-up interview that “it was difficult to find good pictures” and that “searching for pictures took a lot of time.”

Along these same lines, students were asked what they liked the most and the least about this project. Based on students’ overall rating of the project, it might be presumed that there would have been a larger degree of positive comments from the nine students who rated the project a 4 or 5, and contrarily, the six students who rated it a 3 or less might have had more negative comments. However, comments from both groups of students reflected that a break with the teacher’s traditional pedagogical approaches was well received by both sets of students. Specifically, four students noted that they enjoyed the opportunity to work with digital images. One student who rated this project a 4, wrote that “some of the pictures were awesome.” A student who rated it a 3 welcomed “using photos to explain our pages,” and the student who rated the project a 1 noted that the best part was “finding cool propaganda posters.”

Similarly, students in both groups expressed satisfaction with the project in terms of giving them, in the words of a student who rated the project a 3, “a chance to be creative.” Five students agreed. One student who rated the project a 4 liked “how much freedom we had,” and another student who rated it a 4 expressed satisfaction that he “was able to go at my own pace so I did not get bored or fall asleep.”

In terms of the worst part of the project, themes carried across both groups as well. For example, four students (two in each group) commented on technical issues regarding Web site development, with an additional five remarking that they disliked having to explain why they chose certain images. Further, this inquiry learning environment was not without frustration and resistance, as some students complained that it “required me to think” and students were accustomed to a pedogocial approach described by Ms. Treece as, “You think for me so I don’t have to.” This was reinforced by Kevin (a pseudonym) who expressed that he “like[s] to have exact directions…because that’s the way it’s been for eleven years.”

Comparisons Among Student Achievement and Enjoyment

In order to fully understand the ratings and comments of students, it is necessary to contextualize the survey data in terms of their previous achievement level. The grades for these 15 students prior to the World War II unit are listed in Table 1.

Table 1
Student Achievement Comparisons with Student Enjoyment Ratings

Student Achievement

Students who Rated Project 4 or 5
(n = 9)
Students who Rated Project 3 or Less
(n = 6)
Overall Average 72.44 (SD = 20.72) 75.50 (SD = 22.88)
Test Average 72.72 (SD = 15.81) 82.58 (SD = 6.11)
Reading Quiz Average 56.85 (SD = 24.52) 56.23 (SD = 44.34)

These data demonstrate that both groups of students had a nearly identical reading quiz average, and that their overall average was within 3 points. However, the test average of the students who rated this project a 4 or 5 was nearly 10 points lower than the other group. It should be noted once again, however, that all tests in Ms. Treece’s class were given in a multiple-choice, fact-recall format.

In order to discover other differences between the groups, it is helpful to discern data on student performance on this particular unit. As Table 2 demonstrates, students who rated this project a 4 or 5 achieved higher scores on the Web site than the students rating it lower, but worse grades on the World War II test. These data show a clear disparity between achievement on the Web site and on the World War II test. This inconsistency may be further examined by analyzing student perceptions of whether (and how) this project helped them to learn about World War II. All 15 students were asked this question; each answered in the affirmative. However, the subsequent question inquired as to how they learned, and it was in this question that differences could be found in the two groups.

Five of the nine students in the group rating the project a 4 or 5 described this learning as being reflective of an inquiry-oriented pedagogy, while five out of the six students rating the project 3 or less described their learning as being more rote in nature. For example, one student in the group rating the project a 4 or 5 stated, “I had to know what I was typing [and] it wasn’t just reading something,” while another wrote, “We got to see other views of World War II rather than just the book and [the teacher].” One student who rated the project 3 or less expressed that the project “helped me learn not understand. Learning and understanding are 2 completely different things.” Another articulated that “it covered all the events in the war.” Also, the test scores improved by nearly 4 points in the group that rated the project a 4 or 5; however, there was a slight decrease in test scores (less than a point) for those that rated the project 3 or less.

Table 2
Student Achievement on World War II Unit Comparisons With Student Enjoyment Ratings

 

Student Achievement Students that Rated Project 4 or 5
(n = 9)
Students that Rated Project 3 or less
(n = 6)
Website Scores 92.78 (SD = 6.11) 91.83 (SD = 11.71)
World War II Test Scores 76.11 (SD = 15.54) 82.50 (SD = 6.58)
Previous Test Average 72.72 (SD = 15.81) 82.58 (SD = 6.11)

Despite these benefits, students who were engaged in inquiry learning scored lower on the standards-driven unit test than their counterparts who received traditional instruction. Although the inquiry-oriented environment improved access to curriculum materials, access did not equate to improved student achievement and understanding of the content for all students. Many of these students were enthralled with pictures they found, but could not make sense of these other than that the images were intriguing. As a result, some were not able to make connections to the content they were studying and the primary source materials they encountered without pedagogical intervention. When students were able to converse with the teacher about primary source images they were able to have a better understanding of the impact of World War II. However, this understanding did not occur independently, as most students lacked the cognitive skills and background information to make sense of primary source materials. This limitation may have attributed to the lower achievement of students in the test group.

Nearly every student reported having enjoyed the Web page development, and the majority scored an A or B for their project grade. However, neither enjoyment nor high achievement on this performance task necessarily translated into high scores on the unit test for the test class. Disconnect between the project and summative assessment performance may be attributed to the pedagogical differences that students encountered in the test group. For example, on the day of the unit test a student asked Ms. Treece, “If we didn’t do anything beyond that project, are we going to do well on the test?” She responded, “I have many students who do all the readings and attend class, but still make 60s on the test.” Ms. Treece continued, “Test:  This is goal 10.  I know that we have had an unconventional last few weeks, but remember the rules about tests…. No down time when you are finished [with the test]. You have to go back to the old style of doing notes. You’ll need to write notes on your own. I have activities planned for tomorrow and I don’t want to have to give you lecture notes…”

The Teacher’s Perspective

Ms. Treece’s hesitations about the nature of the project were emphasized both during the project and in her follow-up interview. Although the design and development of Web sites was taught using content-related materials, much less content was covered on the first day of the project than Ms. Treece had used in her traditional pedagogical methods, as the thrust of that day’s lesson was on technical components rather than on history content. After the second day of the project, she very strongly considered abandoning it, as she did not feel her students were learning the content that needed to be covered according to the pacing guide, she reconsidered after we modified the assignment by including more fact-based content.

Ms. Treece, in a reflective evaluation of the project’s success during the follow-up interview, commented that she would definitely restructure this project if she were to use it again. She said there needed to be much more structure for students to understand what “they need to know for the test.” In discussing student performance on the unit test, Ms. Treece indicated that she was not surprised by the lower grades of the test class and said “It’s hard when they are not getting lecture.”

She insisted that students could not learn without her help. As an example, she described how Danny (a pseudonym) was adversely affected by the project. Danny’s unit test score (71) was significantly lower than his test average (M = 90).

Danny also was the only student who strongly opposed doing the project and noted much dislike for the task. Ms. Treece continued, “Danny does only the bare minimum.  He is a minimalist.  He is capable of doing, but is dependent upon me for content. He has this mentality of “you think for me so I don’t have to.” Danny just sits back in class and enjoys the show. When I call on him, he knows the answers. He is very bright and scores well on all tests, but won’t learn without me.

Ms. Treece’s follow-up interview suggested that technology requires a different way of thinking and learning. Her initial perception that students were not learning as many facts as they normally would may have been correct. She noted that students in the class with technology were “able to learn about WWII in more detail, study stuff they wanted to learn more about such as rationing, the Holocaust, ‘Wreathes’, and effects on the Homefront…and had more ‘aha moments.’”

The control class received more prescriptive content instruction in a more teacher directed approach and were, accoding to Ms. Treece, better preparted for the summative test. However, in addition to the lack of factual comprehension among students, a major drawback of this inquiry pedagogy was that it was very time consuming, as she felt as if her students would be rushed to finish a future project of this type in the few days that her pacing guide allows for each unit.

In this study, inquiry pedagogy impacted student achievement, but it was not as visible as a significant jump in test scores. Despite these drawbacks however, particularly her skepticism about students’ ability to learn without her intervention, Ms. Treece said that she would definitely do the project again because, “students really enjoyed the project and they were able to creatively work with content.”

Implications and Recommendations

Although the quantitative results did not indicate significant improvement in student grades, qualitative results showed positive gains in student learning. The overwhelming majority of students (14 out of 15, or 93.3%) indicated that they at least somewhat enjoyed the project. However, skeptics of technology use will invariably say “So what? Students had fun. But did they learn?” It is important not to ignore the motivational benefits of having students engaged with the task as well as content, as the latter is foundational to improving student historical understanding. Pedagogical methods that can help students interpret content while improving self-efficacy are essential to impacting student learning. However, this is a skill that needs to be taught and developed over time and not necessarily a task that can be accomplished during one singular unit of study. Students have to be trained to think independently before the benefits of inquiry learning can be maximized. Even though this approach can offer instruction that is more visually appealing, interactive, and engaging, it cannot take students’ learning to a higher cognitive level without teacher scaffolding, which is similar to the findings of Saye and Brush (1999, 2006). The results also reflect Milson’s (2002) study, which found that students of dissimilar academic abilities may undertake inquiry activities differently.

Comparisons between student achievement and enjoyment suggest that enjoyment did not translate into higher academic achievement. Motivation for engaging with a task should positively affect student learning. Contradictions in these data call into question the nature of the assessment. The assessment used for this unit followed the same format as all other assessments for the entire course, as all unit tests are departmental tests and always contain multiple-choice questions derived from a departmental testbank. Although the pedagogical format for the task for World War II changed, the assessment did not.

Given that the students identified pedagogical differences in the World War II project, one conclusion that can be drawn is that the assessment did not align with the nature of the task. Each student learned, but a reason success was not “translated” was that the test required a different way of thinking than the type of thinking required by the technology-based project. From an instructional design perspective, this is very important, as the evaluation measure did not reflect the teaching methodology and unravels a critical component of technology integration: Although technology may help to bring about inquiry-based teaching and learning, assessments must reflect this pedagogical divergence as well.

Thus, lower student achievement can be attributed to shifts in pedagogy envoked by technology. These limitations are further explained by qualitative data indicating student frustration and often resistence to inquiry-based learning, because it “required me to think,” while students were accustomed to a “you think for me so I don’t have to” teacher-oriented pedagogical approach.

This study also suggests that technology has limited benefits and possibly a negative impact on student achievement when it is used for a single unit of study and is not integrated as a common and familiar pedagogical tool. A different type of instruction and learning took place, and there can be little argument that students learned. However, what students learned could not be found on the test, as they learned such tasks as asking questions to themselves as well as the teacher while analyzing and evaluating primary and secondary sources in order to develop a Web site. Clearly, engagement in this type of inquiry learning was a foreign approach for many students. Thus, lower student achievement can be attributed to a shift in pedagogy that redefined the learning environment.

These data reveal the complexity of student learning. Student learning is not just achievement but is an interaction among many variables. We depict student learning as a circular-flow type of relationship among internal and external variables to impact overall learning outcomes, where equitable interaction between all facets are necessary to ensure student learning (see Figure 1). The inner triangle represents the internal facets of student learning, which are a composite of student ability, attitudes, and achievement. The deductive orientation of the triangle explains student achievement as an outcome of the relationship between student ability and student attitudes, which are positively impacted through increases in student skills while impacting student self-efficacy as byproducts of improvements in academic achievement. For example, if a student enjoys a task and possesses familiarity with the skills needed to accomplish the task, then there is a greater likelihood of the student being successful on the evaluation of the task. Positive achievement then improves student self-confidence and skills. The outer elements are external facets of student learning and include the teacher, task-orientation, and the learning environment.  The teacher is at the top, as the teacher is the greatest determinate of student success. The teacher creates the task and builds the learning environment through pedagogical decision-making and, as described by Thornton (1991), is the “gatekeeper” in terms of what is allowed in, or taught to students (p. 237). A reciprocal relationship exists between the nature of the task and the learning environment, which are important determinates of student learning.

Figure 1. Diagram of relationship among facets of student learning.

Breaks in the interactions among these variables create gaps in learning outcomes. As evidenced in this study, a technology-rich inquiry-based learning environment increases student motivation for learning content and engagement with content. Students in this study were motivated to learn and possessed the technical skills to accomplish the task; yet, this environmental change did not transfer to achievement outcomes. Changes in the learning environment or nature of the task cannot significantly impact student learning when the teacher’s pedagogical approach and assessment strategies do not train students for the skills needed for success in an inquiry-based learning environment. The conditioning of students to a “you think for me so I don’t have to” mode of learning, reinforced by evaluation measures, creates a pedagogical paradox engendering gaps in student learning. To repair these gaps, a pedagogical interface that supports and contextualizes content understanding is necessary.

Although students in the test group seemed to enjoy the task, we wonder whether they would enjoy it as much if it was not such a break from the ordinary. In other words, if this type of instruction was provided over a few units, would it be as much fun? Also, the fact that there were three licensed social studies teachers in the room should not be overlooked. Because nearly every student had individual questions, with the researchers being participant-observers, not only were questions answered more rapidly than if Ms. Treece was on her own, but if students were “stuck,” there was a much greater likelihood that they would not go off task.

In order to address these issues, we are in the process of developing a Digital Literacy Tool (DLT). This is an Internet-based catalogue of primary sources, thematically organized and searchable, accompanied by specific directions of how to break down sources and make meaning. Each source is supported by scaffolding questions that serve as a pedagogical interface (Lee & Clarke, 2003) to guide student interpretation and highlight contextual information, such as historical facts about the time period, geography, people, and cultures. We hope that this resource will address the issues of time and standardized tests. Because the DLT will contain guided questions for each source, it will be a more efficient use of time, as students will be guided as they analyze primary sources. We also hope that it will discourage copying and pasting of text, as students will answer questions in order to demonstrate actual understanding. Perhaps most importantly, by contextualizing content students may be better able to excel on fact-based standardized tests. Primary sources will no longer be analyzed in isolation, but instead among other pertinent facts, and as a result a coalescence will begin to form between technology-rich, inquiry-based instruction and a fact-based high stakes testing environment.

References

Booth, M. (1993). Students’ historical thinking and the national history curriculum in England. Theory and Research in Social Education, 21(2), 105-127.

Braun, J., & Risinger, F. (1999). Surfing social studies. Washington, DC: National Council for the Social Studies.

Cohen, D. J., & Rosenzweig, R. (2006). Digital history: A guide to gathering, preserving, and presenting the past on the Web. Philadelphia: University of Pennsylvania Press.

Friedman, A. M. (2006). World history teachers’ use of digital primary sources: The effect of training. Theory and Research in Social Education, 34(1), 124-141.

Friedman, A. M., & Heafner, T. (2006, November). Website construction in ninth grade social studies. In K. Swan (Chair), Technology Research in the K-12 History Classroom. Symposium conducted at the annual meeting of the College and University Faculty Assembly, Washington, DC.

Friedman, A. M., & Hicks, D. (2006). The state of the field: Technology, social studies, and teacher education. Contemporary Issues in Technology and Teacher Education [Online serial], 6(2). Retrieved July 2, 2007, from http://www.citejournal.org/vol6/iss2/socialstudies/article1.cfm

Heafner, T. L., & Friedman, A. M. (2007, March). The effect of website development on student attitudes and interest in 11th grade United States history. Paper presented at the annual meeting of the Society for Information Technology and Teacher Education, San Antonio, TX.

Heafner, T. L., & Friedman, A. M. (2007b, April). “…Because that’s the way it’s been for 11 years.” The effect of student website development on student achievement. Paper presented at the annual meeting of the American Educational Research Association, Chicago, IL.

Hicks, D., & Ewing, E. T. (2003). Bringing the world into the classroom with online global newspapers. Social Education, 67(3), 134-139.

International Society for Technology in Education. (n.d.). All children must be ready for a different world. Retrieved July 27, 2007, from http://cnets.iste.org/intro2.html

LeCompte, M., & Schensul, J. (Eds). (1999). The ethnographers’ toolkit. Walnut Creek, CA: AltaMira Press.

Lee, J. K., & Clarke, W. G. (2003). High school social studies students’ uses of online historical documents related to the Cuban Missile Crisis. The Journal of Interactive Online Learning, 2(1), 1-15.

Lee, J. K., & Hicks, D. (2006). Editorial: Discourse on technology in social education. Contemporary Issues in Technology and Teacher Education [Online serial], 6(4). Retrieved July 2, 2007, from http://www.citejournal.org/vol6/iss4/socialstudies/article1.cfm

Lenhart, A., & Madden, M. (2007). Social networking sites and teens: An overview. Washington, DC: Pew Internet and American Life Project. Retrieved February 9, 2007, from http://www.pewinternet.org/pdfs/PIP_SNS_Data_Memo_Jan_2007.pdf

Lenhart, A., Madden, M., & Hitlin, P. (2005). Teens and technology: Youth are leading the transition to a fully wired and mobile nation. Washington, DC: Pew Internet and American Life Project. Retrieved February 9, 2007, from http://www.pewinternet.org/pdfs/PIP_Teens_Tech_July2005web.pdf

Levin, D., & Arafeh, S. (2002). The digital disconnect: The widening gap between Internet-savvy students and their schools. Washington, DC: Pew Internet & American Life Project. Retrieved March 14, 2007, from http://www.pewinternet.org/pdfs/PIP_Schools_Internet_Report.pdf

Levstik, L. S., & Barton, K. C. (2001). Doing history: Investigating with children in elementary and middle schools. Mahwah, NJ: Lawrence Erlbaum Associates.

Marshall, C. & Rossman, G. B. (1999). Designing qualitative research (3rd ed.). Thousand Oaks, CA: SAGE Publications, Inc.

Martorella, P. H. (1997). Technology and the social studies – or: Which way to the sleeping giant. Theory and Research in Social Education, 25(4), 511-514.

Mason, C., Berson, M., Diem, R., Hicks, D., Lee, J., & Dralle, T.(2000). Guidelines for using technology to prepare social studies teachers. Contemporary Issues in Technology and Teacher Education [Online serial], 1 (1). Retrieved July 2, 2007, from http://www.citejournal.org/vol1/iss1/currentissues/socialstudies/article1.htm

McGlinn, M. (2007). Using the “Documenting the American South” Digital Library in the social studies: A case study of the experiences of teachers in the field. Contemporary Issues in Technology and Teacher Education [Online serial], 7(1). Retrieved July 2, 2007, from http://www.citejournal.org/vol7/iss1/socialstudies/article1.cfm.

Milman, N. B., & Heinecke, W. F. (2000). Innovative integration of technology in an undergraduate history course. Theory and Research in Social Education, 28(4), 546-565.

Milson, A. J. (2002). The Internet and inquiry learning: Integrating medium and method in a sixth grade social studies classroom. Theory and Research in Social Education, 30(3), 330-353.

National Council for the Social Studies. (1994). Expectations for excellence: Curriculum standards for social studies. Washington, DC: National Council for the Social Studies.

Parsad, B., & Jones, J. (2005). Internet access in U.S. public schools and classrooms: 1994-2003. (NCES 2005-015). U.S. Department of Education. Washington, DC: National Center for Education Statistics.

Saye, J. W., & Brush, T. (1999). Student engagement with social issues in a multimedia supported learning environment. Theory and Research in Social Education, 27(4), 472-504.

Saye, J. W., & Brush, T. (2006). Comparing teachers’ strategies for supporting student inquiry in a problem-based multimedia-enhanced history unit. Theory and Research in Social Education, 34(2), 183-212.

Strauss, A., & Corbin, J. (1998). Basics of qualitative research (2nd ed.). Thousand Oaks, CA: Sage Publications.

Thornton, S. J. (1991). Teacher as curricular-instructional gatekeeper in social studies. In J. P. Shaver (Ed.), Handbook of research on social studies teaching and learning (pp. 237-248). New York: Maxwell Macmillan International.

VanFossen, P. (1999-2000). An analysis of the use of the Internet and World Wide Web by secondary social studies teachers in Indiana. The International Journal of Social Education, 14(2), 87-109.

VanFossen P. J., & Shiveley, J. M. (2000). Using the Internet to create primary source teaching packets. The Social Studies, 91(6), 244-252.

Whitworth, S. A., & Berson, M. J. (2003). Computer technology in the social studies: An examination of the effectiveness literature (1996-2001). Contemporary Issues in Technology and Teacher Education [Online serial], 2(4). Retrieved July 2, 2007, from http://www.citejournal.org/vol2/iss4/socialstudies/article1.cfm

 

Author Note:

This paper is based on a presentation at the 2007 annual conference of the Society for Information Technology and Teacher Education.

Adam M. Friedman
Wake Forest University
email: friedmam@wfu.edu

Tina L. Heafner
University of North Carolina at Charlotte
email: theafner@uncc.edu

 

 

Appendix A

Student Questionnaire

WWII Webpage Scrapbook Project Evaluation

  1. Did you like the project? (Circle the number that best represents your feelings about this project.)
1 2 3 4 5
Hated it! A Little Somewhat A lot Loved it!

Why did you select this rating?  Please provide specific examples.

  1. Did you like learning about WWII? (Circle the number that best represents your interest in WWII.)
1 2 3 4 5
Hated it! A Little Somewhat A lot Loved it!

Why did you select this rating?

  1. Do you think the webpage scrapbook project helped you learn about WWII?   Yes  or  NoIf you answered yes, how did the assignment help you understand WWII?
  2. If you answered no, please explain why you think the project was not helpful.
  3. What was the best thing about this project?  Explain your answer.
  1. What was the worst thing about this project?  Explain your answer.
  1. Would you like to do this kind of project again?   Yes   or   No     Please provide reasons for your decision.

Appendix B

United States History Pacing Guide – Unit 10 Syllabus
American Vision – Chapters 24-27

Goal: World War II and the beginning of the Cold War (1930s-1963) – The learner will analyze the war’s influence on international affairs in following decades.

EOC Objectives:

10.01 – Elaborate on the causes of World War II and reasons for United States entry into the war.

10.02 – Identify military, political, and diplomatic turning points of the war and determine their significance to the outcome and aftermath of the conflict.

10.03 – Describe and analyze the effects of the war on American economic, social, political, and cultural life.

10.04 – Elaborate on the changes in the direction of foreign policy related to the beginning of the Cold War

10.05 – Assess the role of organizations established to maintain peace and examine their continuing effectiveness.  

Date Obj. Notebook Topic Reading
4/25 (T) 4 1/2 Week Test 708-712
4/26 (W) 10.01 54 Causes of WWII 712-718
4/27 (Th) 10.02 56 U.S. Entry into World War II 725-730
4/28 (F) 10.03 55 Holocaust 719-724
5/1 (M) 10.02 57 War In Europe 742-747
5/2 (T) No School – Election Day
5/3 (W) 10.02 57 War In Europe 755-759
5/4 Th) 10.02 58 War in Pacific 764-772
5/5 (F) 10.02 58 War in Pacific 742-745
5/8 (M) 10.03 56 Home Front 749-754
5/9 (T) 10.04
10.05
59 Origins of the Cold War 778-782
5/10 (W) Unit 10 Test