Go to Introduction Go to Quick Looks Go to Conversations Go to Cases Go to Resources




Table of contents
Go to Joliet Junior College Summary
Blank spacer
Go to Joliet Junior College Introduction
Blank spacer
Go to the Joliet Junior College Setting
Blank spacer
Go to Joliet Junior College Learning Problems and Goals
Blank spacer
Go to Joliet Junior College Creating a Learning Environment
Blank spacer
Go to Joliet Junior College Summative outcomes data
Blank spacer
Go to Joliet Junior College Implementation
Blank spacer
Go to Joliet Junior College Conclusion
Additional materials
Go to Joliet Junior College Reader's Guide
Blank spacer
Go to Joliet Junior College Discussions
Blank spacer
Go to Joliet Junior College Resources
Blank spacer
Go to Joliet Junior College Glossary
Blank spacer
Got to Joliet Junior College References
Blank spacer
Go to Joliet Junior College Endnotes
Blank spacer
Show entire Joliet Junior College case
Blank spacer
Download Joliet Junior College case

Go to previous page Joliet Junior College: Creating a New Physics Education Learning Environment
(entire case study)
Go to next page


Dr. Curt Hieggelke


"We're serving these students by teaching them physics. But more than that, we're teaching them how to think, developing their ability to analyze complex sets of data, and developing the unique skill of separating the irrelevant from the relevant. We're teaching in context--in a context where they try to do physics."


"How do I get my students to learn like that?"

Introduction
    Here we introduce you to Curt Hieggelke, what he's done with technology and why. We describe briefly some of the impacts on student learning, how the students have responded, and why it's not just the technology that's made this a successful program.

The Setting

    In this section, we introduce you to Curt's colleagues at JJC and present the information necessary to understand the context within which they strive to achieve their goals for student learning.

Learning Problems and Goals

    Here we examine, first, the learning problems that Curt and his colleagues faced, problems that ultimately motivated them to change their curriculums; then, we take a look at the goals the JJC faculty have set for student learning.

Creating the Learning Environment

    In this section, we look closely at how the JJC faculty created their new learning environments-the tools they use, the activities they assign-and how they assess their success. This section is deeply informative and includes links to both faculty and student discussions of learning activities, as well as information on specific assessment tools and activities.

Summative Outcomes Data

    How well is it working? Find out in this section, which tracks the achievement of Curt's students.

Implementation

    Wondering about the logistics? The JJC faculty share how they did it: from acquiring the necessary resources (time, space, money, etc.), to networking, to overcoming their own ingrained ideas about teaching and learning.

Conclusion

    You have to be an independent learner...


Introduction

Who is Curt Hieggelke?
Dr. Curt Hieggelke teaches physics at Joliet Junior College in Joliet, Illinois. He is a national leader in the development, use and dissemination of innovative computer-enhanced introductory physics teaching methods. In the last ten years, he has received nine NSF grants to pursue his work in this area. His current projects include "Two-Year College Physics Workshops for the 21st Century" (see
http://tycphysics.org) and "Tools for Learning and Assessment."


What's he done?
Students A "tekkie" from way back, physicist Curt Hieggelke has transformed his introductory physics courses at Joliet Junior College into meaningful and exciting learning experiences for his students--whether they are aspiring engineers, scientists, health professionals, or non-science majors. Key to his success is the use of computer-based labs that actively engage his students through real-time acquisition and analysis of data, connections to real-world events, visualization and simulation.


Why?
For some time, Curt had been aware--and concerned--that despite the care he took to present material to his students, they were just not grasping the concepts and ideas he was trying to teach. First, he tried refining his lectures-to no avail. Gradually he came to realize that "lecture doesn't necessarily transmit any information."

    ...I became convinced that no matter how much I told them the right answer, they still didn't pick it up; that becoming a better lecturer doesn't have a better impact on them.

  1. Predict--Students are given a situation or problem and are asked to predict what will happen when something is done to change that situation.

  2. Observe--Once the change has been made, students carefully observe what happens.

  3. Explain--They compare their predictions with what happened and explain their findings, giving reasons, particularly, for any differences between predictions and results.
What his students needed, Curt decided, was a more active learning environment, one that encouraged--no, demanded--student participation in the learning process. Teaching in a lecture format simply was not accomplishing this. So, what would?

Well, for years Curt had been using computers in the classroom to aid in the analysis of data. In the late 1980s, however, it dawned on him that he might go beyond using computers merely for analysis and instead use them to transform the way his students learn physics. In particular, he was excited about the possibilities of using electronic probes that interface with a computer; such devices would enable his students to actually collect and analyze data themselves, fostering a predict-observe-explain learning process that Curt felt was essential to getting his students to understand-not just memorize and regurgitate-important physics concepts.

So first, Curt set about getting computers for his students (no easy task in itself). Then he searched for--and helped develop--a "second generation" of software tools that would enable the active learning environment that Curt sought for his students.

    The first generation of computer technology was 'do the old lab experiment and hook a computer to it and the computer would do graphing or fitting.' The second generation demands the active engagement of students. It's predict and observe and explain...Students are really engaged with the experiments. After they set them up, they can interact with them and see exactly how things changed.

More specifically, these software tools allow students to

  • visualize patterns of data.
  • use graphical representations in ways that enable them to avoid getting lost in the data setup and collection details that accompany most lab activities.
  • experiment easily with different parameters in the same lab setup.


An example graph of position versus time.
Click here to see a larger version of this graph.


Click here to see a larger version of this graph.

These tools are expressly designed to help students understand relationships between data and concepts and to engage their interest in physics.


But it's not just the technology...
Along with--and equally as important as--his computer-enhanced teaching strategies, Curt has implemented other active-learning techniques such as guided group work and formative assessment activities. These activities are not computer-dependent per se; however, in his teaching, Curt blends computer-dependent and computer-independent activities into a synergistic framework for learning.

    The hope is that [the computer work] will feed nicely into how I am interacting with the students and how the students are interacting with each other, even when we are not in lab...

    Now, I'm not sure if the technology in and of itself is essential to start doing this 'elicit-confront-resolve' approach [a variation of the predict-observe-explain approach], but it might be essential. It's not the only reason [this approach] works, but the technology allows us to do it. And this new way carries over into the rest of our class.

The result is a set of learning activities that reinforce each other, providing students with challenging, engaging and effective science learning experiences.


What happens on a typical day in Curt's classroom?

    What I do in the classroom is quite different because I'm not preparing a lecture. It's very intense, because I have to be listening all the time and also thinking about the next question I want to pose to them that moves them from that point to the next point. That's the challenging thing--trying to think ahead at the same time I'm trying to listen to what they're saying.


Sounds great, but are the students really learning better?
In a word--yes. Posttests show that when tested on conceptual understanding, Curt's students perform significantly better than their counterparts in traditional physics courses, as indicated by the Force Concept Inventory (FCI) results presented in Table 1, below.

The FCI, designed by David Hestenes and colleagues, is widely used in the physics community to assess student understanding of the basic issues and concepts in Newtonian dynamics (Hestenes, Wells & Swackhamer, 1992). Questions are multiple-choice and are written in non-technical language, but included correct answers are attractive distracters that specifically address common-sense misconceptions about physics.

To enable consistent comparison of performance on the FCI of students from diverse institutions (from the most to the least selective), Richard Hake of Indiana University introduced an "average normalized gain" factor (Hake, 1998). Hake developed what has become known in the physics community as the "Hake factor" while researching the difference between traditional physics classes and what he calls "interactive engagement" classes in terms of students' pre-instruction and post-instruction performance on the Force Concept Inventory test. The significance of the Hake factor is that it adjusts for the fact that percentage improvement is normally easier for those who start with lower pretest scores than for those who initially score quite high.

Hake factor (h) = actual gain / maximum possible gain, or
h = (average posttest score - average pretest score) / (100 - average pretest score)

In his study, Hake reported that 14 "traditional" courses that "made little or no use of interactive-engagement (IE) methods" achieved an average gain of 0.23±0.04 (SD), whereas 48 courses that made "substantial use of IE methods" achieved an average gain of 0.48±0.14 (SD). These numbers provide a kind of benchmark for other faculty nationally who use the FCI.


Table 1
Joliet Junior College Physics 201, Fall 1997 - Spring 2000 (N = 68)

Average Adjusted Pre/Post-test Gains on FCI

 
Pre-Test
 
Post-Test

Mean Score 49%   73%
SD 16 pts   15 pts
JJC Hake Gain   .47  
Nat'l Hake Gain-Traditional Course   .23  
Nat'l Hake Gain-Interactive Course   .48  

According to Alan Van Heuvelen, a nationally recognized physics educator at the Ohio State University's Department of Physics, Curt's two-year college physics students are performing as well as Harvard students in similarly taught courses.

    When you plot Hieggelke's students' posttest results on the Force Concept Inventory along with the results of students taught by other faculty who use the interactive engagement approach to physics, his students' outcomes compare favorably with those of students taught by Eric Mazur at Harvard University.


That's impressive. But how do students respond to a new learning environment?
Of course, tests are only one side of the achievement story. Are students willing, for example, to take charge in an interactive environment, to accept that the responsibility to learn is theirs? If Curt's students are any indication--and we think they are-the answer is yes, many will. As a student in Curt's Engineering Physics course put it,

    A teacher may be a spoon feeder--giving you plenty of examples--but that doesn't do it for me. I've got to do it myself. Watching the professor do it is not going to help. I've got to do it on my own.... In this course, we teach ourselves and each other.

In labs, for instance, students get their primary feedback not only from the instructor, but from the hands-on experiments and simulation-based problems that they themselves set-up and control. And they're not only learning physics--they're liking it, too. Students made this clear when describing their labs to us:

    Nick: The computer-based exercises in the class were awesome.

    Paul: There was a video camera part that was excellent-seeing the movement step by step, each frame....

    Andy: Analyzing it, breaking it down by cut. Cropping them, taking them in.

    Nick: We could never do that on our own. We can't visualize it without the computer. We can't possibly test it. But to have that was incredible. That was amazing. I loved that lab!

    Steve: That was the best lab.

    Nick: And that last one we did, we used a spring with a mass on it. Compressing it, and letting it go, and finding out its forward motion, amplitude, and things like that gives you a better understanding, as there is less, probably no, experimental error in that.

    Susan (interviewer): So you are visualizing this? What is happening when you set up the parameters?

    Paul: You are watching the compression and expansion of the spring on the computer screen.

    Nick: That was cool. Yeah, we were talking about the strengths of using simulations. The three of us are working with differential equations now, so we can do them a different way. We can work on them with the simulations. A lot of things popped up in the simulation program that I hadn't ever thought about with differential equations. Just working the problems in the chapter on differential equations [in our textbook] is not enough to pass the test. The book teaches you how to do things, how to work spring problems out. It'll work everything out with the spring problem, but it won't teach you exactly what's going on with the physics. That's not going to be enough to pass his tests. For his tests you have to know the physics and how to work out a problem. That simulation lab taught me the concepts of the physics, so from that alone I got the concept.

Curt's students are also quick to point out the power and meaningfulness of visualizing physics concepts: how the use of technology enables this visualization and how visualization leads to new insight into everyday experiences.

    Alice: [As a result of this course,] I try to visualize things more.

    Maggie: I think of physics more. I'm doing it.

    Alice: Yeah. Driving down the road, I think of physics more. Like when we were doing acceleration, I link it together. I'm going up a hill, so my velocity--my acceleration--is decreasing. You think in terms of math.... Going around the curves--that acceleration thing, that's why I don't fly off the road. {laughter}

In short, the technology in the lab has changed the way these students understand and appreciate physics not only inside the classroom, but outside as well.

Wow!
Now, how can I get my students to learn like that?

Curt's story may sound simple, but it's not. The truth of the matter is, change is hard. And in this case, you can't go about it without a plan. Through the following links, we offer you a more complete and comprehensive story of Curt Hieggelke's--and his colleagues'--efforts to improve the quality of student learning in the hopes that his experience may serve as a guide to others.


The Setting

Note: For useful tips and information on how this case study is organized, please see the Reader's Guide.

This case study features the learning environments (see Resource A) created by Professor Curtis Hieggelke of the Department of Natural Sciences and Physical Education at Joliet Junior College (see Resource B) for his introductory physics students. Central to this narrative are the efforts of three of Curt's colleagues (presented below), all of whom have adapted his methods in various ways to suit the needs of their own students.



Dr. William (Bill) Hogan teaches physics courses for students in technical programs, as well as for students planning to transfer to four-year programs in life sciences and engineering. He has adapted many computer teaching methods for use in all of his courses.





Dr. Marie Wolff teaches general and organic chemistry. She was one of two faculty members chosen for the JJC Outstanding Teaching Award in 1992. She is also a member the Chicagoland Consortium to Improve Chemistry, a group that received an National Science Foundation grant to link nine two-year colleges with the NSF's Chemistry Systematic Reform Initiative.



Dr. Michael Lee is Chairman of the Natural Science/Physical Education Department and President of the JJC Faculty Union. He teaches microbiology, healthy, human anatomy and physiology, and uses technology extensively in all his courses. He has also taught video telecourses and courses using interactive television for JJC's Distance Learning Program.



The learning environments that these faculty bricoleursa create are informed by two key teaching principles: that faculty should

  • shift major responsibility for learning from themselves to the students, and
  • enable learning to occur in diverse ways.

These principles guide the JJC instructors' choices of learning activities, such as the computer-dependent uses of hands-on experimentation, visualization and graphical representation and simulation, and Interactive Lecture Demonstrations as described in the Introduction.

The JJC bricoleurs use these activities in conjunction with learning activities that are computer-independent to address common problems that arise in the classroom (namely, weak student performance and student values that contrast with those of the faculty) and to achieve their goals for student learning (to develop in students a conceptual understanding of basic ideas and a lasting interest in physics). As we have seen, the results are impressive: On nationally recognized physics exams, JJC students perform at levels comparable to those achieved by students at elite four-year institutions.

Curt believes that the successfull transformation of his physics courses at JJC depends, in good part, on computer-based labs.

Curt finds that electronic probes that interface with a computer and allow his students to themselves collect and analyze data are especially useful. He attributes their special value to the predict-observe-explain1 learning process which they are designed to foster. These probe-based labs help students to:

  • visualize patterns of data or information;
  • use graphical representations in ways that enable them to avoid getting lost in the data setup and collection details that accompany most lab activities;
  • experiment easily with different parameters in the same lab setup.

Curt refers to hardware and software that is designed to facilitate a predict-observe-explain learning process as second generation software tools.b These tools are expressly designed to help students understand relationships between data and concepts and to engage their interest in physics.

His enthusiasm for these labs and the animated responses of his students are contagious: his faculty colleagues have adapted his methods and are even participating to some extent in the vigorous national dissemination efforts that occupy most of Curt's time outside of teaching.

Curt combines his computer-enhanced strategies with other active-learning strategies, such as carefully guided group work projects and formative assessment c practices, in order to foster deeper student engagement and learning. As you will find in the other sections of this study, Bill, Marie, and Mike also use these computer-independent activities with much success. All of them are finding that these diverse learning strategies reinforce each other, providing students with challenging, engaging, and effective science learning experiences.

The introductory science courses mentioned in this study include:

  • Basic Physics (Physics 100, 4 credits), survey course for non-science majors. Includes lab.
  • Engineering Physics (Physics 201-202-203, 5-5-3 credits), requires calculus and is for students preparing for engineering and science program. Physics 201-202 are lab courses, while Physics 203 is not.
  • Technical Physics (Physics 103-104, 4-4 credits), for students in technology programs leading directly to employment.
  • College Physics (Physics 101-102, 5-5 credits), requires algebra and trigonometry and is for students preparing for life science programs (e.g., pharmacy, physical therapy). Includes lab.
  • General Chemistry (Chemistry 101-102, 5-5 credits), for students planning science-related careers. Includes lab.
  • Organic Chemistry (Chemistry 209-210, 5-5 credits), lab course for students planning life science and chemistry-based careers.
  • Human Anatomy and Physiology (Biology 250, 4 credits), lab course for students planning careers in the health fields.

Syllabi for some of these courses appear in Resource C.


Learning Problems and Goals

A. Problems Motivating JJC Faculty to Try Computer-Dependent Learning Strategies.

Two key problems motivated the Joliet science faculty members to begin using what Curt calls "the second generation" of computer technology:

  • student learning was low (that is, they were not developing a conceptual understanding of course topics and materials); and
  • student engagement was weak.

Of foremost concern to Curt and his colleagues was the problem that students were not developing a real understanding of the material being taught; in other words, they just weren't "getting it." The JJC bricoleursa suggested different reasons for this.

Curt pointed out, for example, a general dissatisfaction with the lecture method of teaching: "Lecture doesn't necessarily transmit any information. For a long time I've been somewhat aware of students' difficulty in understanding physics, and I became convinced that no matter how much I told them the right answer, they still didn't pick it up--that becoming a better lecturer does not have a better impact on them."

Geoff White, a computer lab technician who works with Curt, observed how students come in with mental habits, perhaps learned in previous courses and other life experiences, that prevent them from understanding what science really is.2 For example, the students often "don't want to predict," Geoff said. "For me, making predictions and coming back to verify them is the crux of science. If they're not catching that, then they're missing a lot of what science is."

Geoff White is the Physical Science Lab Supervisor for the JJC Department of Natural Resources. He is responsible for maintaining the lab equipment for chemistry and physics courses.

(HERE LINK) Marie Wolff, Curt's chemistry colleague, noted that before she implemented such teaching techniques as guided inquiry or group work, students had difficulty comprehending basic reading assignments. "The students didn't read with a purpose," she commented, and consequently "they would feel swamped by this reading and would complain about the book being hard to read and not understandable."

Even the students expressed similar concerns about not "getting it." One explained, "[In typical courses, the lectures] and books tell us how to do physics problems, but they don't tell us what we're doing. We don't have a clue what we're doing."

So what did Curt do about this concern that students were not really understanding physics? First, he looked around, nationally, and found that his students' failure to learn in the way that he and his colleagues--and for that matter, his students themselves--want is far from unique to JJC.d This insight led Curt to get engaged with a growing national network of physics educators who are experimenting--with significant successes--with new ways of achieving their goals for introductory physics students.

The faculty and the students interviewed at JJC also expressed concern about low-level student engagement. Marie articulated the idea that students these days are different--an idea that we've all heard faculty express in conversations recently. 3 She believes that the media really are changing students' attention span and that this affects the way they respond in their academic courses.e

The students we interviewed gave us different reasons why student engagement might be a problem. One of the students in Curt's Engineering Physics course explained, in so many words, that students are very strategic and will do just what they have to, and only at a pace that works for them, in order to get a degree. "A lot of people need Physics 1... to complete a degree," this student noted, "[but] aren't really interested in the class."

The students in the Basic Physics course further explained that students lose their will to get deeply engaged in courses when they experience an intimidation barrier. "The class is two hours long and we do a lot of labs," noted one student, "so people were just intimidated by long sessions that meet only twice a week. People get turned off by that."4

Fortunately, Marie and her JJC colleagues are not folks who merely observe these changes in students' values and behaviors. They thought through their goals and began using active learning strategies--whether enabled by computers or not--to achieve these goals. And like so many other science faculty across the nation who have begun using these methods, they found that these new strategies are energizing not only their students, but themselves as well.


B. Learning Goals the JJC Faculty Seek to Achieve.

The specific learning strategies employed by the JJC bricoleurs were strongly influenced by their goals for student learning. In particular, they wanted students to:

  1. develop real conceptual understanding of the material presented;
  2. develop insight into how scientists "know what they know;"
  3. develop analytical and problem-solving skills;
  4. develop greater awareness of technical terms.

(HERE LINK) Bill Hogan, Curt's physics colleague, stepped back from the particulars and gave us a "big picture" answer to our question about goals for student learning. He wants to develop in students a lasting interest in physics:

    My big goal is to contribute to a person's education in a way that makes a difference. In other words, if my contribution is a significant one, it goes way beyond this semester. It is going to last, it is going to inspire the students, give them a foundation or basis for being interested and for understanding these topics.

Like educators everywhere, the bricoleurs at JJC want to foster deep learning and life-long learning skills in their students.5 They want to challenge students to think about science analytically, to develop thought processes that enable them to connect the classroom world to the real world, and to build a "foundation" that will endure "far beyond one semester."

For an in-depth discussion of teaching goals, see Getting Students to Make the Connection: A Discussion of Curt's Teaching Goals.


Creating the Learning Environment

The JJC bricoleurs are among the growing number of faculty who are designing their courses as learning environmentsf. To meaningfully examine these learning environments, we first consider the relationships between the problems and the goals that motivate the bricoleursa to create alternative learning environments:

The JJC bricoleurs are able to choose from an array of learning activities to achieve these goals. Their specific choices are, in general, guided by two underlying teaching principles:

The JJC faculty give highest priority to the first teaching principle--shift major responsibility for learning from the faculty to the students. This entails actively engaging students in a set of mental processes that allow the students to restructure and add to what they already know. The JJC bricoleurs effect such processes using curricula based on "predict-observe-explain" or "elicit-confront-resolve" (a variation of predict-observe-explain) models.

That the JJC faculty are very committed to the second teaching principle--enable learning to occur in diverse ways--is evident in their decision to provide various ways of learning in each course. This principle is important to them because it helps "level the playing field" for students who may have a high capacity to learn, but who are not inclined to learn by listening to and reading largely abstract material. As Bill Hogan puts it, these are the students who are "learning because of the things we do."

The JJC bricoleurs have not only chosen a set of introductory principles that they believe are most important for their students to understand (as exhibited by their course syllabi). They have also chosen a set of learning activities that "weave together"--that is, that work synergistically--to achieve their goals for student learning (see Learning Goals the JCC Faculty Seek to Achieve). As with all the case studies appearing in the LT2 site, the activities are organized into three categories:

  1. Computer-dependent activities that faculty believe simply would not be possible, or at least not feasible, without computers.
  2. Computer-improved activities that faculty believe work incrementally better with technology but can still be implemented without it. (The JJC faculty did not give us examples of this type of activity.)
  3. Computer-independent activities that can be done without technology.
    The hope is that [the computer work we are doing now] will feed nicely into how I am interacting with the students and how the students are interacting with each other, even when we are not in lab... that these parallel activities will feed into each other.... Now, I'm not sure if the technology, in and of itself, is essential to start doing this "elicit, confront, resolve" approach. But it might be essential. It's not the only reason it works, but the technology allows us to do it, and this new way carries over into the rest of our class.
    --Curt Hieggelke

Below, we provide information on the synergistic set of learning activities that the JJC bricoleurs use to create their effective learning environments.


A. Computer-Dependent Learning Activities
The JJC faculty employ three learning activities in ways that would not be possible without what Curt calls the "new generation of computer technologies that demand active engagement of the students." These activities are:

(See We can do things with a computer that years ago took hours to do: Faculty Discuss Computer-Dependent Learning Activities.)

    I read it, and then I see it, and then I know it.
    --Joan, Basic Physics Student

Students running an experiment and capturing it on video
View images here
For Joan, and for other students, these computer-dependent activities provide clear illustrations of concepts that might remain murky if the students were to rely solely on "reading the book and answering questions." The students we talked with explained how even the most mundane activities they took part in outside of class reminded them of concepts they'd learned in their physics labs. For years, science teachers have been assigning hands-on experiments--with and without the help of computers--in an effort to "convince students that what we talk about in class is true" and to force them to "predict, observe and explain" the data with which they're presented. As science students and faculty from Joliet explain, however, the effectiveness of such experiments has greatly increased since instructors have begun using computers in a "second generation" way.

(See The labs are incredible, absolutely incredible: Students Discuss Computer-Dependent Learning Activities.)


B. Computer-Independent Learning Activities
The JJC bricoleurs do not rely solely on computer-dependent activities, of course. They also incorporate activities that are computer-independent: primarily, formative assessmentc and group work/guided discussion. Throughout, we pay attention to how the faculty synergistically integrate all their learning activities.


1. Formative Assessment
Curt places great importance on the use of formative assessment tools as learning activities. He believes that these activities are critical in directly fostering learning and in providing faculty the information about student learning that instructors need in order to constantly adjust and improve their teaching strategies. The formative assessment activities Curt uses fall into two general groups: pre-/post-tests that have been developed recently by physics faculty around the nation and a set of activities that he calls "Tasks Inspired by Physics Education Research" (TIPERs).

Pre-/Post-tests
To be sure, Curt uses these pre-/post-tests for both "formative" and "summative" purposes (Glossary). When he uses them formatively, his purposes are to:

  • foster learning by forcing students to "really think" and making them "hungry to know;"
  • provide instructors with information about student knowledge that they can use to fine-tune their teaching.

Importantly, Curt and other faculty who use these formative assessment activities include them only sparingly in their course grading scheme: the "hungry to know" state of mind requires a low stakes environment, one in which it is safe to make mistakes.

(For specific examples of assessment activities, see Resource D, Pre- and Post-tests Used by Curt for Formative Assessment.)

By contrast, when Curt uses these pre-/post-tests for summative assessment, his purposes are to:

  • foster learning;
  • obtain performance data on which to assess individual student grades;
  • help students achieve "closure" and a sense of confidence on each of the physics topics they are learning.

The first purpose--to foster learning--is shared by formative and summative assessments, but the other two purposes are unique to summative assessments. Summative assessments are "high stakes" for students--they determine grades. They also provide intellectual closure, whereas formative assessments are designed to make students feel uncertain and ready to adjust their view of reality. Curt attempts to achieve his third summative purpose--help students achieve closure and confidence--during the discussion period he holds when he returns students' graded exams. He uses this time to help the students develop their capacity to correctly assess what they do and do not know, and to develop techniques for addressing the weak spots in their knowledge. He also believes that his exam review process is very important because physics is a very sequential discipline, and students need confidence in their understanding of earlier material in order to proceed successfully to the new topics.


Tasks Inspired by Physics Education Research (TIPERs)
Curt also places great importance on the use of a second category of formative assessment activities, which he calls "TIPERs" (Tasks Inspired by Physics Education Research). In his opinion, a number of physics education researchers have asked research questions that provide good insight into students' reasoning processes. Their questions focus on important physical concepts and scientific reasoning skills that students in math-based physics courses need in order to develop a functional understanding of key physics concepts. The intent of this research, Curt explained, is to develop insights that can help faculty more successfully enable students to solve problems with understanding.

These education researchers found that students enter introductory college physics courses with beliefs about the way the physical world behaves that are often only partially consistent, at best, with beliefs substantiated through physics research. The physics education research also has established that it is very difficult to modify some of the typical beliefs that students hold and has ascertained through experimentation that certain methods of teaching are more effective than others in getting students to make the appropriate modifications. In particular, this research provides evidence that instructional approaches that

  • compel groups of students to confront inconsistencies between their beliefs about physical phenomena and how physical phenomena actually are, and
  • require the students to make predictions, argue with each other, test their ideas, and make coherent explanations
lead to more productive learning.

Having learned of this research, it occurred to Curt that many of the learning tasks or formats that these education researchers had designed in order to pursue their research questions could be used effectively as formative evaluation activities in his course. These tasks could do double duty--as classroom "tasks inspired by physics education research" (TIPERs). He uses these tasks to introduce, teach, clarify and review a wide range of concepts and believes this practice builds robust learning.

The different types of TIPERs Curt uses and the sources from which he developed them are listed and described in Resource E. (Some of these use computer technology.) More details about the TIPERs can also be found at http://tycphysics.org.

Curt has found that students adapt quickly to the format of TIPERs. The Ranking Tasks, for example, require students to provide fill-in-the-blank responses, explain the reasoning they used, and rank the level of confidence they have in their answers. Often during class, he asks his students to work on Ranking Tasks or other TIPERs individually on paper and then compare their work with a few others or the class as a whole. Sometimes, instead of asking students to work independently on paper during the first stage, he will present a problem, ask them to think about it, and then poll them or ask for a show-of-hands. He then asks the students to explain why they made these choices, and eventually (with some coaching) they come to the correct consensus. To achieve the "hungry to know" purpose of these activities while also encouraging students to take the TIPERs seriously, Curt sometimes allocates a few points in his grading scheme to these tasks.

Curt calls TIPERs "one of the power tools for learning:" they provide a good means to ask questions in different ways and to ask very similar questions that are interrelated--processes that he considers especially valuable in implementing all his "active" learning activities (whether computer-dependent or independent). He has observed that students like these tasks--they know that they learn a lot from them. Moreover, TIPERs are easy for faculty to use. They do not take a lot of additional time to administer and are easy to analyze because patterns in student responses are easy to spot.

Curt's rationale for using TIPERs is entirely "formative." First, TIPERs force students to make their reasoning evident, thereby providing the instructor with useful information about what the students do and do not understand. He uses this information immediately to decide how to interact with the students that day and in subsequent class sessions. Second, the process of completing the tasks encourages students to engage in the predict-observe-explain learning sequence that is so central to Curt's teaching philosophy.

(See We have to know where students' problems are and not where we think they will be: Curt Discusses Formative Assessment Activities.)

It appears, based on the student testimony, that TIPERs (all of which the students referred to as "Ranking Tasks") involve a "pushing" factor that is critical to the learning process. They get students to think hard about a concept that is genuinely puzzling, which pushes them out of their comfort zone and makes them feel unsettled and confused. Thus, as they begin working on a topic in class, they already have their wheels spinning on the subject and are much more likely to get actively involved.

(See Once you do the task, you learn it: Curt's Students Discuss Formative Assessment Activities.)


2. Group Work/Guided Discussion
Curt, Bill, Marie, and Mike use group work activities both with and without computers. By requiring their students to work together on all their labs, they integrate small group work with their computer-dependent lab activities: hands-on experiments; visualization, graphical representation and simulation; and Interactive Lecture Demonstration. (When we described these activities in the Computer-Dependent Learning Activities section above, we did not highlight the group work elements.) In so doing, they make a virtue out of what might have been viewed as a resource "problem"--that the number of computers in the labs is two to three times smaller than the number of students in the class. Curt has designed the computer-based labs to function synergistically with group workg.

When the class meets in a regular classroom, Curt uses guided discussion activities that are so interactive, it is difficult to distinguish them from "group work." The activities essentially demand active participation from all the students. (We suspect that it would be very difficult to implement group work and guided discussion at the same time with more than 20 students in the class.) Primarily, the group work/guided discussion activities that Curt uses consist of:

  • requiring all the students to provide a response to a pre-test or TIPER question, round-robin fashion;

  • asking students to take turns solving and presenting problems at the board in a Socratic mode (an activity that the students dubbed "cooking");

  • using a more free-flowing format in which he forces the full group to grapple with hard questions that he won't answer for them. In such a format, students are encouraged to speak freely and to spiritedly disagree with each other.

In addition to the group work/guided discussion initiated and sustained by the JJC faculty, there is group work that the students themselves organize. As the students see it, there are two approaches to group learning, both of which entail students teaching students:

    Susan (interviewer): You said before that you "teach it to others." What type of student-to-student teaching is going on?
    Steve: Basically two different types. A lot of us get together in the mornings before class and crunch to finish the homework, and then afterwards we turn in what we have done. Then in class, he wants us to go up to the board and present it to other classmates and show them the way we did it. That way, you know that there are variations as to ways you can do it, different concepts you can look at.

The JJC faculty recognize that group work is critical to designing an effective constructivist learning environment for two main reasons: it gets students to teach each other, and it helps them to feel safe enough to participate actively in class. One thing essential to the success of their learning environments is that students must not be too apprehensive about contributing the ideas and explanations that instructors are trying to help them develop. If they are too shy or not very confident, they will be inhibited from participating. Group work, according to the students and staff we interviewed, diminishes these inhibitions. It lowers the intimidation factor because it helps students take charge of their own learning.


Summative Outcomes Data

    When you plot Hieggelke's students' post-test results on both the Mechanics Baseline and the Force Concept Inventory along with the results of students taught by other faculty who use the interactive engagement approach to physics, Hieggelke's students show as much if not more gain.
    --Alan Van Heuvelen (The Ohio State University Department of Physics)

The JJC faculty are striving to make learning meaningful by concentrating on teaching concepts rather than focusing on repetition of formulas and laws. This philosophy also shapes their summative assessmenth practices. Curt explained, for instance, how many flawed assessments test only the students' ability to regurgitate facts without challenging their true knowledge of the subject. His view, which is widely shared, is that having students who can rattle off Newton's Third Law without really understanding it does not constitute evidence of meaningful learning. Summative assessments should instead say something about a student's deeper understanding of these basic laws of physics. Moreover, faculty who are trying out new learning activities intended to help students achieve meaningful understanding can use the results of these tests to gauge the success of their new approach.

Accordingly, Curt uses a number of tests, some of which are used nationally, that are designed to assess conceptual learning in physics. Below he briefly describes the various exams he gives and the results of those tests.

    Curt: Now those tests I mentioned, I give those to all my classes--whether it's the liberal arts conceptual physics course, the algebra-trig based course, the course for allied health students or the physics course for engineering students--because they all have components of what I expect them to learn. I use a set of tests at the beginning of the semester. During the semester they take tests that other people have developed . . . and then the final exam. I've extended my final exam from two hours to four. They schedule exams for two-hour time blocks, so I get two of these blocks and give my students some of those assessment tools in those time slots.

    Susan: Do you have any data from the various classes that show, in national comparisons, how well your students are learning? Something about the value-added?

    Curt: Yeah, my data show rather strong gains.... The problem, which [large] universities don't face, is that I have particularly small classes. So I have to add all those classes together to get a statistically significant picture.

Because class size at JJC is small, it is difficult to obtain statistically significant information from these assessments on a semester basis. However, Professor Alan Van Heuvelen (The Ohio State University Department of Physics), a national expert in this area, informed us that,

    When you plot Hieggelke's students' post-test results on both the Mechanics Baseline and the Force Concept Inventory along with the results of students taught by other faculty who use the interactive engagement approach to physics, Hieggelke's students show as much if not more gain. His students' outcomes compare favorably with those of students taught by Eric Mazur at Harvard University, Paul D'Alessandris at Monroe Community College, and Tom O'Kuma at Lee College.

Below we list the names and acronyms for the summative assessment tests that Curt uses and indicate how, and in which physics courses, he uses them. [Note that these tests are the same as those described in the section on formative assessment, where we presented formative assessment as a learning activity. In Resource D, we provide brief descriptions of these tests and information about how to obtain them. Clearly, Curt uses these tools for both formative and summative assessment purposes.]

  1. Maryland Physics Expectations Survey (MPEX); Pre/Post-test in Physics 100, 201, 202
  2. Force Concept Inventory (FCI); Pre/Post-test in Physics 100, 201
  3. Force and Motion Conceptual Evaluation (FMCE ); Pre/Post-test in Physics 100, 201
  4. Testing Understanding of Graphs - Kinematics (TUG-K); Post-test in Physics100, 201
  5. Mechanics Baseline Test (MBT); Post-test in Physics 201
  6. Vector Evaluation - Tools for Scientific Thinking (TST); Post-test in Physics 201
  7. Heat and Temperature Conceptual Assessment (HTCE); Post-test in 201
  8. Conceptual Survey of Electricity and Magnetism (CSEM); Pre/Post-test in Phys 202
  9. Conceptual Survey of Electricity (CSE); Pre/Post-test in Physics 202
  10. Conceptual Survey of Magnetism (CSM); Pre/Post-test in Physics 202
  11. Determining and Interpreting Resistive Electric Circuits Test (DIRECT); Post-test in Physics 202
  12. Electric Circuit Conceptual Assessment (ECCE); Pre/Post-test in Physics 202

Note that Thornton, Sokoloff, and Laws have developed Items 3, 6, 7, and 12. Much of the data obtained using these tests has been collected to help inform the development of the computer-based MBL lab materials that they have produced. Curt and Bill use these tests because they have adapted many of the Thornton, Sokoloff, and Laws lab materials for their courses.

The Maryland Physics Expectations Survey (MPEX, Item 1) is not a test, but rather a survey that attempts to measure students' attitudes before and after taking a physics class. It asks students to assess the degree to which they agree with statements such as, "Physics is relevant to the real world." Published data for this instrument indicate that students tend to agree with this statement before a standard physics course (usually calculus-based) and tend to disagree with it after having completed the course. This outcome is not what most physics professors seek to achieve. MPEX outcomes for JJC physics students go against this trend.

The Force Concept Inventory (FCI, Item 2), and the Force and Motion Conceptual Evaluation (FMCE, Item 3) tests measure related and somewhat overlapping conceptual areas. The FCI and FMCE deal with kinematics and Newtonian thinking. Questions are multiple-choice and are written in non-technical language, but answers are included among attractive distractors that specifically address common-sense misconceptions about physics. The FCI is widely used, and data on student performance on the FCI are available from scores of courses at various institutions across the nation.

To enable consistent comparison of performance on the FCI of students from diverse institutions (from the most to the least selective), Richard Hake of Indiana University introduced an "average normalized gain" factor (Hake, 1998). As noted in the Introduction, Hake developed this factor, which has come to be known in the physics community as the "Hake factor," while researching the difference between traditional physics classes and what he calls "interactive engagement" classes in terms of students' pre-instruction and pot-instruction performance on the FCI. The significance of the Hake factor is that it adjusts for the fact that percentage improvement is normally easier for those who start with lower pre-test scores than for those who initially score quite high.

Hake factor (h) = actual gain / maximum possible gain, or
h = (average post-test score - average pre-test score) / (100 - average pre-test score)
Hake reported that 14 "traditional" courses that "made little or no use of interactive-engagement (IE) methods" achieved an average gain of 0.23±0.04 (std dev), whereas 48 courses that made "substantial use of IE methods" achieved an average gain of 0.48±0.14 (std dev), almost two standard deviations above that of the traditional courses (from 1998 article abstract). These numbers provide a kind of benchmark for other faculty nationally who use the FCI. Curt is using the Hake factor to establish average normalized gains on other tests, as well (as explained below).

At JJC, the FCI results for students in Curt's Engineering Physics course (Physics 201) vary a great deal from semester to semester, in part due to the very small class size. However, averaged over six semesters (Fall 1997 - Spring 2000), their Hake factor is 0.47 for the FCI (Table 1, below), which is comparable to the average Hake gain nationally for interactive engagement courses. The Hake factor for the same students on the FMCE, to which Curt has added several questions dealing with momentum is 0.62.


Table 1
FCI and FMCE Test Results for JJC Physics 201, Fall 97 - Spring 2000

(Number of students=68; SD=Standard Deviation)

 
FCI
FMCE