FLAG - Classroom Assessment Techniques (CATs)

Weekly Reports    (Screen 4 of 6)

Variations
Report Structure
Depending on the course, the questions may be modified to reflect course or disciplinary requirements. For example, in a physics or chemistry course you might ask students to focus their questions on the homework problems. In biology, students might focus on lecture, laboratory or reading assignments.

One useful variation on Question 3 requires students to provide a rationale or justification for each of their questions [e.g., "If I were the professor I would ask students to explain the function of DNA ... because understanding the function of this molecule is central to understanding all the physiological processes of living things].

If you are using this technique in a science methods course (I found it very useful to teach science to pre-service teachers), you might change the last question to: "If I were the elementary teacher and taught this material to children, what questions would I ask to find out if they understood it?" This will offer an opportunity to teach question asking techniques.

Number of questions
In some courses, instructors feel that the third question is less informative than the first two, and they omit it. In other courses instructors assign the second and third questions every week, and the first one every other week to alternating groups of students. Both of these strategies reduce the workload of the instructor.

Frequency of Reports
Some instructors feel that it is too time-consuming to grade Reports every week. Instead they assign them every other week and have quizzes on alternating weeks.


Analysis
Scoring Weekly Reports
To start, we suggest that you decide how you are going to score the Reports. What is the maximum score? How is it to be distributed among the three questions? What criteria should be used to assign value to student responses? [ You might take a look at the CAT on Scoring Rubrics by Diane Ebert-May]. Three issues are central to any scoring scheme for Weekly Reports: What are the most important concepts of the week?; How much "explanatory value" is represented by each concept?; and How are the concepts connected to each other?. A concept map may be helpful here but only if it is not overloaded with details, and really represents important connections. [See CAT on
Concept Mapping by Michael Zeilik.]

Level of Difficulty of Student Questions
To assess the understandings, interests and expectations of students, it may be useful to analyze the levels of difficulty posed by their questions. For example, one can assign four levels of difficulty to interrogatives posed in questions 2 and 3 as follows:


Pros and Cons

However,
  • Weekly Reports may be frustrating to students because they are rarely asked to write in science courses or to reflect on their knowledge.
  • Weekly Reports require training of students.
  • Weekly reports take a great deal of instructor time (answering questions).
  • Reliable scoring requires knowledge of rubrics.


Tell me more about this technique: