Skip to main content

Rethinking Formative Assessment

We've seen an increased significance placed on formative assessment in the legal academy. Standard 314 of the ABA Standards requires that law schools use both formative and summative assessment methods in their curriculum. Its rational for doing so is "to measure and improve student learning and provide meaningful feedback to students." The ABA defines formative assessment methods as "measurements at different points during a particular course or at different points over the span of a student's education that provide meaningful feedback to improve student learning."

Those of us in the legal research instruction business are no strangers to formative assessment. We are leaders in this in the law school curriculum, with rarely a class going by in which students do not practice their skills. Lately, though, I've been wondering whether I'm going about formative assessment in the way that will best provide meaningful feedback to students. In the mandatory workshops we put on for our first year students, we focus intensely on Rombauer's method--research as a process, not a mere gathering skill. More often than not, however, our ungraded formative assessments, while disguised as an open problem because we start them off with a client-based fact pattern, are really designed to lead them from source to source--effectively a treasure hunt that takes them through the process. Now, I'm not entirely opposed to treasure hunts as a tool to teach the mechanical side of research. But, if we purport to be teaching our students process and analysis, we need to let them engage in that process with ungraded assessments where we are not directly telling them which sources to use and in which order. Otherwise, their first opportunities to truly engage in the research process openly is on their graded open memos--which, at least in my students' case, are being graded by their legal writing professors, not the legal information experts who taught them the four-step process in the first place. As such, the focus of the feedback is spread across any number of topics--technical writing, style, and more, in addition to which sources they found. Students are not getting meaningful feedback centering primarily on the research process they used.

Students need practice conducting open research problems without the pressure of a looming grade. Otherwise, students fixate on finding the "right" answer or sources, rather than engaging in and absorbing the process. Without being worried about producing a graded written product, students are able to take in the research process fully because their cognitive loads are lessened. This will also help students view research as more than a rote, mechanical task to gather authorities, as they're able to isolate the skills necessary for successful research from those needed for successful writing.

In my instance, this means creating assignments that students may not be able to complete in the allotted 50-minute time period we have--or at least that we don't have time to review in that short time. This may require buy-in from the legal writing professors to allow us to give students homework, perhaps in the form of participation points, because if an assignment isn't sanctioned by the professors who are responsible for their grades, the students may not take it seriously. We must be willing to have conversations with our legal writing colleagues about creative ways to incorporate ungraded, formative assessments into the curriculum (in those situations where we are not their "grading" professor). We need to be upfront with them about what exactly we are trying to teach our students--process and analysis, and why this particular type of assignment is a necessity.

This also requires us being willing to review assessments from our entire first year class, which may be a challenge depending on the number of instructional librarians you have and how much other for-credit and non-credit teaching they might be doing. One way to get around having to collectively grade ~140 1L assessments might be to create a video walking through the research process you'd use for a given problem. But this isn't a perfect solution, as there are often multiple ways to move through a research problem successfully. I always lean toward wanting to give individualized feedback based on students' attempts--even better if that feedback is in a conference so I know students are absorbing it. Still, the most important point is that students are 1) getting a chance to practice open problems and 2) they are receiving some kind of meaningful feedback. After all, meaningful feedback is our best way to ensure that our students will be able to conduct research successfully in practice. It's also our best way to demonstrate to our students that research is a process that requires critical thinking.

Popular posts from this blog

Using Backward Design in Course Development

There are different methods instructors use to design their courses. In his book Creating Significant Learning Experiences, L. Dee Fink identifies three major approaches:
In the first approach, the instructor picks out some number of major topics within their course subject matter, then preps lectures for each topic. Then he or she adds in a final exam and sometimes a midterm, and the course is ready to go.  Fink notes that this approach is less time-consuming, but "pays little or no attention to the quality and quantity of student learning." [1] He explains that this type of learning "has a relatively short half-life and, more significantly, does not meet the educational needs of students and society today." [2]In the second approach, instructors still designs their course around major topics, but rather than focusing solely on lectures, he or she incorporates a variety of active learning opportunities. This approach is more engaging for students, but it still does…

Four Aspects of Effectual Teaching (& Why Instructional Design Is the One Missing In Many Law Courses)

There are four general components of teaching, which all must come together for a teacher to be successful:
Knowledge of the Subject Matter: Most instructors in higher education have this covered. The largest potential hurdle of this aspect of teaching is perhaps remembering to view the material from the perspective of the beginner learner, as opposed to from the teacher's own advanced learner status. In my first year of teaching, I found this to be an issue, as I jumped over steps that were so obvious to me that I didn't even notice them anymore. It was only by students asking questions that illustrated I was missing an important step in their comprehension and by watching the legal writing professor I co-taught with that I began to break down my material into pieces that were more digestible for my students.

Interaction with Students: Instructor-student interaction can take a myriad of forms. As L. Dee Fink writes in Creating Significant Learning Experiences,

"Teacher-stud…

Students Forget Most of What We Teach (And What To Do About That)

Studies show that humans forget most of what they learn. But, students acquire new knowledge better when we keep a couple of things in mind:

1)  Students learn better when they have a clear understanding of why they are being expected to learn new tasks and information. As such, it is critical that we explain to students why we are teaching what we’re teaching. Tying curriculum back to practical application can help students understand the importance of what they are learning. 

For those of us teaching legal research, this is vitally important. We have to tell students why being strong researchers is central to their ability to be efficient lawyers—that they will be spending approximately 35% of their time conducting legal research in their first few years of practice. We have to explain to them that research is an analytical skill that they must practice in context so they can learn to do this critical lawyering skill effectively. It’s also important that we explain the importance of t…

Helping Students Learn to Learn

One aspect of learning that I see students struggle with the most is applying the skills they have learned to new scenarios or situations. It is critical that students are equipped with the ability to continue to advance in their profession and in their knowledge after they have left our courses and law school altogether. This is true for two reasons. First, it's not possible for students to learn everything there is to know about the law--or even one topic within the law--during the course of law school. There's simply too much content to learn; the best we can hope for is to identify the fundamental knowledge for our subject areas and do our best to make sure our students know that material. Second, even if they could learn everything, they would have to be able to continue to learn as new areas of law emerge and preexisting areas of law evolve.

In his book, Creating Significant Learning Experiences, L. Dee Fink identifies three different meanings for "learning how to l…

The “Burden” of Being An Excellent (Legal Research) Teacher

The challenge of being an excellent teacher stems from the necessity of having to be an expert in two areas, one’s subject specialty and the craft of educating. For law librarians who instruct, this means first being an expert in using constantly-evolving legal research databases, not to mention those newly developed resources that we must quickly learn to use, and in the analytical process inherent to legal research. Staying fully abreast of changes to the huge volume of legal materials could alone be a full-time job. When combined with efficiently and effectively serving our patrons, engaging in collection development, and doing any of the other dozens of tasks that librarians undertake on a daily basis, it becomes easy to see why finding the time to hone our craft as teachers would be difficult. Despite these challenges, it's critical that we make time to do so.
As one scholar explains, Really good teachers who want to preserve their skills and get better over time have to go int…