Monday, May 14, 2012

Formative assessment in action


University teachers tend not to be explicit about the formative assessment techniques they use. In fact, there are many who don't use the term at all when describing their practice.
Formative assessment is any learning activity that will assist the teacher to identify deficiencies in student learning to date, design future learning tasks to address these deficiencies, and provide students with feedback that will assist them to improve their performance in summative assessment activities. Formative assessment may be marked, but that mark will not count towards a final grade. It's one of the most useful strategies employed by effective teachers in any part of the sector. It helps teachers to monitor their own effectiveness, and to monitor the progress of their students.
So, if you've ever reached the end of a teaching session - a lecture, a tutorial, a seminar, a class, or some other form of lesson - and wondered whether your students have actually grasped the points you intended them to learn, you need to introduce some formative assessment. Here are a few techniques that will give you feedback on your teaching and on how well students have learnt the lesson you were teaching. You might discover that some quite unexpected things are happening in your class - both inspirational and horrifying. It's always best to know.
  1. The Minute Paper: Towards the end of the session, ask students to spend five minutes answering two questions:
    • What was the most important thing you learnt during this class?
    • What important question remains unanswered?
  2. The Muddiest Point: Towards the end of the session, or at the end of a section, ask students to spend five minutes answering the question "What was the muddiest point in ___ ?".
  3. RSQC2: Students write brief statements that recall, summarize, question, connect, and comment on key points from a session.
  4. Pro & Con Grid: Students list the pros/cons, costs/benefits, or advantages/disadvantages of an issue or question in a two-column format.
Collect the papers on occasion, and respond to them at the beginning of your next session with the students, in whatever way seems appropriate. At other times, simply invite students to make brief comments themselves at the beginning of the next class before moving on.

Variations on these techniques can be found in a range of different texts.

Directed Paraphrasing

This is a technique I encountered in an old booklet called Class Assessment Techniques: a handbook for faculty, by K. Patricia Cross and Tom Angelo, and have adapted slightly for this posting.

The activity is designed to test "the degree to which students have understood and internalized a given lecture or reading by [evaluating] their ability to summarize and restate the lesson in their own words". That sounds a bit bland, but think further on this later comment by the authors: "much of a student's eventual success depends on his or her ability to first internalize rather specialized and often complex information and then effectively communicate it". Are you the kind of person who understands something better once you have taught it to someone else? Me too.

This is a very authentic learning activity which mirrors the kinds of skills that students will need once they enter the workplace.

So here's what you do.
  1. Select a point in your course - perhaps after a major reading assignment, lecture, or seminar.
  2. Decide on an appropriate audience for the students, and how much speaking time they will need. Choose a non-expert audience. For example, if they are psychology students, they might be asked to describe a counselling technique to a group of teachers; if they are accountants, they might be asked to describe a change in the tax law to a client; and if they are medical students, they might be asked to describe a surgical technique to the parents of a child about to undergo an operation.
  3. Provide the audience with feedback sheets. Each feedback sheet should include the following:
    • an overall rating presented as a set of boxes to tick:
      • confusing
      • mininally understandable
      • adequately outlined
      • excellent explanation
    • space for members of the audience to record comments about the best aspects of the presentation
    • space for members of the audience to record comments about the worst aspects of the presentation
  4. If you have time, for each presentation, put the speaker in a group with his or her audience, and give them time to talk about the best and worst aspects of the presentation. You might need to provide guidance on the best way to provide useful feedback without destroying confidence. Alternatively, you as teacher can collect these evaluation sheets, go through and summarize them, add your own comments, and return them to the speaker.
Make sure that students do present the material in the role they have been allocated (and that they don't merely read out a pre-prepared script from a cheatsheet or a PowerPoint slide). Encourage them to use metaphor and examples, to draw on the board or on a piece of paper, and to check understanding with their audience to ensure that the main points are getting across.

Further reading:

Cross, K. Patricia & Angelo, Thomas A. (1988). Classroom Assessment Techniques: a handbook for faculty. Michigan: National Center for Research to Improve Postsecondary Teaching and Learning.

I found a copy on the web at http://eric.ed.gov/PDFS/ED317097.pdf, courtesy of my University's libary database subscriptions, but more recent and much more beautiful editions can be purchased from all the usual places.

Tuesday, April 3, 2012

The Mini-conference

In a traditional face-to-face teaching environment where students are assessed partly on an oral presentation, the lecturer usually puts up a list of the available spots and students (or groups of students) sign up for a spot.  Some go for the earliest spots, so that they can get it over and done with early. Others sign up for later spots, so that they can see what others do before them. Either way, marks have to be tweaked to take the schedule into account.

Here’s an alternative, suggested to me by my colleague James Meek: the mini-conference.

Instead of holding oral presentations every week for the 13 weeks of the semester, bring the students together towards the end of the semester for a whole day (or two), and run the day like a mini academic conference, complete with plenaries, discussion panels, streamed presentations, and opportunities for informal networking.

This works equally well for traditional semester-long courses, intensively-delivered courses, online courses (except here you run it like an online conference, e.g. Follow the Sun: Online Learning Futures Festival), and short courses.

Thursday, March 29, 2012

Crosswords

In some disciplines, the vocabulary (and spelling of specialist language) is extremely important. If this is so for your discipline, you might think about developing a number of crossword puzzles to use as stimulus or starter activities at the beginning of class, to fill in those minutes when the latecomers are drifting in. This will give your students practice at spelling the language of the discipline (and becoming familiar with the meanings of the words).

There are a number of websites that offer free software and more that offer more sophisticated, paid applications. Here’s a crossword I generated using one of these free online puzzle makers, and the answer sheet.




 

Small Groups

Small group discussions can work very well, but you need to have quick, easy ways of grouping and re-grouping the students.

Here are some methods.

First, count the number of students in the class on the day.

Decide how many people you want in each group. Say you have 20 students in the group, and you want them in groups of five.

  1. DIY: “Divide yourself up into groups of five.” If you do it this way, they will sit with their friends. This works in some situations, but not in others.
  2. Count them off: Once all the students are in the room, count them off around the room: 1, 2, 3, 4; 1, 2, 3, 4, … etc. Sit all those numbered 1 together, all those numbered 2 together and so forth.
  3. Aye, Captain: Pick four “captains” and allow them to choose four others to join their group.
  4. Mixed abilities: Create lists of team members before you get into the room, based on ability. In each group, put one from the highest-achieving five, one from the lowest-achieving five, and three from the middle of the pack.
  5. Similar abilities: Rank the students, and then make up the groups by allocating them in order: the five top-achievers are in Group A, the next five in Group B and so on.
These are their Home Groups.

Beadle’s Jigsaw
So, you’ve grouped the students and set each group a different (but related) set of on-topic questions. Keep the list of questions short. They discuss the topic and questions in their Home Group.

While they are talking, go around, and put stickers on their upper arms. (You will have pre-prepared stickers that will sort the students into four Expert Groups, each of five students.) Stop the first discussion.
Direct the students to stand and re-group according to the stickers: all those in Expert Group 1 sit together, and so on.

In the Expert Group discussions, each student reports on discussions and conclusions from his or her Home Group.

If necessary, move them back into their Home Groups and begin all over again with a different topic.


To read more about Phil Beadle’s tips on teaching, read his book: Beadle, P. (2010). How to teach. UK & USA: Crown House Publishing.

Thinking Aloud as a Problem is Solved

This idea is from a site that focuses on collaborative learning.

The strategy is this.

Divide the class into pairs. If you have one student left over, add that student to one of the pairs as an extra listener, or listen to him/her yourself.

Present the pairs with the problems they are to solve. The first person in the pair takes the role of Solver for the first problem. He/she reads the problem aloud, and talks through the solution, making notes when necessary. The second person in the pair is the Listener. He/she listens carefully, but does not guide the first person to the solution. Rather, the Listener's role is to catch any errors (pointing out that an error has been made, but not identifying it or providing correction), question the Solver about any gaps or leaps in logic, and ask for clarification when the Solver's explanation becomes unclear.

To read the author's explanation of the theory behind the strategy, go to the Doing CL website.

Wednesday, March 28, 2012

Building Student Communities

Most tertiary sector institutions use a Learning Management System (LMS) these days. It might have a local name, but sitting behind that cutely named online learning environment is usually one of the vendor-supported applications (e.g. Desire2Learn) or one of the two main English language open-source LMS applications (Moodle or Sakai). This isn’t about LMS applications, though, it’s about a couple of lovely little (externally-hosted) tools called ELGG and Ning.

ELGG: According to the company website, ELGG “is an award-winning open source social networking engine that provides a robust framework on which to build all kinds of social environments”. It’s a bit like an LMS, but not really. It’s reason for being is to facilitate social learning and sharing of resources and ideas.

Ning: The Ning website says: “Hit the ground running to engage and grow your community (big or small). Organize events. Use member profiles to bring faces to names. Get everyone talking through groups, forums, chats and activity stream. Plus more (lots more).”

Have a look … I am sure you will find uses for them. Free versions are available.