Header text

EssayTagger is a web-based tool to help teachers grade essays faster.
But it is not an auto-grader.

This blog will cover EssayTagger's latest feature updates as well as musings on
education, policy, innovation, and preserving teachers' sanity.
Showing posts with label formative assessment. Show all posts
Showing posts with label formative assessment. Show all posts

Wednesday, May 1, 2013

How to configure an assignment for "Evaluation-only" mode

With today's release of "Evaluation-only" mode support, instructors can now evaluate end-of-unit and final essays without providing feedback comments. Here's how to get started.


We're super-excited that we were able to launch our new "Evaluation-only" mode in time for most schools' final exams. Finals are the strongest case for when to use "Evaluation-only" mode; it's too late to provide helpful feedback and the kids won't get much out of it anyway with their minds already on summer.


Enabling "Evaluation-only" mode
Create or edit an assignment as you normally would. You'll notice a new option: "assessment mode":



Click the droplist and select "Evaluation-only" mode:


Latest update: "Evaluation-only" mode - just in time for finals!

EssayTagger is all about helping teachers provide targeted feedback that will promote student growth. But mid-stream fast formative assessments or end-of-unit summative assessments don't always require extensive feedback. Now EssayTagger supports both "Evaluation + Feedback" and "Evaluation-only" assessment modes to support those situations.


First, the lingo
It's taken me a while to wrap my brain around the following two terms, so let's review them just to be sure we're all on the same page:

Formative Assessment is a kind of check in with your students in the middle of a unit to see where they're at, see where they're struggling. The goal is to then use this information to make on-the-fly adjustments to your plans and instruction to help the students reach the goals you've set out for them. Formative assessments should be fast, simple, and low-stakes or zero-stakes (i.e. not for points). And they have to come early enough so that there's still time left to adjust course as needed. If you just want to quickly "take the pulse" of the room, there's no need for extensive feedback comments.

Summative Assessment is the end measurement point. Did they reach the goal? How many of the target skills can they actually demonstrate now that the unit is complete? Because summative assessments come at the end of the learning process, providing feedback or further coaching at this point is somewhat pointless. When students hand in a final essay at the end of the school year are they really going to absorb your extensive comments as they start their summer vacation? Shyeah, right!


EssayTagger's default mode: "Evaluation + Feedback"
Our primary emphasis on feedback comments places us outside of the world of fast formative assessment and summative assessment. In this mode instructors select a feedback comment from the appropriate quality column or add new reusable comments as needed:



Extensive feedback makes sense when a further draft is expected and students have a chance to incorporate or address your comments. Ideally all writing assignments would have a write-review-rewrite cycle built into the schedule.


The new "Evaluation-only" mode
With today's new release, instructors can opt to configure an assignment to focus solely on evaluation.

Drag-and-drop the rubric element like you normally would. In this example, we are dragging the "Thesis" button to identify the essay's thesis:



But now when the "Thesis" evaluation options pop up, we see that there is only a single choice for each quality level:


Wednesday, January 16, 2013

Using EssayTagger for fast formative assessment, pt2

In part two we explore a method for fast, effective formative assessment by leveraging EssayTagger's strengths and incredible built-in data reporting.



Part two: Fast, effective formative assessment with EssayTagger


"If students receive feedback often and regularly, it enables better monitoring and self‐regulation of progress by students."
- Nicol and Macfarlane-Dick

At face value EssayTagger's core function--grading essays more efficiently--seems more well-suited to end-of-unit essay evaluation (summative assessments). But as you'll see we can easily leverage EssayTagger's strengths to hit all three formative assessment keys discussed in part one: speed, detailed diagnostics, and quality feedback.


Basic approach
Develop open-ended, journal-style written response questions aligned with unit goals and then evaluate students' work in EssayTagger, focusing on short, targeted feedback. Then review the evaluation results data to refine class-wide instruction and target individual reinforcement or remediation. Ideally you would repeat 2-3 times throughout the unit before the end-of-unit summative assessment.


A concrete example: The Tempest, Sophomore English
When studying Shakespeare with sophomores we need to work on the mechanical skill of processing the complex text and would like to see the students develop an engagement with the text at an emotional, human level. A final summative assessment might come in the form of an essay prompt like, "Do Prospero's ends justify his means?"which would require a detailed understanding of the text and characters along with an expectation of referencing appropriate textual evidence.

Using EssayTagger for fast formative assessment, pt1

In part one we'll quickly review what formative assessment is and some of its key characteristics. Then we'll learn how to use EssayTagger for fast, effective formative assessment.

"The giving of marks and the grading function are overemphasized, while the giving of useful advice and the learning function are underemphasized."  
- Black, Paul, and Wiliam

Buzzword primer
I often get lost in the absurd world of edu-speak lingo. So before we even start, let's define our two key terms:

Formative assessment is an approach where the teacher "build[s] in many opportunities to assess how students are learning and then use[s] this information to make beneficial changes in instruction" (Boston). Formative assessments happen during a unit, within the flow of instruction. It's about quickly diagnosing problems and adjusting what you're doing tomorrow to produce better results before the unit ends.

Summative assessment "generally takes place after a period of instruction and requires making a judgment about the learning that has occurred (e.g., by grading or scoring a test or paper)" (Boston). You could also call this "Final assessment"--it's looking to measure the end result of instruction.

The two can be boiled down to: "where are we struggling?" (formative assessment) vs. "how did we do?" (summative assessment). Or, if you prefer a more colorful analogy: "what's the patient's temperature" vs "how many patients survived?"


Formative Assessment Key #1: Speed
If your goal is to modify instruction tomorrow, clearly your formative assessments need to be fast. It would be absurd for a nurse to take a patient's temperature and then have to wait a week for the results.

Formative Assessment Key #2: Detailed diagnostics
One of the key principles behind formative assessment is that it "provides information to teachers that can be used to help shape teaching" (Nicol and Macfarlane-Dick). In this sense they are diagnostic, identifying the areas where students are struggling. The more detail it can provide--exactly who is struggling in which areas--the better, but this generally slams up against the need for speed. It's very difficult to do quick formative assessments that are highly detailed and still allow the teacher to have a life.

Formative Assessment Key #3: Quality feedback
While the first two keys were teacher-centric, this one is student-centric. Part of what powers formative assessment's effectiveness is the targeted feedback provided to each individual student. It's not enough to merely see where course corrections are needed; each student must be explicitly steered in that direction.