Adapting traditional rubrics for EssayTagger: Nevada Opinion Writing Rubric (5th grade)

EssayTagger represents an evolution of the concept of a rubric. Here's a specific look at how I adapted an existing rubric to take advantage of the EssayTagger world.

If you're new to the EssayTagger world, here's a primer on how EssayTagger rubrics are different from traditional rubrics.

Tearra Bobula, a teacher at Mark Twain Elementary in Carson City, NV, asked me to adapt the Nevada Opinion Writing rubric. It initially presents a bit of a challenge. It consists of five main sections that each contain a subset of 2-4 additional elements:

(click for larger view)

Let's take a closer look at the first section:

(click for larger view)

Each row of this section pertains to the Statement of Purpose/Focus, but assesses slightly different aspects of that overall area. I would break these four sub-elements down to something like:

• Statement of Opinion
• Focus
• Maintain Purpose/Focus
• Provides Context

So when I adapted this rubric I treated each sub-element as its own rubric element:

Latest Update: Administrator Report emails

A simple new convenience feature driven by teacher feedback from my friends at El Camino Real Charter High School out in sunny southern California.

El Camino is embarking on an ambitious effort to coordinate classroom expectations across all teachers. Such an effort requires a bit of a culture shift--your classroom is no longer an isolated private island--as well as some technology support to ease the logistics of so much collaboration and sharing.

Specifically, they needed to be able to share their graded essays with their administrators and other teachers in the school. The interim solution was to print hard copies (ack, no!!!) or manually copy-and-paste the hyperlink to each student's graded work.

In order to support their efforts (which are perfectly aligned with my own philosophy of enhancing school-wide collaboration through data unification), we added a simple Administrator Report feature which emails a list of each student's results and provides a link to their graded essay:

Administrator Report email (fake test data for demonstration purposes)

Where we're headed: school-wide data unification

EssayTagger was initially developed as a tool to help individual teachers. Now we're taking aim at unifying all writing assessment data across an entire school or district. Here's why this is valuable and here's how we'll do it.

The problem: Disparate writing assessments
In a typical school there's a wide array of teachers who assess writing throughout the year. And with the increasing emphasis on "reading and writing across the curriculum," those numbers are growing. English and Social Studies teachers are busy as ever grading essays, but now there are Math teachers who are assigning reflection paragraphs. PE teachers are assigning sportsmanship essays.

Unfortunately writing assessments are almost always isolated within the confines of each individual classroom. The History teacher knows that his students are struggling with using evidence in their writing, but he has no idea that his students' English teacher is frustrated with the same problem. There simply aren't any lines of communication across departments to share this information and collaborate on a solution.

But the worst offenders are the district writing assessments. Many schools will do a school-wide writing assessment that is scored on a standardized rubric which is then coded into a database so that administrators can pore over the results. These district writing assessments exist outside of the normal curriculum (e.g. in the middle of the Huck Finn unit the sophomores will be asked to write about texting while driving). Worse, the students rarely ever see the results and almost never receive any feedback. They're writing into a black hole. And, oddly enough, teachers often don't even see the results. They might see some bullet points on an institute day slideshow or get the data second-hand from their department head.

Disparate writing assessments are pure silliness.


Writing--and assessing--across the curriculum
We've bought into the value of writing across the curriculum and now it's time to unify assessment data across the curriculum.

Every writing assessment tells us more about each student and our school's overall trends. Assessment data shouldn't be cloistered within the walls of each classroom, but rather should be contributing to a rich web of highly interconnected data. This is the "web-ification" of the school structure; teachers need to think of themselves as part of a network instead of individual sovereign islands.

When Bobby's English teacher grades his essay, his History teacher should be able to see the results down to each individual skill being assessed. The district writing assessments should add to this pool of information and provide more insight to all of Bobby's teachers. The Culinary Arts teacher should know what strengths and weaknesses to expect when she assigns a research paper on launching your own restaurant. The school's writing center or peer tutors could benefit from a detailed skills profile for  each student that comes for help.

Latest update: Google apps and Drive integration is here!!

Today's major new release enables student sign-in via Google apps accounts and integration with Google Drive!

Just about every school I talk to has jumped onto the Google apps bandwagon. It's really a no-brainer. It is the best platform on the planet and it's free for schools. Insane.

I'm super-excited to announce that as of today students will be able to sign in to EssayTagger using their Google apps accounts.

Google sign-in simplifies the process for both students and teachers while increasing reliability and security. This is already a huge win, but there's more!

Google account sign-in opens the door to integrating with Google Drive. Now students can link their Drive account and pull their assignments directly out of Drive:

Using EssayTagger to coordinate PLT assessments, pt2

Part 1: PLTs must have common assignments and common assessments
Part 2: How to coordinate PLTs with EssayTagger
Part 3: Analyzing the data reports (coming soon)

In part two we show you a simple way to increase PLT coordination while maintaining each teacher's individual voice and personal flair.

Let's assume you're onboard with the idea that PLTs need to have a few common assignments that have common assessments in order to gauge the PLT's progress and effectiveness (if not, check out part 1).

Now how do we do this? I closed part 1 by sharing how much I hate common assessments because they are never in my voice and seem like an alien or foreign presence in my classroom. Education reformers would be wise to note that jarring students out of the environment they're used to isn't the best way to assess the effectiveness of that environment!

Producing uniform PLT assessment data seems incompatible with preserving the unique flair and character of each teacher's classroom.

EssayTagger provides a way around that conundrum.


Shared rubrics
Rubrics are at the heart of how teachers assess written work in EssayTagger. And they are EssayTagger's secret weapon to solving the problem at hand.

Have your PLT agree upon a shared assignment. Let's say all of the Sophomore English teachers will be teaching "The Tempest". We can agree upon a few key goals for our Tempest unit and develop a summative essay assignment for the end of the unit.


Collaborate on the rubric
Now have one teacher log into her EssayTagger account (or jump to our free Common Core Rubric Creation Tool) while the PLT discusses what they'd like to see in the rubric for this shared assignment. Consider the PLT's goals for the unit and begin building the rubric in EssayTagger. Again, we only need one transcriber to create the rubric.

Using EssayTagger to coordinate PLT assessments, pt1

It's becoming more and more important to coordinate curriculum and assessment within PLT teacher teams. In part one we'll briefly discuss PLTs, motivate why coordination is so important, and discuss some of the challenges. Part two will discuss how to use EssayTagger to enhance that PLT coordination without stifling teachers' individual voices and strengths. Part three will look at how the resulting data can help each individual teacher and the PLT as a whole.

Part 1: PLTs must have common assignments and common assessments

Part 2: How to coordinate PLTs with EssayTagger

Part 3: Analyzing the data reports (coming soon)

PLTs are in
Most schools seem to be moving toward the PLT--Professional Learning Team--model where, for example, all of the Sophomore English teachers would meet regularly, plan team goals, share resources and exercises, and hopefully develop a few common assignments and assessments.

However, I've been in schools that still operated with each teacher as his or her own island. In this sort of environment the PLT concept will likely be met with significant resistance. There will always be the I've-been-doing-it-my-way-for-35-years holdouts but even the most progressive-thinking teachers will worry about the constricting nature of making their classes more uniform and perhaps less unique.

On the flip side, I've been in schools that had weak or ineffective PLTs, despite significant administrator emphasis on them. Simply meeting every other week is not enough. We would talk about what each of us were doing, but there'd be no central focus or plan. It has to be more than just check-in-and-share time.

Sadly, teacher prep programs aren't taking a lead on this. I'm disappointed that my M.Ed. program didn't train us to collaborate with our peers. PLTs weren't even mentioned once during my two year program. We're supposed to be the new guard, the fresh blood bringing a modern approach to education. But too many Schools of Education are themselves stuck in old-guard or outdated modes of thinking and practices.

So I feel like I have a pretty strong grasp of many of the challenges and pitfalls when it comes to PLTs. And it's no surprise that transitioning to a team approach can often be a difficult process when a culture of collaboration or direct experience with PLTs is lacking. But as you'll see in part two, there is hope. Incremental change and increased coordination is possible and can be facilitated by some 21st-century technology.


Coordination is king
A PLT has to have a set of common goals for their class sections. If a PLT doesn't have a common vision for student outcomes, you don't really have a PLT; you just have a bunch of individual teachers sitting in the same room. Common goals matter. My Sophomore English students have to be just as prepared to enter their Junior English class as the students from any other Sophomore English section. And the Junior English teachers should have a reliable set of expectations for what they'll get from their incoming juniors each year.

But just setting common goals isn't enough. We need to know if those goals are being met. Did our sophomores really get to where we wanted to get them? And how did my specific crop of sophomores do vis-à-vis the rest of the PLT's students? Did my kids see particular gains or struggles versus their peers? This isn't about outing a bad teacher or competing against my teammates. It's about being able to identify what is and is not working in my class and across all of our classes.

Using EssayTagger for fast formative assessment, pt2

In part two we explore a method for fast, effective formative assessment by leveraging EssayTagger's strengths and incredible built-in data reporting.

Part one: Primer on formative assessment

Part two: Fast, effective formative assessment with EssayTagger

"If students receive feedback often and regularly, it enables better monitoring and self‐regulation of progress by students."

- Nicol and Macfarlane-Dick

At face value EssayTagger's core function--grading essays more efficiently--seems more well-suited to end-of-unit essay evaluation (summative assessments). But as you'll see we can easily leverage EssayTagger's strengths to hit all three formative assessment keys discussed in part one: speed, detailed diagnostics, and quality feedback.


Basic approach
Develop open-ended, journal-style written response questions aligned with unit goals and then evaluate students' work in EssayTagger, focusing on short, targeted feedback. Then review the evaluation results data to refine class-wide instruction and target individual reinforcement or remediation. Ideally you would repeat 2-3 times throughout the unit before the end-of-unit summative assessment.

A concrete example: The Tempest, Sophomore English

When studying Shakespeare with sophomores we need to work on the mechanical skill of processing the complex text and would like to see the students develop an engagement with the text at an emotional, human level. A final summative assessment might come in the form of an essay prompt like, "Do Prospero's ends justify his means?"which would require a detailed understanding of the text and characters along with an expectation of referencing appropriate textual evidence.

Using EssayTagger for fast formative assessment, pt1

In part one we'll quickly review what formative assessment is and some of its key characteristics. Then we'll learn how to use EssayTagger for fast, effective formative assessment.

"The giving of marks and the grading function are overemphasized, while the giving of useful advice and the learning function are underemphasized."  

- Black, Paul, and Wiliam

Buzzword primer
I often get lost in the absurd world of edu-speak lingo. So before we even start, let's define our two key terms:

Formative assessment is an approach where the teacher "build[s] in many opportunities to assess how students are learning and then use[s] this information to make beneficial changes in instruction" (Boston). Formative assessments happen during a unit, within the flow of instruction. It's about quickly diagnosing problems and adjusting what you're doing tomorrow to produce better results before the unit ends.

Summative assessment "generally takes place after a period of instruction and requires making a judgment about the learning that has occurred (e.g., by grading or scoring a test or paper)" (Boston). You could also call this "Final assessment"--it's looking to measure the end result of instruction.

The two can be boiled down to: "where are we struggling?" (formative assessment) vs. "how did we do?" (summative assessment). Or, if you prefer a more colorful analogy: "what's the patient's temperature" vs "how many patients survived?"


Formative Assessment Key #1: Speed
If your goal is to modify instruction tomorrow, clearly your formative assessments need to be fast. It would be absurd for a nurse to take a patient's temperature and then have to wait a week for the results.

Formative Assessment Key #2: Detailed diagnostics
One of the key principles behind formative assessment is that it "provides information to teachers that can be used to help shape teaching" (Nicol and Macfarlane-Dick). In this sense they are diagnostic, identifying the areas where students are struggling. The more detail it can provide--exactly who is struggling in which areas--the better, but this generally slams up against the need for speed. It's very difficult to do quick formative assessments that are highly detailed and still allow the teacher to have a life.

Formative Assessment Key #3: Quality feedback
While the first two keys were teacher-centric, this one is student-centric. Part of what powers formative assessment's effectiveness is the targeted feedback provided to each individual student. It's not enough to merely see where course corrections are needed; each student must be explicitly steered in that direction.

Using EssayTagger to level expectations within teacher teams

Teacher teams should have a common vision for what "success" means for their students. EssayTagger collects and analyzes a ton of data which can be used to create consistent expectations across the teacher team.

Whenever you grade an assignment in EssayTagger you end up with an assortment of data reports that provide a deeper insight into how your students performed, based on your evaluations.

That's all well and good, but what is the relevance to teachers operating in a team-based approach? What does the rest of the Sophomore English team care about the results from my two Soph Eng sections?


At a minimum, compare results and discuss
Maybe I find that my sections are doing reasonably well on Thesis but are still developing their skills with Counterclaims. Are the other Soph Eng teachers seeing the same thing with their students?

If so, we can talk about strategies to improve their work with addressing the opposing viewpoint.

Or perhaps we'll find that my Thesis results look stronger than the other teachers' results. Now things get interesting. Am I doing something awesome that's really working with my kids or am I just grading their theses too generously?