Latest Update: Administrator Report emails

A simple new convenience feature driven by teacher feedback from my friends at El Camino Real Charter High School out in sunny southern California.

El Camino is embarking on an ambitious effort to coordinate classroom expectations across all teachers. Such an effort requires a bit of a culture shift--your classroom is no longer an isolated private island--as well as some technology support to ease the logistics of so much collaboration and sharing.

Specifically, they needed to be able to share their graded essays with their administrators and other teachers in the school. The interim solution was to print hard copies (ack, no!!!) or manually copy-and-paste the hyperlink to each student's graded work.

In order to support their efforts (which are perfectly aligned with my own philosophy of enhancing school-wide collaboration through data unification), we added a simple Administrator Report feature which emails a list of each student's results and provides a link to their graded essay:

Administrator Report email (fake test data for demonstration purposes)

Where we're headed: school-wide data unification

EssayTagger was initially developed as a tool to help individual teachers. Now we're taking aim at unifying all writing assessment data across an entire school or district. Here's why this is valuable and here's how we'll do it.

The problem: Disparate writing assessments
In a typical school there's a wide array of teachers who assess writing throughout the year. And with the increasing emphasis on "reading and writing across the curriculum," those numbers are growing. English and Social Studies teachers are busy as ever grading essays, but now there are Math teachers who are assigning reflection paragraphs. PE teachers are assigning sportsmanship essays.

Unfortunately writing assessments are almost always isolated within the confines of each individual classroom. The History teacher knows that his students are struggling with using evidence in their writing, but he has no idea that his students' English teacher is frustrated with the same problem. There simply aren't any lines of communication across departments to share this information and collaborate on a solution.

But the worst offenders are the district writing assessments. Many schools will do a school-wide writing assessment that is scored on a standardized rubric which is then coded into a database so that administrators can pore over the results. These district writing assessments exist outside of the normal curriculum (e.g. in the middle of the Huck Finn unit the sophomores will be asked to write about texting while driving). Worse, the students rarely ever see the results and almost never receive any feedback. They're writing into a black hole. And, oddly enough, teachers often don't even see the results. They might see some bullet points on an institute day slideshow or get the data second-hand from their department head.

Disparate writing assessments are pure silliness.


Writing--and assessing--across the curriculum
We've bought into the value of writing across the curriculum and now it's time to unify assessment data across the curriculum.

Every writing assessment tells us more about each student and our school's overall trends. Assessment data shouldn't be cloistered within the walls of each classroom, but rather should be contributing to a rich web of highly interconnected data. This is the "web-ification" of the school structure; teachers need to think of themselves as part of a network instead of individual sovereign islands.

When Bobby's English teacher grades his essay, his History teacher should be able to see the results down to each individual skill being assessed. The district writing assessments should add to this pool of information and provide more insight to all of Bobby's teachers. The Culinary Arts teacher should know what strengths and weaknesses to expect when she assigns a research paper on launching your own restaurant. The school's writing center or peer tutors could benefit from a detailed skills profile for  each student that comes for help.

Using EssayTagger to coordinate PLT assessments, pt2

Part 1: PLTs must have common assignments and common assessments
Part 2: How to coordinate PLTs with EssayTagger
Part 3: Analyzing the data reports (coming soon)

In part two we show you a simple way to increase PLT coordination while maintaining each teacher's individual voice and personal flair.

Let's assume you're onboard with the idea that PLTs need to have a few common assignments that have common assessments in order to gauge the PLT's progress and effectiveness (if not, check out part 1).

Now how do we do this? I closed part 1 by sharing how much I hate common assessments because they are never in my voice and seem like an alien or foreign presence in my classroom. Education reformers would be wise to note that jarring students out of the environment they're used to isn't the best way to assess the effectiveness of that environment!

Producing uniform PLT assessment data seems incompatible with preserving the unique flair and character of each teacher's classroom.

EssayTagger provides a way around that conundrum.


Shared rubrics
Rubrics are at the heart of how teachers assess written work in EssayTagger. And they are EssayTagger's secret weapon to solving the problem at hand.

Have your PLT agree upon a shared assignment. Let's say all of the Sophomore English teachers will be teaching "The Tempest". We can agree upon a few key goals for our Tempest unit and develop a summative essay assignment for the end of the unit.


Collaborate on the rubric
Now have one teacher log into her EssayTagger account (or jump to our free Common Core Rubric Creation Tool) while the PLT discusses what they'd like to see in the rubric for this shared assignment. Consider the PLT's goals for the unit and begin building the rubric in EssayTagger. Again, we only need one transcriber to create the rubric.

Using EssayTagger to coordinate PLT assessments, pt1

It's becoming more and more important to coordinate curriculum and assessment within PLT teacher teams. In part one we'll briefly discuss PLTs, motivate why coordination is so important, and discuss some of the challenges. Part two will discuss how to use EssayTagger to enhance that PLT coordination without stifling teachers' individual voices and strengths. Part three will look at how the resulting data can help each individual teacher and the PLT as a whole.

Part 1: PLTs must have common assignments and common assessments

Part 2: How to coordinate PLTs with EssayTagger

Part 3: Analyzing the data reports (coming soon)

PLTs are in
Most schools seem to be moving toward the PLT--Professional Learning Team--model where, for example, all of the Sophomore English teachers would meet regularly, plan team goals, share resources and exercises, and hopefully develop a few common assignments and assessments.

However, I've been in schools that still operated with each teacher as his or her own island. In this sort of environment the PLT concept will likely be met with significant resistance. There will always be the I've-been-doing-it-my-way-for-35-years holdouts but even the most progressive-thinking teachers will worry about the constricting nature of making their classes more uniform and perhaps less unique.

On the flip side, I've been in schools that had weak or ineffective PLTs, despite significant administrator emphasis on them. Simply meeting every other week is not enough. We would talk about what each of us were doing, but there'd be no central focus or plan. It has to be more than just check-in-and-share time.

Sadly, teacher prep programs aren't taking a lead on this. I'm disappointed that my M.Ed. program didn't train us to collaborate with our peers. PLTs weren't even mentioned once during my two year program. We're supposed to be the new guard, the fresh blood bringing a modern approach to education. But too many Schools of Education are themselves stuck in old-guard or outdated modes of thinking and practices.

So I feel like I have a pretty strong grasp of many of the challenges and pitfalls when it comes to PLTs. And it's no surprise that transitioning to a team approach can often be a difficult process when a culture of collaboration or direct experience with PLTs is lacking. But as you'll see in part two, there is hope. Incremental change and increased coordination is possible and can be facilitated by some 21st-century technology.


Coordination is king
A PLT has to have a set of common goals for their class sections. If a PLT doesn't have a common vision for student outcomes, you don't really have a PLT; you just have a bunch of individual teachers sitting in the same room. Common goals matter. My Sophomore English students have to be just as prepared to enter their Junior English class as the students from any other Sophomore English section. And the Junior English teachers should have a reliable set of expectations for what they'll get from their incoming juniors each year.

But just setting common goals isn't enough. We need to know if those goals are being met. Did our sophomores really get to where we wanted to get them? And how did my specific crop of sophomores do vis-à-vis the rest of the PLT's students? Did my kids see particular gains or struggles versus their peers? This isn't about outing a bad teacher or competing against my teammates. It's about being able to identify what is and is not working in my class and across all of our classes.

Latest Update: Downloadable results data!

As part of our push for new and improved data reporting, you can now download all of your results/grading data for each of your assignments. This feature is fully reverse-compatible with all existing assignments.

We don't believe in vendor lock-in so we're happy and excited to offer yet another way for you to access your results data. It's your data; it shouldn't be trapped on our servers.

What's in the download?

All of the data in the chart shown below will be included in the data download as well as a few extra fields. Here's the full list:

Using EssayTagger to level expectations within teacher teams

Teacher teams should have a common vision for what "success" means for their students. EssayTagger collects and analyzes a ton of data which can be used to create consistent expectations across the teacher team.

Whenever you grade an assignment in EssayTagger you end up with an assortment of data reports that provide a deeper insight into how your students performed, based on your evaluations.

That's all well and good, but what is the relevance to teachers operating in a team-based approach? What does the rest of the Sophomore English team care about the results from my two Soph Eng sections?


At a minimum, compare results and discuss
Maybe I find that my sections are doing reasonably well on Thesis but are still developing their skills with Counterclaims. Are the other Soph Eng teachers seeing the same thing with their students?

If so, we can talk about strategies to improve their work with addressing the opposing viewpoint.

Or perhaps we'll find that my Thesis results look stronger than the other teachers' results. Now things get interesting. Am I doing something awesome that's really working with my kids or am I just grading their theses too generously?

Latest Update: New data reports!

With EssayTagger's core platform in place, it's time to turn our attention to the incredibly rich data that is generated when you grade your essays in our system.

UPDATE 11/3:
We've already updated the charts quite a bit and have updated this post to reflect the changes!

UPDATE 11/29:
Even more improvements and two new charts! Post updated again.

UPDATE 11/30:
You can now download your grading data to Excel!

We've reached the first milestone of our major push to enhance and extend the data reporting features of the site. Today's release opens the first new data reports on a beta test basis. "Beta" in programmer lingo means it's not yet finalized, but is mostly where it needs to be. There will likely be further refinements based on instructors' feedback as well as minor bugs to be fixed.


Quick highlights

• "Section snapshot" overall section-wide aggregate performance graph
• "Section details" chart of all students' performance on each rubric element
• "Individual details" in-depth view of a particular student's performance on the assignment
• Statistically-significant outlier identification to help you focus on the students who are furthest from the pack.

All of these data reports are amazingly useful tools for teachers, but I'm particularly excited about the statistical analysis we're able to provide. You don't have to know the first thing about stats, standard deviation, or z-values; we're computing everything for you and flagging the kids that need your attention the most!

You grade, we crunch the numbers. How awesome is that?!

(see the demo video here: http://youtu.be/WZsEoAJEkv0)


"Section snapshot" overall results
This is the new default view; you'll be routed here automatically when you click "exit grading app" when you're done grading. It's the broadest view of the data and includes two charts. The goal is to provide a rough "snapshot" look at how your class section performed as a whole on the essays graded thus far:

The stacked column graph displays how many of your students fell into which quality levels when you evaluated their essays in the grading app.

Put simply: the more green, the better.

Latest Update: Common Core progression-tracking!

Grades and GPAs are just rough estimates. It's more important to keep track of which skills your students have mastered. That's where Common Core-aligned progression tracking comes in. It's a big deal.

Most of us have had this skeptical suspicion: Am I aligning my curriculum to Common Core just because some bureaucrats said I have to?

If that were all that was behind Common Core, then it would absolutely be a waste of our time.

But curriculum alignment is just stage 1. Here's the full picture:

1. Align curriculum to Common Core
2. Assess within Common Core
3. Report and track student data within Common Core
4. Develop and share remediation strategies tied to Common Core

Only at this high-level view does it all start to come together. The overarching goal is to enable apples-to-apples comparisons that can then be used to drive stage 4 where every teacher in America is creating interchangeable exercises and materials.

Let's be more concrete. EssayTagger is focused on stages 1-3, culminating in our Common Core-aligned progression tracking that was just released: