Discussing: "The Death of Math" by Gary Rubenstein

Rubenstein bemoans testing culture's effect on Math education and suggests a better way forward. I feel his pain but think he's only half-right.

Gary Rubenstein in his "The Death of math" blog post is spot-on about the short-sighted nature of de-prioritizing away from vital skills like geometric proofs as a result of standardized testing pressures. Proofs are geometry and are by far the most valuable aspect of it. And it ain't about the math, it's about the way of thinking that geometry proofs cultivate (yes, I'm an English teacher that has come to love "ain't"--deal with it!).

But Rubenstein is a bit behind the times in the Khan Academy era. Sal Khan, my former boss and co-worker (a fact that I will brag about until the end of eternity), has worked out a better solution to a lot of the issues that Rubenstein tries to solve.

Where we're headed: school-wide data unification

EssayTagger was initially developed as a tool to help individual teachers. Now we're taking aim at unifying all writing assessment data across an entire school or district. Here's why this is valuable and here's how we'll do it.

The problem: Disparate writing assessments
In a typical school there's a wide array of teachers who assess writing throughout the year. And with the increasing emphasis on "reading and writing across the curriculum," those numbers are growing. English and Social Studies teachers are busy as ever grading essays, but now there are Math teachers who are assigning reflection paragraphs. PE teachers are assigning sportsmanship essays.

Unfortunately writing assessments are almost always isolated within the confines of each individual classroom. The History teacher knows that his students are struggling with using evidence in their writing, but he has no idea that his students' English teacher is frustrated with the same problem. There simply aren't any lines of communication across departments to share this information and collaborate on a solution.

But the worst offenders are the district writing assessments. Many schools will do a school-wide writing assessment that is scored on a standardized rubric which is then coded into a database so that administrators can pore over the results. These district writing assessments exist outside of the normal curriculum (e.g. in the middle of the Huck Finn unit the sophomores will be asked to write about texting while driving). Worse, the students rarely ever see the results and almost never receive any feedback. They're writing into a black hole. And, oddly enough, teachers often don't even see the results. They might see some bullet points on an institute day slideshow or get the data second-hand from their department head.

Disparate writing assessments are pure silliness.


Writing--and assessing--across the curriculum
We've bought into the value of writing across the curriculum and now it's time to unify assessment data across the curriculum.

Every writing assessment tells us more about each student and our school's overall trends. Assessment data shouldn't be cloistered within the walls of each classroom, but rather should be contributing to a rich web of highly interconnected data. This is the "web-ification" of the school structure; teachers need to think of themselves as part of a network instead of individual sovereign islands.

When Bobby's English teacher grades his essay, his History teacher should be able to see the results down to each individual skill being assessed. The district writing assessments should add to this pool of information and provide more insight to all of Bobby's teachers. The Culinary Arts teacher should know what strengths and weaknesses to expect when she assigns a research paper on launching your own restaurant. The school's writing center or peer tutors could benefit from a detailed skills profile for  each student that comes for help.

Using EssayTagger to coordinate PLT assessments, pt2

Part 1: PLTs must have common assignments and common assessments
Part 2: How to coordinate PLTs with EssayTagger
Part 3: Analyzing the data reports (coming soon)

In part two we show you a simple way to increase PLT coordination while maintaining each teacher's individual voice and personal flair.

Let's assume you're onboard with the idea that PLTs need to have a few common assignments that have common assessments in order to gauge the PLT's progress and effectiveness (if not, check out part 1).

Now how do we do this? I closed part 1 by sharing how much I hate common assessments because they are never in my voice and seem like an alien or foreign presence in my classroom. Education reformers would be wise to note that jarring students out of the environment they're used to isn't the best way to assess the effectiveness of that environment!

Producing uniform PLT assessment data seems incompatible with preserving the unique flair and character of each teacher's classroom.

EssayTagger provides a way around that conundrum.


Shared rubrics
Rubrics are at the heart of how teachers assess written work in EssayTagger. And they are EssayTagger's secret weapon to solving the problem at hand.

Have your PLT agree upon a shared assignment. Let's say all of the Sophomore English teachers will be teaching "The Tempest". We can agree upon a few key goals for our Tempest unit and develop a summative essay assignment for the end of the unit.


Collaborate on the rubric
Now have one teacher log into her EssayTagger account (or jump to our free Common Core Rubric Creation Tool) while the PLT discusses what they'd like to see in the rubric for this shared assignment. Consider the PLT's goals for the unit and begin building the rubric in EssayTagger. Again, we only need one transcriber to create the rubric.

Using EssayTagger to coordinate PLT assessments, pt1

It's becoming more and more important to coordinate curriculum and assessment within PLT teacher teams. In part one we'll briefly discuss PLTs, motivate why coordination is so important, and discuss some of the challenges. Part two will discuss how to use EssayTagger to enhance that PLT coordination without stifling teachers' individual voices and strengths. Part three will look at how the resulting data can help each individual teacher and the PLT as a whole.

Part 1: PLTs must have common assignments and common assessments

Part 2: How to coordinate PLTs with EssayTagger

Part 3: Analyzing the data reports (coming soon)

PLTs are in
Most schools seem to be moving toward the PLT--Professional Learning Team--model where, for example, all of the Sophomore English teachers would meet regularly, plan team goals, share resources and exercises, and hopefully develop a few common assignments and assessments.

However, I've been in schools that still operated with each teacher as his or her own island. In this sort of environment the PLT concept will likely be met with significant resistance. There will always be the I've-been-doing-it-my-way-for-35-years holdouts but even the most progressive-thinking teachers will worry about the constricting nature of making their classes more uniform and perhaps less unique.

On the flip side, I've been in schools that had weak or ineffective PLTs, despite significant administrator emphasis on them. Simply meeting every other week is not enough. We would talk about what each of us were doing, but there'd be no central focus or plan. It has to be more than just check-in-and-share time.

Sadly, teacher prep programs aren't taking a lead on this. I'm disappointed that my M.Ed. program didn't train us to collaborate with our peers. PLTs weren't even mentioned once during my two year program. We're supposed to be the new guard, the fresh blood bringing a modern approach to education. But too many Schools of Education are themselves stuck in old-guard or outdated modes of thinking and practices.

So I feel like I have a pretty strong grasp of many of the challenges and pitfalls when it comes to PLTs. And it's no surprise that transitioning to a team approach can often be a difficult process when a culture of collaboration or direct experience with PLTs is lacking. But as you'll see in part two, there is hope. Incremental change and increased coordination is possible and can be facilitated by some 21st-century technology.


Coordination is king
A PLT has to have a set of common goals for their class sections. If a PLT doesn't have a common vision for student outcomes, you don't really have a PLT; you just have a bunch of individual teachers sitting in the same room. Common goals matter. My Sophomore English students have to be just as prepared to enter their Junior English class as the students from any other Sophomore English section. And the Junior English teachers should have a reliable set of expectations for what they'll get from their incoming juniors each year.

But just setting common goals isn't enough. We need to know if those goals are being met. Did our sophomores really get to where we wanted to get them? And how did my specific crop of sophomores do vis-à-vis the rest of the PLT's students? Did my kids see particular gains or struggles versus their peers? This isn't about outing a bad teacher or competing against my teammates. It's about being able to identify what is and is not working in my class and across all of our classes.

Using EssayTagger for fast formative assessment, pt2

In part two we explore a method for fast, effective formative assessment by leveraging EssayTagger's strengths and incredible built-in data reporting.

Part one: Primer on formative assessment

Part two: Fast, effective formative assessment with EssayTagger

"If students receive feedback often and regularly, it enables better monitoring and self‐regulation of progress by students."

- Nicol and Macfarlane-Dick

At face value EssayTagger's core function--grading essays more efficiently--seems more well-suited to end-of-unit essay evaluation (summative assessments). But as you'll see we can easily leverage EssayTagger's strengths to hit all three formative assessment keys discussed in part one: speed, detailed diagnostics, and quality feedback.


Basic approach
Develop open-ended, journal-style written response questions aligned with unit goals and then evaluate students' work in EssayTagger, focusing on short, targeted feedback. Then review the evaluation results data to refine class-wide instruction and target individual reinforcement or remediation. Ideally you would repeat 2-3 times throughout the unit before the end-of-unit summative assessment.

A concrete example: The Tempest, Sophomore English

When studying Shakespeare with sophomores we need to work on the mechanical skill of processing the complex text and would like to see the students develop an engagement with the text at an emotional, human level. A final summative assessment might come in the form of an essay prompt like, "Do Prospero's ends justify his means?"which would require a detailed understanding of the text and characters along with an expectation of referencing appropriate textual evidence.

Using EssayTagger for fast formative assessment, pt1

In part one we'll quickly review what formative assessment is and some of its key characteristics. Then we'll learn how to use EssayTagger for fast, effective formative assessment.

"The giving of marks and the grading function are overemphasized, while the giving of useful advice and the learning function are underemphasized."  

- Black, Paul, and Wiliam

Buzzword primer
I often get lost in the absurd world of edu-speak lingo. So before we even start, let's define our two key terms:

Formative assessment is an approach where the teacher "build[s] in many opportunities to assess how students are learning and then use[s] this information to make beneficial changes in instruction" (Boston). Formative assessments happen during a unit, within the flow of instruction. It's about quickly diagnosing problems and adjusting what you're doing tomorrow to produce better results before the unit ends.

Summative assessment "generally takes place after a period of instruction and requires making a judgment about the learning that has occurred (e.g., by grading or scoring a test or paper)" (Boston). You could also call this "Final assessment"--it's looking to measure the end result of instruction.

The two can be boiled down to: "where are we struggling?" (formative assessment) vs. "how did we do?" (summative assessment). Or, if you prefer a more colorful analogy: "what's the patient's temperature" vs "how many patients survived?"


Formative Assessment Key #1: Speed
If your goal is to modify instruction tomorrow, clearly your formative assessments need to be fast. It would be absurd for a nurse to take a patient's temperature and then have to wait a week for the results.

Formative Assessment Key #2: Detailed diagnostics
One of the key principles behind formative assessment is that it "provides information to teachers that can be used to help shape teaching" (Nicol and Macfarlane-Dick). In this sense they are diagnostic, identifying the areas where students are struggling. The more detail it can provide--exactly who is struggling in which areas--the better, but this generally slams up against the need for speed. It's very difficult to do quick formative assessments that are highly detailed and still allow the teacher to have a life.

Formative Assessment Key #3: Quality feedback
While the first two keys were teacher-centric, this one is student-centric. Part of what powers formative assessment's effectiveness is the targeted feedback provided to each individual student. It's not enough to merely see where course corrections are needed; each student must be explicitly steered in that direction.

Ug, how can we solve anything if we confuse correlation with causation?

The headline reads: "School Absences Translate to Lower Test Scores, Study Says".

If you ain't in school, ya ain't gonna learn. That's obvious. But this article from Sarah D. Sparks implies causation--that missing school causes the lower test scores. Sparks argues that "The analysis contributes to mounting evidence that absenteeism puts students at greater risk of poor academic achievement and eventually dropping out of high school."

If it's true that absenteeism is a causal factor, the solution is very simple: make sure those kids get to school every day. So let's push for more government grant money to hire a whole army of truancy officers!

However, let's remember:

Any teacher will tell you that missing school is bad, but what really matters is why those kids are missing school. Correlations can be interesting but identifying causation is how you solve problems.

Using EssayTagger to level expectations within teacher teams

Teacher teams should have a common vision for what "success" means for their students. EssayTagger collects and analyzes a ton of data which can be used to create consistent expectations across the teacher team.

Whenever you grade an assignment in EssayTagger you end up with an assortment of data reports that provide a deeper insight into how your students performed, based on your evaluations.

That's all well and good, but what is the relevance to teachers operating in a team-based approach? What does the rest of the Sophomore English team care about the results from my two Soph Eng sections?


At a minimum, compare results and discuss
Maybe I find that my sections are doing reasonably well on Thesis but are still developing their skills with Counterclaims. Are the other Soph Eng teachers seeing the same thing with their students?

If so, we can talk about strategies to improve their work with addressing the opposing viewpoint.

Or perhaps we'll find that my Thesis results look stronger than the other teachers' results. Now things get interesting. Am I doing something awesome that's really working with my kids or am I just grading their theses too generously?

Announcing: Free Common Core Rubric Creation Tool!

We're super-proud to announce the release of our new tool that helps teachers create Common Core-aligned rubrics! Open to the public, totally free.

EssayTagger's Common Core Rubric Creation Tool

http://www.essaytagger.com/commoncore

You are ahead of the curve and are working hard to align your curriculum to Common Core. But assessing and tracking your students' progress within Common Core is difficult -- and nigh impossible to do for essays.

I spent the whole dang summer wrestling with the standards, trying to figure out how to incorporate them into real-world, practical writing rubrics.

My initial approach was to try to coax the actual text of the standards into a more rubric-friendly format. But teachers shouldn't have to waste their time adapting the W.8.1a text just to be able to include "Thesis" on their rubrics.

Instead just evaluate "Thesis" like you normally would but add, "Oh, and by the way, 'Thesis' is part of W.8.1a." This is where the tool comes in to help you.

On teacher accountability, pt1: The trouble with bad data

In Part 1 I lay out the case against teacher accountability measures via "value-added" analysis of standardized test score data. In part 2 I offer practical compromises.

Here in the Chicagoland area we are in the fourth day of the Chicago Teachers Union (CTU) strike that is making national headlines.

I did my Master of Education and teacher certification program at the University of Illinois-Chicago. Not surprisingly, a lot of my former classmates are current Chicago Public School (CPS) teachers. I spoke with them last night as they returned from a day out on the picket lines.

They made it clear that this was about fighting a flawed teacher evaluation system that puts undo emphasis on their students' standardized test scores. They also have serious concerns about the push to privatize the public school system. Then are the more tangible things they're fighting for like reduced class sizes (raise your hand if you think 38 teenagers in one room can be productive at anything).

The media and the average Joe on the street think this is about money or benefits or the teachers stubbornly refusing any form of accountability. This is incorrect.


Let's talk about accountability. It's important.
Accountability matters. Teachers should be held to high standards and should be judged by the quality of their work.

Understand that teachers aren't fighting accountability; they're fighting a particular form of accountability that is of dubious value and may indeed be deeply flawed.

On teacher accountability, pt2: Possible compromises

In part 1 I laid out the case against the current method of teacher accountability via value-added analysis. Here I offer what I think are reasonable compromises.

This focus on quantifiable standardized test scores is not going to go away. Some form of accountability linked to test scores is unavoidable. Period. I leave it to the statisticians to refine the analysis and reduce that 53% margin of error.

But here are some practical solutions to incorporate this data while controlling for its flaws:

Making Common Core work, pt2: The big picture

Teachers and administrators need to understand the big picture of where Common Core is headed. Here's your quick preview.

The long view

At a surface level the Common Core standards specify what students should know or be able to do. We're focused on how to integrate that into our classrooms. That part is straightforward and obvious.

But the big picture is much bigger than this. 

Establishing a common set of target skills is just step one. The Common Core standards are not a goal unto themselves but merely a means to an end. The real goals lay beyond. One of the major ones, not surprisingly, is all about data.

Knowing a student's GPA doesn't convey enough information. Knowing that she got a B- in Sophomore English isn't enough. But knowing that she's struggling with W.9-10.1d is useful.

The standards create a common reference point for learning targets that are otherwise ad hoc, disorganized, or nonexistent. Forget leaving notes to next year's teachers that "Johnny is weak on fractions" or that "Sarah struggles with citations." That world is coming to an end. Too much information is lost that way, too much time is wasted on reassessing students' abilities at the beginning of each year.

Instead teachers will have standardized reporting tools that use the Common Core framework to track a student's entire educational record on a skill-by-skill progression level. 

Common Core isn't just about what to teach, it's about tracking what has been learned.

Making Common Core work, pt1: Why it's awkward

Forget "aligning" with Common Core; how the heck do you even begin to use Common Core?!

This multi-part series will explore some possibilities for making Common Core relevant and actually useful in real-world classrooms.

I've been engaged in a number of great discussions lately about how best to incorporate the Common Core English/Language Arts (CC ELA) standards into the classroom. My vision for how to work with these standards is evolving quickly and I wanted to share my thoughts to stimulate further discussions.

And very soon I will be implementing some form of Common Core integration with EssayTagger. I'd rather have the idea be well-thrashed out before I build a half-baked solution.

But first we have to understand the Common Core ELA beast for what it is.


Basic tensions
Common Core is inevitable. It'll be on us faster than any of us are ready for and we best get prepared ASAP. Gripe and moan and cry all you want, it ain't gonna change a thing.

Worse: The language of the Common Core standards is not classroom-friendly or, more accurately, it is not student-friendly.

Worse(er) (hee hee! Relax!): The Common Core standards are not directly compatible with how we classroom teachers work with our students and provide feedback.

This all being said, the Common Core ELA standards are not bad. They are actually quite reasonable. They're just not a great fit; the administrators' standards-based data-tracking world does not align smoothly with classroom reality. Shocker.


Common Core - A closer look
Let's stop talking and dive in.

New Rubric: Common Core Explanatory / Informative Writing (9-10) rubric

The first of many rubrics distilled from the Common Core State Standards.

Update 9/21/12:
In the six months since this post was originally published, my view of how to integrate with Common Core has evolved a considerable amount. This post is now old news. I've built a free, publicly-accessible tool to help teachers create their own customized Common Core-aligned rubrics. It's going to make life SO much easier for all of us!

Read about this new approach or jump straight to the EssayTagger Common Core Rubric Creation Tool

Check it out and let me know what you think!


Original Post:
The Common Core State Standards. Oof.

You've heard all the talk. You suspect they might get in your way and make your life a living hell. Just thinking about them makes you want to curl up on the couch in the fetal position and take a nap (my default reaction to moderately stressful things).

I'm not here to sell you on its merits or argue that there is a lack thereof. I'm here to make your life a little bit easier when you find yourself held accountable to the Common Core standards when teaching writing.

New Rubric: "They Say, I Say"

One of our first demo rubrics is now available for anyone to use in their own EssayTagger assignments!

Gerald Graff was one of my professors at the University of Illinois at Chicago during my M.Ed. program. And, I'll be honest, I was very wary of "They Say, I Say" when he first explained the concept of the book to my class. But TSIS quickly won me over. And the skyrocketing sales that he and his wife/co-writer have enjoyed certainly show that others appreciate its value as well.

But there was one thing I noticed -- the book does not address assessment. I love the guidance it offers for teaching composition and the structure it gives to developing writers, but I felt like there was a missing final chapter on how to evaluate the resulting TSIS-style essays.

So I began developing a TSIS-style rubric that would work within the EssayTagger system. I met with Prof. Graff to show him an early draft and his eyes lit up with enthusiasm.

Now that I've completed EssayTagger's rubric sharing and import features, I can post the rubric for anyone to use:

EssayTagger "They Say, I Say" rubric:

http://www.essaytagger.com/rubric?code=AA-TSIS

This rubric is listed as a "work-in-progress" because, well, it is. But it's a pretty dang good start. And keep in mind that any rubric shared on EssayTagger is meant to be a starting point. Teachers should alter and customize these rubrics however they see fit.

Let me know what you think!

New Rubric: Four-Strand/Four-Level

From what I'm told, the Four-Strand/Four-Level rubric is fairly common in Washington schools. I've adapted it for use in EssayTagger (you can import it straight into your own assignments!) but you'll still want to customize it to suit your needs.

EssayTagger version of the Four-Strand/Four-Level rubric:

http://www.essaytagger.com/rubric?code=CW-MEHZ

And as I've said previously, because rubrics are so macroscopic, they inevitably undergo some changes when they are adapted for the much more fine-grained world of EssayTagger.

Changing how we think about rubrics

Traditional rubrics are too general and macroscopic to help students. The future is specificity. And it's here.

Sharing rubrics is a simple, but important, way for teachers to collaborate.

Unfortunately, traditional rubrics -- by their nature -- can only address general, overall trends in a paper: "Some evidence was insufficient." That's fine for a quick, high-level diagnostic, but it's not very helpful for the student.

My goal when I'm grading papers is to coach the students so they can learn from their mistakes and do better next time. Traditional rubrics are good for setting expectations before the attempt, but once the essays are graded, they're really just an assessment tool. They're not a learning tool.

In order to improve, students need more fine-grained feedback: Which specific piece of evidence was weak? Why wasn't it compelling?

Traditional rubrics simply can't address these questions (nor, to be fair, were they meant to). Traditional rubrics are macroscopic. But students need the microscopic.

Accountability and Incentives: A Cautionary Tale, pt1

Introduction

I understand the rationale behind the push for ever-increasing teacher accountability -- it's natural to want to insure that your kids are getting the quality education they deserve. Teachers can't just sit back and say, "Trust me, I know what I'm doing." Those days are over. Fair enough.

But we teachers need the rest of the country to understand that when we push back against how teacher accountability is being implemented, we are not just scurrying around trying to hide our incompetence or protect our "cushy" jobs.

We can handle the scrutiny. Most of us would be eager to let our students' successes serve as evidence of our effectiveness as educators. I don't think we fear accountability -- if that accountability is implemented properly, if success is defined properly.

It's not about rigging the game in our favor, lowering the bar, or any of that nonsense; it's about making sure that we're judged for the things that really matter, the things that we teachers do that actually improve students' lives.

The American public needs to realize that not all forms of teacher accountability are created equal. Worse, the most popular methods can be misleading or downright detrimental. Even "no-brainer" approaches like rewarding "effective" teachers with bonuses have already ended in failure. Just because greed-maximizing incentives (sort of) work for capitalism doesn't mean they work for education.

However, hearing these arguments and really feeling them are two different things. And somehow teachers have been turned into the enemy -- or at least that's how it feels to us -- to the point where no one seems much interested in listening to the people who have the most expertise on the subject.

But I think the power of satire and absurdity has a chance to get the message across. So, in that vein, I offer you:

Demo now available!

I haven't had much time time to post here because we're hitting crunch time as we get close to our launch date. But we do have a big announcement: You can now try out our innovative essay grading tool for yourself!

The demo is available from our homepage at:

www.essaytagger.com

The demo is fully-functioning. The only limitation is that it is preloaded with two fake assignments (normally you would customize the assignments and rubrics yourself).

The demo loads with a basic five-paragraph essay rubric. It's not the most exciting thing ever, but it uses the language that teachers and writing instructors are most used to seeing.

What's more exciting is that the demo also has the option to load our "They Say / I Say" rubric. I've been working with Gerald Graff on the early stages of this rubric that is a companion to the blockbuster composition book by Graff and his wife, Cathy Birkenstein. We're really excited about continuing the work on the "They Say / I Say" rubric and sharing it with the book's huge following.

The site will launch with a small library of rubrics, including the "They Say / I Say" rubric, that you can take and customize however you like. I'm working with other teachers to develop rubrics for AP English Language, AP Literature, and others. You'll always be able to create your own rubrics from scratch if you prefer; these pre-made rubrics are just to give you a head-start if you want it!

Check out the demo and let me know what you think!

Betting on the future, pt 1: Career guidance is more valuable than Huck Finn

In this two-part post I'll argue for why it isn't sufficient to just prepare kids for college. We also must guide them toward careers that have some hope of surviving and thriving in the 21st-century.

When my seniors wrapped up their college application essays I figured it would be a good time to talk to them about the realities of 21st-century careers. Which careers will survive? Which will die out in the next 10-15 years? Not the typical lesson plan for an English teacher, but most English teachers don't have nine years of experience in high-tech startups.

To get their thought processes started I argued that pharmacists won't survive. Awkwardly, a number of my students were planning on pursuing pharmacy in college. They were not pleased.