Header text

EssayTagger is a web-based tool to help teachers grade essays faster.
But it is not an auto-grader.

This blog will cover EssayTagger's latest feature updates as well as musings on
education, policy, innovation, and preserving teachers' sanity.
Showing posts with label latest update. Show all posts
Showing posts with label latest update. Show all posts

Tuesday, October 1, 2013

K-5 Common Core standards in-progress!

EssayTagger's free Common Core Rubric Creation Tool has been very well received by teachers. But I initially only adapted the 6-12 standards. I'm finally gearing up for K-5!


Our free Common Core Rubric Creation Tool is quite popular. It's been used to create over 7,500 Common Core-aligned rubrics in just its first year! And easily half of our customer support emails are from people who want us to incorporate the K-5 standards.

Well, I hear you and I am working on it!! Check out the work-in-progress.


Want to help? 
I'd love some collaborators! This is difficult! Use the support widget on the website, respond in the comments below, or find me on Twitter (@KeithMukai) if you want to contribute!


Some background
For those of you that don't know, the innovative aspect of the tool is that it breaks down each standard into its assessable sub-components:




This solves the problem that teachers face when they look at the standards; the dang things are just too vague, cover too much ground, or just aren't assessable.

It was also a crap-ton of work for me! Those assessable sub-components aren't part of the official CCSS specification; I had to stare at each standard and find a concise way to translate the standard into its assessable sub-components. That's not easy. And I'm not necessarily going to get everything right.

So I also made the tool flexible so that if you don't like my terminology or the way I've done it, you can edit the labels or even add totally new subcomponents as you see fit.



You then end up with a rubric grid that you can further customize, add additional CCSS-aligned rubric elements, add non-CCSS-aligned rubric elements (e.g. "Class Citizenship" or anything else not captured by the CCSS). You can also add performance descriptors (the traditional rubric text we're used to seeing) in each grid cell. You can share your rubric online (post a link, Twitter, email, etc), print it, or download it as an Excel CSV file.




And, of course, since this tool is part of EssayTagger, you can apply your rubric to an EssayTagger assignment and produce Common Core-aligned results data as you grade!



The Common Core Rubric Creation Tool is free for anyone to try and there's no registration or sign in required.

That being said, I certainly would not be disappointed if you decided to go deeper into the EssayTagger world and create a free trial account in order to see what life is like when you grade essays in our system. And as I always have to point out: EssayTagger is NOT an auto-grader. You make all the evaluations, you provide all the feedback. We just make it easier and more efficient for you to do so!

Wednesday, May 1, 2013

Latest update: "Evaluation-only" mode - just in time for finals!

EssayTagger is all about helping teachers provide targeted feedback that will promote student growth. But mid-stream fast formative assessments or end-of-unit summative assessments don't always require extensive feedback. Now EssayTagger supports both "Evaluation + Feedback" and "Evaluation-only" assessment modes to support those situations.


First, the lingo
It's taken me a while to wrap my brain around the following two terms, so let's review them just to be sure we're all on the same page:

Formative Assessment is a kind of check in with your students in the middle of a unit to see where they're at, see where they're struggling. The goal is to then use this information to make on-the-fly adjustments to your plans and instruction to help the students reach the goals you've set out for them. Formative assessments should be fast, simple, and low-stakes or zero-stakes (i.e. not for points). And they have to come early enough so that there's still time left to adjust course as needed. If you just want to quickly "take the pulse" of the room, there's no need for extensive feedback comments.

Summative Assessment is the end measurement point. Did they reach the goal? How many of the target skills can they actually demonstrate now that the unit is complete? Because summative assessments come at the end of the learning process, providing feedback or further coaching at this point is somewhat pointless. When students hand in a final essay at the end of the school year are they really going to absorb your extensive comments as they start their summer vacation? Shyeah, right!


EssayTagger's default mode: "Evaluation + Feedback"
Our primary emphasis on feedback comments places us outside of the world of fast formative assessment and summative assessment. In this mode instructors select a feedback comment from the appropriate quality column or add new reusable comments as needed:



Extensive feedback makes sense when a further draft is expected and students have a chance to incorporate or address your comments. Ideally all writing assignments would have a write-review-rewrite cycle built into the schedule.


The new "Evaluation-only" mode
With today's new release, instructors can opt to configure an assignment to focus solely on evaluation.

Drag-and-drop the rubric element like you normally would. In this example, we are dragging the "Thesis" button to identify the essay's thesis:



But now when the "Thesis" evaluation options pop up, we see that there is only a single choice for each quality level:


Tuesday, March 5, 2013

Latest Update: Administrator Report emails

A simple new convenience feature driven by teacher feedback from my friends at El Camino Real Charter High School out in sunny southern California.


El Camino is embarking on an ambitious effort to coordinate classroom expectations across all teachers. Such an effort requires a bit of a culture shift--your classroom is no longer an isolated private island--as well as some technology support to ease the logistics of so much collaboration and sharing.

Specifically, they needed to be able to share their graded essays with their administrators and other teachers in the school. The interim solution was to print hard copies (ack, no!!!) or manually copy-and-paste the hyperlink to each student's graded work.

In order to support their efforts (which are perfectly aligned with my own philosophy of enhancing school-wide collaboration through data unification), we added a simple Administrator Report feature which emails a list of each student's results and provides a link to their graded essay:

Administrator Report email (fake test data for demonstration purposes)

Thursday, February 28, 2013

Latest update: Support for iPad Pages documents!

Getting any file off of an iPad and out into the world can be a challenge, but Pages makes life more difficult because it uses a unique document format that is not very compatible with other programs. We've been able to overcome both obstacles. Here's how.


Apple's Pages word processor iPad app does make it easy to create some really nice-looking documents. But my praise for Pages stops there because it's such a pain to deal with Pages documents. What good is a beautiful word processor if you can't do anything with the resulting documents?!

Thanks to our just-released Google apps and Google Drive account integration, we can now get Pages documents off of students' iPads and submit them directly to EssayTagger.


Step-by-step instructions
First you'll need to enable Google integration for your course. Instructions can be found here. Your students will also need Pages (obviously) and the Google Drive app.



The Google Drive app works with Pages to export your document into a Word DOC file and then upload it to your Drive account. This conversion and upload to Drive is the key to this process.

Here's the test essay I'll be working with:

Sunday, February 24, 2013

How to enable Google integration in EssayTagger

Student sign-in via Google apps accounts and Google Drive integration were released today as "beta" features that are ready for broader, real-world testing. If you'd like to try it out with your students, follow these simple instructions.


Google integration has passed all of our internal testing, but there's nothing like hordes of actual students to find the flaws or weak points in any new feature.

We'd love your help to test it out. I'd suggest trying it out on a small, mostly inconsequential assignment. Something like a one-paragraph journal entry or a short reflection on the day's reading would be ideal. That way if any students do run into problems signing in or linking their Drive accounts, it's not the end of the world.


Enabling Google integration
Google integration is configured at the course level. Log in to your EssayTagger account and scroll to the bottom of the Instructor Home screen to see your list of courses. Click on the "edit" link next to the desired course.


Latest update: Google apps and Drive integration is here!!

Today's major new release enables student sign-in via Google apps accounts and integration with Google Drive!


Just about every school I talk to has jumped onto the Google apps bandwagon. It's really a no-brainer. It is the best platform on the planet and it's free for schools. Insane.

I'm super-excited to announce that as of today students will be able to sign in to EssayTagger using their Google apps accounts.



Google sign-in simplifies the process for both students and teachers while increasing reliability and security. This is already a huge win, but there's more!


Google account sign-in opens the door to integrating with Google Drive. Now students can link their Drive account and pull their assignments directly out of Drive:


Wednesday, January 30, 2013

Yes!! EssayTagger on your iPad!

EssayTagger's patent pending interactive grading app is built in Flash and works great in any web browser. However, Steve Jobs decided years ago that Apple would not to support Flash on iOS devices (iPad, iPhone). I've experimented with a special version of our grading app that can work as an installed iPad app, but it's a long way from being ready to put in the iTunes app store. I figured iPad support would just have to wait.

But then Alaina Langdahl of Parkrose High School in Portland, OR suggested we take a look at a few iPad web browser apps that serve as an alternative browser to the built-in Safari browser and, most importantly, they support Flash!

I'm ecstatic to announce that the Photon browser does a surprisingly good job of bringing the EssayTagger grading app to life on an iPad!


Holy awesomeness!!!

Drag-and-drop interactive grading on a tablet! This is exactly how I imagined using EssayTagger when I first started this company!

All grading app features are fully supported when used through the Photon browser. There are some important settings that will vastly improve the experience. I'll update this post soon with step-by-step instructions.


The downside
Photon browser is a $4.99 app purchase. I know, that stinks.

We have no relationship with Photon and will be evaluating other Flash-enabled iPad browsers. Hopefully a free option will emerge that offers support for all of the features required to run the grading app. Ideally Apple would finally come around and support Flash, but that's not very likely (in fact, even Android is moving away from Flash with its latest Android Jelly Bean 4.2 OS).

Until we identify a viable free solution, it'll be up to you to decide if grading on your iPad is worth $4.99.


Updates:
Step-by-step instructions for using EssayTagger with the Photon browser are now posted!

- Alaina is reporting that she's having success with the free Puffin iPad browser. My testing with Puffin was less successful but I'll take a closer look at it as soon as I can.

Monday, January 28, 2013

Latest update: Rubric descriptors now integrated into the grading app

We differentiate rubric "descriptors" that are designed to set performance expectations vs feedback comments that promote student growth. Long overdue, your rubric descriptors are now integrated into the feedback-driven grading app.


Rubrics serve two purposes
It's taken me a while to wrap my brain around this, but I finally had my "a-ha!" moment and clearly saw that rubrics serve (at least) two distinct purposes:
Purpose #1: Rubrics set performance expectations for students before they attempt the assignment. 
Purpose #2: Rubrics provide performance feedback after their work is assessed and scored.
A typical rubric grid cell for, say, Evidence will go something like, "Uses inadequate examples, evidence, or reasoning to support its position." This sort of vague language always frustrated me because I only cared about Purpose #2 (rubrics as feedback). In fact, this was a large part of the motivation for me to create EssayTagger in the first place. I wanted to be able to give students more specific feedback at a per-sentence level. I wanted to be able to coach them on every individual piece of evidence rather than offering a single generic statement.

And I tended to poo-poo Purpose #1 because I set expectations in class by doing a ton of group and peer review where everyone evaluated samples and compared notes against my evaluations. It was amazing to see how close the class peer review averages were to my own determinations on the essay samples. At that point it didn't seem necessary to re-establish those expectations in a formal rubric.

So I built EssayTagger with only Purpose #2 in mind.


Enter "descriptors"
But many teachers told me that they believe strongly in Purpose #1 (using a rubric to set expectations). I try my best to avoid letting my personal biases get in the way and prevent other teachers from being able to incorporate EssayTagger into their classrooms.

So I developed the "descriptor" feature in EssayTagger to support Purpose #1. Descriptors set expectations. Enter them into your rubric and share it or print it out for your students. They can review the rubric and the descriptor text before they write the assignment.

Here's an example:
click to view full size

As you can see, this EssayTagger rubric looks like a traditional rubric with high-level expectation-setting descriptors.

However, because descriptors usually make for horrible feedback comments (failing to serve Purpose #2), they were kept separate from the targeted feedback comments that are the real bread-and-butter of the EssayTagger system.

Because of this separation--Purpose #1 vs Purpose #2-- I did not even display the descriptors in the grading app. I wanted to include them but I wasn't sure how to do it without creating confusion between descriptors and feedback comments.


Descriptors now integrated into grading app
A recent email exchange with Stephanie Bester of Thurgood Marshall Middle School finally prompted my second "a-ha!" moment and I finally figured out how to display the descriptors in the grading app in a way that would minimize confusion.

Wednesday, January 23, 2013

Latest update: Six-level rubric support

Thanks to teacher feedback, EssayTagger rubrics can now have up to six possible quality levels.

I had previously limited rubrics to a max of five quality levels mostly due to practical constraints; there just wasn't enough left-to-right space in the grading app to comfortably accomodate six quality levels. But after a series of recent cosmetic updates, the grading app now has plenty of breathing room.



Then: Law of diminishing returns
But I was still skeptical. I knew that six-level rubrics were popular, but I never used six-level rubrics in my classroom. For me, anything beyond five levels started to get overwhelming. How could I possibly remain consistent in evaluating ever-finer levels of distinction?

Monday, January 7, 2013

Latest Update: Error marking!

Thanks to input from our users we now support a dedicated feature for marking spelling, grammar, or other errors. But this new feature is more than just a red underline. Read on to learn more!


EssayTagger is built to help teachers evaluate student work within the structure of a custom rubric and provide excellent, specific feedback to students. But instructors made it clear to us that we needed direct support to be able to mark errors--the dreaded red pen markups on a paper. It makes sense; marking a grammar error is different from evaluating a weak thesis.


Error Mark overview
The new feature makes it easy to mark problematic passages as having an error. Marked passages will have a red underline. You can enter an optional comment about the error. When a student receives her graded work, she'll see the red underlines sprinkled throughout her essay.

But here's the coolest part: all of the marked passages will be collected into a list at the end to make it easy for the student to do a follow-up correction exercise.

And just to be clear: These are errors that you determine. The grading app does not do any auto-evaluation whatsoever. EssayTagger is always driven by your brain, your expertise. We do not believe in auto-grading software!!


Let's see an example!
Error marking piggy backs on our existing "free comment" system to make it super quick and easy to mark an error.

Just select the problematic text:



And when you release the mouse button the new Mark Error/Free Comment popup box will appear:



Just click "mark as error" and the text will be underlined in red. That's it!



The student will now see this error mark in the final graded output. Here's what the student sees:



You can also enter an optional comment about the error. Comments appear in the list of marked passages at the end of the graded essay, prefaced with your initials:



Notice that the whole sentence is presented so that the underlined portion appears within its full sentence context.

Pretty damn cool, right?!


A word of advice
In most cases I recommend not entering a comment about the error. Instead hold the student responsible for reviewing her errors and thinking through them herself to figure out and learn from her own mistakes. She can seek out help if she needs it, but we shouldn't take on the responsibility of making corrections for the students when it really doesn't do them any good.

I'd much rather have students submit corrections to earn back some mechanics points rather than having me write endless "subject-verb agreement" or "you're/your" comments that the students won't even read.

Think of it as a chance to put those Active Learning vs Passive Learning PD workshops to use!


Available now!
As with all EssayTagger feature updates, this is available now to all EssayTagger users. Every time we upgrade the site, all users benefit!



Additional features coming soon
We will update the data reporting screens to include data about how many errors were marked in each essay along with aggregate data (e.g. average number of errors marked on the assignment) and individual vs aggregate performance outlier analysis (i.e. does a student have statistically significantly more errors than his peers?).

Wednesday, December 5, 2012

Latest Update: More screen space for the grading app!

I do just about everything for EssayTagger on my MacBook Air. The default screen resolution of 1440x900 makes the grading app look great. There's plenty of space for everything.

But one of the more pressing items on my to-do list was to address the needs of users with more cramped screens. I set my MacBook's resolution down to 1024x768 and figured out how to make the grading app fit a bit more comfortably in that constrained space.

Sunday, December 2, 2012

Latest Update: Rubrics can now be downloaded as Excel files!

We're doing everything we can to encourage more teacher collaboration within teams and across the entire web. One of the main ways we do this is through rubric sharing.

Instructors can already create their own rubrics; share them via email, Twitter, facebook, or hyperlink; print them (Macs can save the printable version to PDF); import any EssayTagger rubric into their own accounts; and edit those rubrics however they please.

Now you can also download any EssayTagger rubric as an Excel CSV file.

The CSV file format is very common and is supported by most spreadsheet programs (Excel, Google Drive spreadsheet, etc.).

Friday, November 30, 2012

Latest Update: Downloadable results data!

As part of our push for new and improved data reporting, you can now download all of your results/grading data for each of your assignments. This feature is fully reverse-compatible with all existing assignments.

We don't believe in vendor lock-in so we're happy and excited to offer yet another way for you to access your results data. It's your data; it shouldn't be trapped on our servers.


What's in the download?
All of the data in the chart shown below will be included in the data download as well as a few extra fields. Here's the full list:

Thursday, November 29, 2012

Latest Update: New data reports!

With EssayTagger's core platform in place, it's time to turn our attention to the incredibly rich data that is generated when you grade your essays in our system.


UPDATE 11/3:
We've already updated the charts quite a bit and have updated this post to reflect the changes!

UPDATE 11/29:
Even more improvements and two new charts! Post updated again.

UPDATE 11/30:
You can now download your grading data to Excel!


We've reached the first milestone of our major push to enhance and extend the data reporting features of the site. Today's release opens the first new data reports on a beta test basis. "Beta" in programmer lingo means it's not yet finalized, but is mostly where it needs to be. There will likely be further refinements based on instructors' feedback as well as minor bugs to be fixed.


Quick highlights
  • "Section snapshot" overall section-wide aggregate performance graph
  • "Section details" chart of all students' performance on each rubric element
  • "Individual details" in-depth view of a particular student's performance on the assignment
  • Statistically-significant outlier identification to help you focus on the students who are furthest from the pack.

All of these data reports are amazingly useful tools for teachers, but I'm particularly excited about the statistical analysis we're able to provide. You don't have to know the first thing about stats, standard deviation, or z-values; we're computing everything for you and flagging the kids that need your attention the most!

You grade, we crunch the numbers. How awesome is that?!

(see the demo video here: http://youtu.be/WZsEoAJEkv0)


"Section snapshot" overall results
This is the new default view; you'll be routed here automatically when you click "exit grading app" when you're done grading. It's the broadest view of the data and includes two charts. The goal is to provide a rough "snapshot" look at how your class section performed as a whole on the essays graded thus far:



The stacked column graph displays how many of your students fell into which quality levels when you evaluated their essays in the grading app.

Put simply: the more green, the better.

Monday, November 26, 2012

Latest Update: Common Core progression-tracking!

Grades and GPAs are just rough estimates. It's more important to keep track of which skills your students have mastered. That's where Common Core-aligned progression tracking comes in. It's a big deal.

Most of us have had this skeptical suspicion: Am I aligning my curriculum to Common Core just because some bureaucrats said I have to?

If that were all that was behind Common Core, then it would absolutely be a waste of our time.

But curriculum alignment is just stage 1. Here's the full picture:

  1. Align curriculum to Common Core
  2. Assess within Common Core
  3. Report and track student data within Common Core
  4. Develop and share remediation strategies tied to Common Core
Only at this high-level view does it all start to come together. The overarching goal is to enable apples-to-apples comparisons that can then be used to drive stage 4 where every teacher in America is creating interchangeable exercises and materials.

Let's be more concrete. EssayTagger is focused on stages 1-3, culminating in our Common Core-aligned progression tracking that was just released:

Friday, November 16, 2012

Latest Update: Language and Speaking & Listening Common Core standards added!

Based on teachers' feedback, I've added the Language and Speaking & Listening standards to our Common Core Rubric Creation Tool.

The Language standards are necessarily quite mechanical (e.g. L.9-10.2a is the semicolon) and as such are often more suited to drill-and-skill type exercises and assessments, though certainly an instructor could construct an essay rubric that included a few specific mechanical elements.



The Speaking & Listening standards are, not surprisingly, even further afield from EssayTagger's emphasis on essay assessment. However, the Common Core Rubric Creation Tool isn't limited to just EssayTagger use and teachers did request that this standard be included. And, if you're a little creative, there actually are ways to make the Speaking & Listening standards work within EssayTagger (e.g. evaluating students' self-assessments after delivering a speech).



Both of these Common Core standards were added to the tool as a direct result of teacher requests. I had intentionally passed them up when I originally released the tool.

We are incredibly receptive to instructor feedback so keep the comments coming!

Sunday, October 14, 2012

Latest Update: New and improved free trial!

Let's jump straight to the good stuff:

The new free trial will allow instructors to grade up to 99 essays in one assignment!


Our original free trial allowed for only a single class set of essays (~25). The original idea was to encourage teachers to start small. As a classroom teacher I advocated for the small trial approach to minimize any possible classroom disasters.

Don't get me wrong, I think EssayTagger is a remarkably robust system, but anytime a new workflow or new technology is involved, there's always the risk of things going wrong. And as a frazzled teacher I'd rather see only one section crash and burn than all three!


But then came the feedback
That's all nice in theory, but in reality teachers were more unhappy about creating inconsistencies between their sections by singling out just one of them to try EssayTagger. It's too much hassle to have different sections in different places or systems; second period is over here, but fourth and sixth periods are over there.


So we changed it
Our new approach now lets the instructors decide if they want to have all of their sections switch to EssayTagger or just experiment with one or two sections.

The only new limitation is that free trial users can only have one assignment in the system at a time. And even if you delete and start over with a new assignment, the 99 essay limit continues to count down. I think that's a reasonable compromise.


Existing free trial users
Your free trial accounts have been automatically upgraded to the 99 essay limit. If you have more than one assignment in the system, don't worry, you get to keep them; they've been "grandfathered" in so you don't lose your existing data. You just won't be able to create any new assignments as a free trial user.


Your thoughts?
Being a classroom teacher myself, I try to bias all company decisions toward what's best for teachers and their students. I hope this improvement is further proof of that commitment. As always, I'm eager to hear your thoughts and suggestions.

Monday, March 19, 2012

New Rubric: Common Core Explanatory / Informative Writing (9-10) rubric

The first of many rubrics distilled from the Common Core State Standards.

Update 9/21/12:
In the six months since this post was originally published, my view of how to integrate with Common Core has evolved a considerable amount. This post is now old news. I've built a free, publicly-accessible tool to help teachers create their own customized Common Core-aligned rubrics. It's going to make life SO much easier for all of us!

Read about this new approach or jump straight to the EssayTagger Common Core Rubric Creation Tool

Check it out and let me know what you think!


Original Post:
The Common Core State Standards. Oof.

You've heard all the talk. You suspect they might get in your way and make your life a living hell. Just thinking about them makes you want to curl up on the couch in the fetal position and take a nap (my default reaction to moderately stressful things).

I'm not here to sell you on its merits or argue that there is a lack thereof. I'm here to make your life a little bit easier when you find yourself held accountable to the Common Core standards when teaching writing.

Friday, March 2, 2012

New Rubric: "They Say, I Say"

One of our first demo rubrics is now available for anyone to use in their own EssayTagger assignments!

Gerald Graff was one of my professors at the University of Illinois at Chicago during my M.Ed. program. And, I'll be honest, I was very wary of "They Say, I Say" when he first explained the concept of the book to my class. But TSIS quickly won me over. And the skyrocketing sales that he and his wife/co-writer have enjoyed certainly show that others appreciate its value as well.

But there was one thing I noticed -- the book does not address assessment. I love the guidance it offers for teaching composition and the structure it gives to developing writers, but I felt like there was a missing final chapter on how to evaluate the resulting TSIS-style essays.

So I began developing a TSIS-style rubric that would work within the EssayTagger system. I met with Prof. Graff to show him an early draft and his eyes lit up with enthusiasm.

Now that I've completed EssayTagger's rubric sharing and import features, I can post the rubric for anyone to use:

EssayTagger "They Say, I Say" rubric:

This rubric is listed as a "work-in-progress" because, well, it is. But it's a pretty dang good start. And keep in mind that any rubric shared on EssayTagger is meant to be a starting point. Teachers should alter and customize these rubrics however they see fit.

Let me know what you think!

New Rubric: Four-Strand/Four-Level

From what I'm told, the Four-Strand/Four-Level rubric is fairly common in Washington schools. I've adapted it for use in EssayTagger (you can import it straight into your own assignments!) but you'll still want to customize it to suit your needs.

EssayTagger version of the Four-Strand/Four-Level rubric:

And as I've said previously, because rubrics are so macroscopic, they inevitably undergo some changes when they are adapted for the much more fine-grained world of EssayTagger.