Showing posts with label high-stakes testing. Show all posts
Showing posts with label high-stakes testing. Show all posts

Sunday, September 15, 2013

Watching "Teach"

I set aside two hours on Friday evening, September 6 to watch the CBS movie "Teach."  (I wonder if anyone besides a teacher watched this mea culpa by Davis Guggenheim, atonement for his teacher-bashing "Waiting for Superman"?)

It was as much a romantic whitewash of the teaching profession as Waiting for Superman was a scorched-earth review of public schooling. (Just look at the image that accompanies that movie -- a child at a desk in a post-apocalyptic wasteland.)

But, hey, if you're trying to attract young people to the profession, you certainly don't want to focus on the all night paper-grading marathons, the pointless professional development, the hours spent collecting data to prove your worth, the flat nature of the career, or the paltry pay that means many teachers can't afford to live where they teach or send their own children to university.

But for selling the "feel good" aspect of teaching, it was a hit.  I felt good.  But I already love my job and think teachers are the greatest human beings on the planet.

I also LOVED the commercials where comedians come back from the future to tell a young person that they will "lead a group of small aliens into a better future."  Fun.  I hope it makes some of our young people consider the career.

For those who did not see it--and I suspect there are more of those than not--the movie followed four teachers through a year.  All four received some collaborative help in improving their teaching.  All four "saved" at least one student before the end of the year.

Happy ending.

Also, at commercial breaks famous people came and sat at a student desk in a generic hallway and personally thanked a teacher for changing them.  And Queen Latifah also made a pitch for teachers. Her mom is/was one.  Subtext for teacher wannabes:  You, too, can have a famous person thanking you for your thankless task one day.  (Another message I despise: why bother giving if there's nothing in it for you?)

I felt pretty good about my job after the movie, and yet....something has nagged at me for weeks about what I saw.

And it wasn't the fact that teachers are being sold as superheroes again. That was clear the first time through.  Teacher as superhero is an unsustainable, if not impossible, reform idea.  We can't build an entire profession on the idea that selfless giving--to the exclusion of your own health and wellbeing--is the only way to rescue kids.

And it wasn't the accepted premise throughout the movie that student test scores are a true measure of what a child has learned. From the beginning there was no counter to the idea that high-scoring kids will be successful in our crazy, ever evolving world.

Both the idea that teachers must be superheroes and that test scores are unassailable were presented as truths.  I agree with neither of them.  There is little evidence that those who are strong academically will be successful later.  Bad premise.

However, what had me considering and reconsidering the movie over the following days were the faces of the students we followed. I was particularly affected by the little girl in Matt Johnson's fourth grade and the struggling boy in Shelby Harris' 7th grade math class. When the camera rested on them there was so much pain, loss, and confusion in their faces that I found it hard to watch.

Throughout the movie these students were referred to as "behind" and "below grade level."  These children had been labeled failures and losers from the very beginning of their school careers (until they met the superhero).  And they knew it.

Even the Algebra student, who had completely disengaged from schooling at the beginning of the year by exhibiting behaviors that any classroom teacher has seen time and again--putting his head down, answering with a dismissive "I don't know"--clearly saw himself as a loser.  The only real way to save face when you live with this label is to show the world that you do not care about the label.  It's all "stupid" when schooling reminds you time and again that you are a complete and utter failure.

It is very painful to watch.

It was the teacher's job to bring them up to grade level and thus save them from failure.  Get them to "catch up" with their peers.  Help them re-imagine themselves as a "winner" rather than a "loser."

This is what haunted me.  We still live inside the factory-model that forces kids through an unyielding  "system" attempting to stamp out lookalike products.   The system presumes that all children progress at the same rate.  It presumes that we all enter with the same experiences, grey matter, and motivation. It presumes that we can all learn at the same pace based on an arbitrary calendar made up in a vaulted office somewhere.  I noted that the Algebra teacher had better success with her students when she ignored the overcrowded curriculum map and slowed down to match the pace of the students who were trying to learn the material. That smacks of a problem with the map, the test, the curriculum, etc. -- not the kids.

When a child is placed in a grade level (arbitrarily based on a birth date) the inability to keep up is deemed the child's fault.  And this message is sent to the child time and again.  Hence the pained expressions on these children's faces throughout the two hours.  Hence my discomfort.

It is a poor system for bringing out the best in our children.  One that should be ditched.

As for the movie, outside of the *revolutionary* notion that teachers need time to collaborate, and a twenty-minute add for Kahn academy, (does Guggenheim own stock?)  it offered nothing new to the education world.

I hope young people decide to become teachers, and I hope they bring with them a new age of learning that revolves around the student and not outsider's measuring sticks.

But Davis Guggenheim is not a visionary.  He's just a salesman who uses images to great advantage. And the product he's selling is both short-sighted and simplistic.






Monday, April 1, 2013

The Dark Ages


The retired head of the Atlanta School District, Beverly Hall, has recently been indicted for cheating.

According to the New York Times, some teachers were browbeaten into changing student answers in erasure parties where wrong answers were switched to the right ones.

Thirty-five teachers and administrators have been indicted in the case.


"Every time I play those tapes, I get furious about the way Beverly Hall treated these people," [said Richard Hyde, Georgia state investigator who taped hours of teachers wearing wires.]

Some of the teachers, single parents who feared losing a job--Beverly Hall's unofficial motto was "low score, out the door"--felt unable to resist orders.  Without a doubt, the losers are students and parents who were unsuspecting pawns in the deception.

The Atlanta scandal is only the most egregious of other scandals under investigation across the country.   Some don't even attempt to fudge the numbers.  Lying about student success seems to be accepted practice when the figures don't add up.  The governor of Georgia was under great pressure from the business community to drop his investigation into the scandal.  Business leaders wanted to be able to attract more business to a state with a well-educated population---even if they weren't.

This is the state of education today which lumbers zombie-like on to more testing and accountability under the new Common Core (some estimate tests may take eight to ten hours...) in spite of good science (about what really helps kids, about how testing distorts instruction)  that is currently ignored.

History will mark this the new Dark Age.

In our national experiment on a whole generation of children, two social science truths are now playing out.
  • If you want to motivate people to work harder in intellectual work they need more autonomy, mastery, and purpose.  When our motivation is unhinged from its purpose, we get what Daniel Pink calls "crap." We seem to be getting plenty of that.
  • Secondly, when you use numbers to determine social decision-making, it leads to corruption and a distortion of the social process.  This is known as Campbell's Law.  Duh.  See above examples of how these narrow numerical definitions of success have completely distorted teaching and learning, probably our most social behavior.
I declare this particular education experiment over.

Let's get back to creating a strong, innovative teaching profession.  And stop diverting money into the pockets of test developers.


***Ironic, too, that it looks like we will be throwing teachers and administrators in prison for a failed education/business model while the real Masters of the Universe continue to run an economy over a cliff.


Sunday, February 10, 2013

Huck Finn Takes a Standardized Test

I have a soft spot for the "bad" kids.

My definition of a "bad" kid is a creative disrupter.  These students refuse to follow rules simply because they are there and show their disdain for "stupid" ideas by acting independently, following their own logic.

I qualify these characters worthy of celebration.

Huck Finn lives.  Mark Twain's quintessential bad boy is the American spirit incarnate: He looks at the landscape and acts adventurously, getting off the beaten path and creating his own.

Where would we be if whole legions of Huck Finns had not asked us to reconsider "sivilization"?

So I was amused by the student response to the MAPS test required by the district in Seattle.

Some of the kids just would not play by the rules.

And sometimes they made errors that fit only into the category of kid logicthe delightful way a child's mind can shift adult paradigms. (My son at age three observed that a jet plane was "scratching the sky."  Yeah. Take a look at those jet trails some time.)

So here's what some kids did:

  • When some kindergarteners were directed to put the mouse on the item, they lifted the mouse and placed it on the computer monitor. 
  • When students figured out that a correct answer up-leveled the questions and made them harder, they deliberately answered questions incorrectly so the computer would serve up easier questions.
  • When students were told it would not affect their grades, they rushed through the reading comprehension test without reading so they could get back to doing something they wanted to do.  (Have you ever read something you didn't want to read?  It's really hard to care about it.)

I would qualify all these errors as "good mistakes" a phrase I first heard from a tennis coach.  "That was a good mistake!" he exalted once when a ball went long.  Hitting balls short was a bad mistake--holding the racket incorrectly.  A long ball meant I was starting to get it: follow through and let it sail.

The qualification of an error as a good one was so empowering that I still use it, rewarding errors that show a new skill in the offing.    

I'd qualify all of the above actions as a good mistakes. In every one there is strong evidence of critical thinking.

To a mechanized standardized test, the answer is either right or wrong--no qualification.  It takes the observation of a human being to follow the logic of the error.  

Ironically, these mechanized tests are to be used to measure the effectiveness of teachers in the classroom.  To a teacher who has a led a career of watching and coaching kid's through their own kid logic, relying on mechanized scores feels like tying your hands behind your back while someone slaps you in the face.

So Huck Finn broke the rules.  

He could not ignore his own logic when deciding whether or not to steal Jim out of slavery and help him back to his family. He tears up the letter to Miss Watson that would have revealed Jim's whereabouts:
I studied a minute, sort of holding my breath, and then says to myself: "All right then, I'll go to hell"--and tore it up.  It was awful thoughts and awful words, but they was said.  And I let them stay said; and never thought no more about reforming. 
Sometimes, when faced with injustice, the only choice is taking the road to hell.

As of four days ago the administration of Seattle was still sticking to its sivilized notion of holding teachers accountable.

Long live Huck Finn.

Saturday, September 15, 2012

What Chicago (and other) teachers fight for....

Though the Chicago's teacher's strike has tentatively come to an end, getting the issues fairly addressed in the media as been a struggle.  Here is what they are fighting for int he words of a Chicago teacher.  Please pass it on.

"...the mainstream media is not covering all of the issues for which the teachers are striking.  It is unsettling, but that is where we come in.  It is our job to talk with friends, colleagues, and neighbors to illuminate the struggles that the students face in Chicago.  A school with 1000 students does not have a social worker.  Teachers use economic text books that are 12 years old.  Our curriculum has become more and more narrowed to teach finite skills on absurdly written tests, tests which close our neighborhood schools and unfairly evaluate us.  In CPS once test scores drop, the district begins to divest in the school and take away parent, teacher, and administrative voice, leaving the schools left to improve with fewer resources..."

If we care about children, we can do better.  Detractors paint teachers as selfish money-grubbers who work few hours for high pay.  That is not the issue.

The issues are:

Do we really want to assess teachers based on student test scores?  Not only has this been repeatedly proven to be unreliable, it means that students will have to sit for tests--all the time.

Try to imagine being a student who must take multiple tests in every grade.  Now try to imagine how teachers and systems might try to ensure that all students are read to take the tests.  Right.  More tests to make sure they are ready for THE test.  (This is already the way many students experience school right now.)  Now, try to imagine how an adult, who's livelihood depends on the test scores, might behave.  Getting a little ugly, isn't it?

Who, in this fight, is really thinking about the children?

Why is there NO money for air-conditioning or new texts but there IS money for charter schools and multiple tests?  (Both of which have been proven to have very poor track records for improving education.)

Who, in this fight, is really thinking about children?

Why is poverty an EXCUSE for teachers but not for public officials?  Children make up the majority of those who live in poverty, but that's okay?

Who, in this fight, is thinking about children?

Sunday, October 9, 2011

Teacher Effectiveness Measures - What's the problem?


Below are the remarks I was privileged to share before a full room on the VCU campus in Richmond on Saturday, October 1. The topic was "Merit Pay and Teacher Evaluation."  


   I have been a teacher since 1978, and have been in the classroom since the beginning of No Child Left Behind.  Even prior to that, when the Standards of Learning first went into effect in Virginia, I commented to my colleagues that we already knew who was behind and did not need a measuring tool for that.  But removing our ability to evaluate our own students through outside testing was the first step in a campaign to de-professionalize every teacher in America and a clear signal that we would no longer be trusted to perform our jobs.
  What we need, and have needed for the past thirty or more years, are the tools, resources, professional training, and time to educate all children to high levels of performance.  Recently, the lion’s share of resources have been spent in “raising test scores” and not in improving effective practice.  And for that reason, I consider the past decade a complete stagnation, and in some places a reversal, of what teaching professionals consider best practice.
   I would like to state clearly that I am opposed to any merit pay system that is attached to student achievement connected to testing.  There are a number of reasons for my opposition, but the primary one is that it will fundamentally distort the relationship between the teacher and student in potentially damaging ways.
   We should not tie an adult’s livelihood to the performance of vulnerable children.  This immediately shifts our view of our work.  Suddenly children become potential commodities to be exploited or weak performers to be avoided.  This is fundamentally dangerous.  Those who need us most will be least served.
   As the stakes connected to testing have been increasingly raised over the years of NCLB there has been a steady increase in cheating scandals.  We can be assured that these scandals will find their way into individual classrooms and have a profound effect on student learning if teacher performance is measured against these narrow tools.
   The current plan in Virginia, to tie teacher evaluation to student growth causes me a great deal of concern.  To begin with, I do not understand what tools will be used to measure this growth and how they will be untangled from all the factors that affect student achievement.
   To my knowledge there is no reliable tool available for measuring a teacher’s effectiveness within a school year.  The psychometricians have repeatedly argued that Value Added Measures are extremely unreliable.  In addition, the experts clearly state that current criterion referenced tests were never designed to measure teacher effectiveness and is a misuse of their purpose.  In their own words these tools are “highly unstable” and correlate well only to the students in the classroom and not to the work of the teacher in the classroom.  And yet, federal, and now state, policy is being formulated around what amounts to a huge experiment in defining our work.
   One thing that is clear from the Race to the Top plan, which holds all teachers accountable and uses standardized tests as a large percentage of that measuring tool, is that taxpayer dollars will be diverted from the classroom to create and monitor the testing.  This is certain to build more of the downward pressure on teachers that has already proven to have a limited effect on student achievement . It will create a top-heavy bureaucracy that adds nothing to the quality of instruction and student learning.   It is, however, certain to benefit the test makers and the huge testing industry that has thrived during the last decade and has even continued to show rocketing profits in spite of the current economic downturn.
   It has already begun.  In my small district a testing program was purchased over the summer to begin tracking student reading levels, potentially as a measure of teacher effectiveness. Again, a tool never designed for this purpose.  If we are to track “teacher effectiveness” in every subject and grade, there will need to be more tools, some of which are yet to be brought into existence. Imagine what a juggernaut of testing all of our students, even the youngest will face.  Concurrently, our district has had a reduction in force, no salary increases, and cuts to professional development over the past four years.
   Over the past ten years, a the domain of a classroom teacher—evaluating student achievement—has  been “outsourced” to testing companies that produce measurements that are removed in both time and distance from the classroom and are limited in their effectiveness to improve instruction.  Testing programs have systematically stripped teachers of our decision-making abilities while simultaneously holding us accountable for the less-than stellar results. Teachers are frustrated with the decisions made at a distance that ultimately underserve student needs in the classroom.
   Teachers should not be the subjects of experiments in effective teaching.  Teachers must be partners in the study of effective practice.  Studies of effective practice should ultimately result in improved practice, not managerial, personnel decision-making. Is the real goal of the measurement process to pressure school administrators into removing some teachers?  If so, are they also not being trusted to do their jobs?
   We should be celebrating and sharing teacher knowledge, not creating an adversarial relationship with our students and our colleagues as this program promises to do.  Studying our own work, sharing best practice, and developing local, formative assessments will benefit every child and restore teachers to their role as coach, guide and evaluator.
   The current argument to measure teaching effectiveness is, in my opinion, a distraction from what needs to be done to reform our public schools that will create and maintain a robust teaching force ready to prepare our young people for an uncertain but rapidly changing future.

Other panelists were: Kitty Boitnott, President, Virginia Education Association; Tichi Pinkney Eppes of the Greater Richmond Education Reform Alliance; Stephanie Hooks of Richmond Public Schools; Martin Reardon, VCU Education Professor; and Gabriel Reich, VCU Education Professor.