Showing posts with label high stakes testing. Show all posts
Showing posts with label high stakes testing. Show all posts

Wednesday, January 21, 2015

Not your Public School Anymore...

January 21 federal HELP (Heath, Education, Labor, and Pension Committee) hearings begin on the federal No Child Left Behind law, (NCLB) which has been controlling the work of public schools for twelve years.  View hearing here.http://www.c-span.org/video/?323903-1/hearing-federal-education-policy-reform&live
           
Even if you do not have a child in school, never had a child in school, or despised your own schooling, you need to pay attention to this debate.

Why?  Because your tax dollars have been funneled into a variety of boondoggles, mean-spirited rulings, and questionable educational practices that have made some private individuals very rich while impoverishing, shaming, and sidelining others.  

Meanwhile children have been submitted to the largest un-tested social experiment ever perpetrated on a helpless group of citizens and are suffering under a narrowed and constricted curriculum.

Here is an argument you are likely to hear, first from Charles Barone of the Democrats for Education Reform (DFER).  Barone spoke last week in support of Education Secretary Arne Duncan’s decree that the law must be repealed, but not the tests.

"I don't know how else you gauge how students are progressing in reading and in math without some sort of test, some kind of evaluation," Barone said. "If you want to see a kid's vocabulary, how they write, if they can perform different math functions, the only way is to sit them down and give them a test."

In this argument, Barone presents an either/or logical fallacy that appeals to common sense.  Either you test them--as we have been doing for the past 12 years--or you have no evidence of student ability.

Most adults will accept this argument on it's face. (Of course! You have to test them.) But, in addition to its insultingly facile nature, it simply isn't true.

The facts are that teachers have always relied on a variety of forms of assessment to gauge where their students are and have reported these assessments in a variety of ways: report cards, parent conferences, remediation, specialized groupings.... (Surprise: we've always known who struggles.)

Teachers also use assessments to celebrate and encourage all students to find success in something: school plays, art shows, band and choir concerts, debates, school newspapers, spelling bees, repairing cars, wiring a house, building a tennis pavilion, welding, creating an architectural drawing, drawing blood, entering a variety of contests both athletic and academic--every one of these activities are authentic and evaluative.

Nothing provides greater feedback than a real audience, a public display, a finished product, or a scoreboard.  Nothing is more "real-world" than these activities.

A multiple-choice test is as "fake" an assessment as any devised.

Barone also ignores that since 1969 the nation has had the National Assessment for Educational Progress, also called "The Nation's Report Card," an annual, standardized test that provides reliable, valid data on the achievement of our students in all of the various reported groups, but does not punish school systems by withdrawing funds or testing every child every year.  The data from these tests is used diagnostically to look for broad areas for improvement in the delivery of education.

Ironically, this national tool has been used to measure the effectiveness of NCLB.  The verdict: a steadily rising rate of achievement among all students flattened once NCLB was put in place.  In some areas the achievement gap between sub groups has closed--but primarily because the top group dropped down, not because the bottom rose.

Against this assessment the high-stakes-testing-hold-all-schools-accountable initiative has been an abject failure.

So why would we repeat, at great expense, work that is already being done?

Barone, DFER, and Education Secretary Arne Duncan have been speaking for business groups who stand to gain financially from a policy designed to prove every public school a failure.  The options offered for "failed public schools" are always about shifting public dollars into private hands: charter schools run by private groups for profit, online courses run by private groups for profit, testing created by private groups for profit.

As a single example consider Pearson, the British-owned testing behemoth.  Your tax dollars have supported this outfit for years.  Hired to "hold teachers accountable" this group has been siphoning off local dollars with little oversight, shielded by the very loud "you gotta test 'em" voices.  Operating profits (that's profits, not sales) for 2012 alone were $1.4 billion.  In large part, this is money derived from taxes paid by citizens.

Current law ensures the profits will keep rolling in.  To wit: when our students test, teachers sign a legal document--every time--that stipulates they can have their license revoked if they read the test. The argument implied is that teachers cannot be trusted to teach well if they know what the kids will be tested on (huh?).

The truth is that released tests would require the creation of a new test every year.  That is expensive and would cut into the 1.4 billion in profits.  Our Virgnia legislature supports these business interests through law.

This also conveniently keeps out any oversight by experienced educators.  We can't know for certain what students are asked to do.  Additionally, these tests do not provide the valid information from tools we used to rely on to gauge student ability: The Iowa Test of Basic Skills or the Stanford Achievement test.

There are more costs associated with testing: Every district must provide computers and reliable internet access ($$).  The tests must be administered to very careful guidelines, usually by someone in the building whose job is dedicated to this ($$$). Data must be collected, reported, printed, published which requires personnel and software in every district and state ($$$).  Teachers must create specific goals that can be quantified, measured, reported, described (time and $$). This, more than anything else, is driving good teachers away--and affecting the quality of teaching.

All of these local costs support the testing multiple-choice monster, but Pearson profits!  The organization is also clearly overextended, promising and profiting on products they cannot produce. For instance, they have hired freelance writers--not educators--to write test questions and seasonal employees--not educators--to score them.  Shoddy products, indeed.

Yes, kids will always have to take tests.  But they do not have to be mandated by law, shift public money into private hands, carry damaging labels, and destroy the lives of children.

Educators already know who needs support for learning. Our money would be better spent in achieving equity of resources for all of our students--well-equipped school buildings, access to books and enriching experiences, and well trained and supported teachers.

Repeal the law.  Dump the tests.

Sunday, April 27, 2014

In the Belly of the Oligarchy

Corporate Oligarchy, according to Wikipedia:

Corporate oligarchy is a form of power, governmental or operational, where such power effectively rests with a small, elite group of inside individuals, sometimes from a small group of educational institutions, or influential economic entities or devices, such as banks, commercial entities, lobbyists that act in complicity with, or at the whim of the oligarchy, often with little or no regard for constitutionally protected prerogative.  Monopolies are sometimes granted to state-controlled entities, such a the Royal Charter granted to the East India Company.  Today's multinational corporations function as corporate oligarchies with influence over democratically elected officials.

It is the testing season, and, as I have been required to do every year since we began the Standard of Learning tests in Virginia in 1995, I must sign an agreement with the state before proctoring the tests.

The School Division Personnel Test Security Agreement is enforced by Virginia Law 22.1-292.1.

Over the years the agreement has been revised.  Last year the agreement was "toughened up."

In signing, I put my livelihood at stake:

  • Agreement #1:  "Violation of test security procedures: revocation of license."  
  • And in case I didn't get it, in Agreement #2: "...if test security procedures are not followed, my license may be suspended or revoked and/or I may be assessed a civil penalty for each violation."
  • And finally I am required to squeal:  "All known or suspected violations of SOL test security shall be reported to appropriate school division personnel or to the Virginia Department of Education."  And then the contact information for informants is provided.

The agreement rankles.

Parts of it are downright insulting--"All persons are prohibited from altering, in any manner, student responses to secure SOL test items"--since it presumes a level of complicity or guilt--while also acknowledging the very high stakes surrounding these tests since adults are judged (fired, reassigned, subjected to extensive data-collection and paperwork....) by the results.

So, yeah, some might be tempted to cheat.  Go figure.

We are also advised that "All persons are prohibited from providing students with answers to secure test items, suggesting how to respond to secure test items, or influencing student responses to secure test items."

Okay.  I wouldn't do that in my classroom either, especially if I really want to know what a student knows, but once you start making rules you have to cover every possible variance (hence my problem with rule making.)

But here is where it crosses over into the level of a gag rule.

The following item on the agreement is more about protecting the intellectual property of the test maker--in this case Pearson, a multinational corporation (see oligarchy definition).

The ruling effectively shuts down any push back on whether a test item is a valid one, whether the test is testing what it purports to be testing, or whether classroom teachers can get any insight into what a student might struggle with so adjustments can be made in the classroom to better prepare the test taker.

Teachers are prohibited from:

  • "Reading or reviewing any part of a secure test (e.g. test items, answer options, passages, pictures, diagrams, charts, maps, etc.) before, during, or after the test administration."


The rules, supported by the state legislature, (see definition wherein corporations have "influence over democratically elected officials") ensure that there will be no effective oversight of the test items.

We can't read the test or we are in violation.

Our role is to merely read directions and tacitly support a tool we may not find in the best interest of our students. (But how could we know?  We can be fired for reading it.)

  • All SOL tests must be administered strictly in accordance with the instructions provided in the SOL test manuals.  This includes but is not limited to adhering to procedures for the handling, distribution and use of test materials and test manipulatives, adhering to specific requirements associated with test accommodations (e.g. read aloud accommodation, dictation to scribe, etc.), and reading all SOL test directions to students exactly as written.  SOL test directions must not be paraphrased, altered, or expanded without prior authorization from the Virginia Department of Education through the Division Director of Testing unless the Examiner's manual allows flexibility in providing specific directions.
We have been instructed to answer every student inquiry (whether it has to do with negotiating the new computerized 'enhanced testing items'--lots of clicking and dragging--or providing a condensed version of directions) with this rejoinder: "Read your test directions again and do the best you can."

That's it.

Turn on the computers.  Read the official directions.  Don't look at the test.  Face the potential of losing your license--and your income.  And have your worth as a professional measured by student outcomes on a test which essentially exists in a black box.

Something feels really unfair.


So not impressed with the "technology enhanced items."  Just bells and whistles that are a distraction from what a student knows because sometimes it's the format that trips the student up.  

For instance, on the reading test they must click on tabs to read paired passages.  Some don't see that.  (Even though even more class time is given over to teaching students how to use the tools, they don't always see it. Maybe they're stressed?)

Some students don't notice that the passage is more than a page long. Getting to the next page requires more clicking.  

Many students complain it is hard to read on the computer screen.  The reading test last year took my students FOUR HOURS, people. Think about reading long passages on a computer screen for four hours.

Many items feel like trickery.  For instance, there are items that indicate you should choose "all" the items which fit a criteria.  There is no indication of how many items one must choose.  But you must get all of them (and not too many) or  the entire question is wrong.  That is supposed to reflect "rigor." 

Seems more like a carnival game where the carny is sure to win more often than the mark.

I can learn more about my students' knowledge from a written answer.  

And you, dear taxpayer, should want me to do that.  After all I have a Master's degree and 25 years of teaching experience.  That's thousands of students, tens of thousands of written answers.  I can provide immediate feedback that extends into narrative or a long discussion rather than a disembodied number devoid of explanation.  

I actually know how to do that.  

And I know my students.  I know who is a second language learner who understands a lot of content but is lagging behind in language acquisition.  Providing a simple synonym could help them reveal their understanding.  And I know who has little experience with computers and might need assistance with technology.  And I know who has testing anxiety and could better show their knowledge in another way.  And I know who struggles with attention and could use a stretch or a stroll around the room to get refocused.

Frankly, I'm surprised there is no prison time associated with these rulings. Pearsons' $9 billion in annual revenues is at stake.  There's a lot less profit if you have to re-write the test every year.  Much easier to coerce a legislature into threatening an entire profession.

But I imagine that Pearson's Public Relations division has determined that making martyrs of public school teachers through extended jail time might turn the public against them.

Saturday, January 4, 2014

Talking Education with Non-educators

It is easy to remain insular during the school year as any private life is consumed by the crowded school schedule.

It is school, school, school without a let up (nights, days, weekends) until everything comes to a screeching halt at the holidays.

Often I feel that I have emerged into another world when mingling with peers who have only tangentially thought about public schooling as it affects their grandchildren, nieces, nephews and neighbors.

After being immersed in conversations about Ed policy with educators for months at a time, I am confronted with themes as they are perceived by the general public.  Angry exclamations from those outside of our realm about what is going on in our schools--or not going on, as they see it--are informative. The texture these big issues are taking in the wider world by those who don't eat, breathe, and sleep educational issues becomes clear.

Though it may be easy to rise to a defensive posture, the commentary heard from the wider public can help us frame a message to explain the broad changes educators endorse when it comes to effective instruction for our students.

What I've heard over this holiday break convinces me that real reform in public Ed needs a framework that will engage a public that only understands one kind if schooling:  the one they had. 

Here are ways I've tried to shift conversations. Also offered are tips for transitioning a righteous rant into a thoughtful consideration of what it means to be educated, something those who played the game by the old rules (and did fairly well according to that system) haven't considered.

Tip number one:  Let your conversation partner rant. But listen beneath the outrage. What does he/she seem to be fearing?

Tip number two:  Rather than going on the defense, ask questions. Whenever possible, tie an issue to their own child or grandchild by describing what a policy looks like from the child's perspective. Link new ideas in education to memories of their own school experiences.

Here are issues which are raising the eyebrows of the general public.  I've had more than one adult bring up these topics as what is seen as alarming change:

Do you know that if a kid fails a test they get to take it again?

Fear:  This is unfair. Kids should get what they "deserve," which is a low grade due to laziness. We will get a generation that does not value hard work. Consequences, like low grades, will teach them a lesson.

Response:  What do you see as the goal for a course?  Is it more important to earn the first score or learn the material?  Try to shift the speaker's focus to outcomes for a system of education.   If you can maintain their interest, ask about their own grades, and what they can recall about particular subjects. Did the grade reflect what was learned?  (I recommend asking about Algebra and Chemistry. :-)) Does a good grade mean you know it?  How do you think you would react to schooling if you always failed every test?

At some point, I reference the many students I've had who've "passed" a course with the lowest possible numerical D and seem happy enough accepting several failing grades. They have learned to play the school game well, content to coast through on seat time, learning very little. (Or, as is the real case, they have given up trying to figure out how this learning thing works.)  Reteaching and retakes ensure that kids who struggle learn they can get help. They also learn that perseverance produces results. The message in this philosophy is that understanding the material is the primary goal--not squeaking by.

This issue is actually a monumental shift in the goal of public education.  It signals a move from merely ranking our students by the skills, talents, and experiences they arrive with through "earned" grades to instructing all students to a level of competency.  When the public gets behind this paradigm shift, then we will have the kind of literate, thinking workforce the biz people are always yapping about.

The teacher had the kids doing these projects and teaching each other.  She's not doing anything.

Fear:  My taxpayer dollars are being wasted. What a cushy job!

Teachers know this sounds like project-based or constructive learning. We also know that managing the projects and keeping students moving forward takes a lot of planning and skill not obvious to onlookers when the teacher is in coach mode. When the job is done well, the learning is deep and long-lasting. But it would take hours to go through the theory.

Instead, ask:  When you learn something new at work, which do you remember better--the directions someone feeds you or the tasks you had to figure out for yourself?

Or:  Tell me a specific day or days you recall learning something in school. Why do you think you remember that? Most will concede that they remember little of daily lectures, more about what they read on their own, reports they generated, and even more when the activity was unique--like a field trip off campus or a play or musical performance which demanded their active participation.  This, you can explain, is what we have learned about learning.  The mind must be engaged.  The task has to be somewhat challenging but achievable (not too frustrating).  Most adults only have experienced this kind of learning at their workplace--very few in the classroom.  This is another paradigm shift for the adult who has not experienced this kind of hands-on learning.

I'm evaluated on my results at work.  It's only fair that teachers are evaluated as well.

Fear:  Somebody is getting away with something (like that lazy, good-for-nothing history teacher I had who hurt my feelings in eleventh grade....)

With this one, the temptation is really strong to cry "bullshit" since I've worked in the private sector alongside plenty of slackers who were never fired or even pushed to improve.  However, reality never seems to enter into discussions of schooling.  Public schools, I've gathered, are supposed to reflect some place that doesn't exist in the real world where everything is "fair," all parties are happily satisfied, and no transgression goes unjustly resolved. Ah well.

Ask:  Do you have a child/grandchild/niece/nephew in school?  How would you feel about your loved one taking a high stakes test in every grade, including kindergarten, and every subject (think art, PE, band).  Now to add to the pressure of the test, imagine that the livelihood of the adults, who have their own children, mortgages and debts, relies on the scores of those tests.  What would the day/week/month look like?  Who's best interest will be served in this scenario?

That usually does it.  If you want to explore other ways that the teachers could be held accountable, feel free.  But, without a doubt, most adults can see that basing employment on the tests taken by children, impressionable, malleable children left in a room for six to eight hours a day with a stressed adult, is a very, very bad idea.

Oh, and the last big issue?  School shootings.   There has been no debate at all on this issue with my adult friends.

We all agree that something must be done about mental illness and the easy access to weaponry.


Sunday, October 27, 2013

Begging for a "distinguished" Education that will "first do no harm"

*Remarks upon recognition as the 2013 Distinguished Alumni for Professional Achievement at Shenandoah University Alumni Weekend: 
It is with deep appreciation and humility that I thank you for this recognition. 
Thank you Dr. Fitzsimmons, members of the awards committee, faculty members who are present and especially Dr. Mary Bowser who advised me through my graduate work at Shenandoah.  I’d especially like to thank Theresa Manchey, for the introduction.  I have long viewed Theresa as a mentor of both good teaching practice and as a guide in negotiating our professional roles.
No one achieves anything without support along the way, and that is why I am especially pleased to have my family present.  My children Annie, Neil and Carolyn long endured my absences both physically and mentally as I pursued writing and teaching beyond the classroom.  Thank you so much for your patience.  My husband and partner Lynn has been most supportive by providing a safe landing at home and the freedom to follow my passions.  Also, he is a phenomenal cook and has nurtured all of us by providing endless meals.
In accepting this recognition, I cannot help but consider it as affirmation of the work that all teachers do in classrooms everyday, often going unacknowledged or recognized by the communities they serve.  So it is in behalf of those colleagues that I accept the title “distinguished.”
 I consider myself lucky to have found my calling:  I like young people and being around them day in and day out can be both energizing and fulfilling. Contrary to a widely held view, teaching is not for everyone—but for those who find their way, there is much to celebrate.

  • Teaching is intensely intellectual. The work requires the marriage of experience and knowledge, sometimes achieved on-your-feet in front of an unforgiving audience.  There is never a point in teaching when you can say “I got this.”  The target is always moving.
  •  Teaching is also intensely satisfying. Those who make it a lifelong career have a friend in every generational group. There is great pleasure in watching former students take their places as contributing adults.
  • But teaching is also intensely humiliating.  This is part of the work that every teacher struggles against on a daily basis.  We know immediately when we didn’t hit the mark.  We are aware of the students we were unable to save.  We know who we’ve reached, but also who we’ve failed.  Teachers carry the burden of failure poorly because our losses run counter to the mission of helping and serving the student.
 It is this awareness that has made the past decade extremely difficult for educators.  The high stakes testing that has taken center stage in our classrooms has been counter to what we feel creates opportunity for good instruction. 
And though the decade has been painful for teachers professionally, it has been even harder to watch as testing victimizes students.  Imagine a student who takes 32 separate high-stakes tests in the space of four years and fails every single one.  It happens.  What is learned from that experience?  It is only possible to learn one thing:  that you are a failure.  Repeated failure is often a reality for the student with the fewest resources to garner for the resiliency needed to overcome a setback.  Every failure pushes that student further from the goal, not closer to it.
The work which brings me here tonight has centered on raising the professional stature of teachers so that our classroom based knowledge is both valued and incorporated into reforms that improve rather than punish teaching and learning.  Though it has been engaging work, there is a long way to go to reach that goal. 
So it is with a sense of failure that I accept this recognition because, although the work continues, I have not yet seen the changes needed to ensure that every child is afforded the opportunity to experience success.
When that goal is reached I will feel that both my profession and the nation I live in has truly “distinguished” itself.

Thank you.