‘Surviving the Zombie Apocalypse” Exam

If you are in to pop culture, you know that the apocalypse is imminent. The only controversy is how to defend yourself against (kill) the undead. Does it take a headshot a la The Walking Dead or the Double Tap via Zombieland. Whatever it is, make sure you know the rules.

Ok, so maybe there’s not going to be a zombie apocalypse. But one thing is sure: The theories behind surviving the Cataclysm of the Undead have some things in common; The competence to think creatively, the ability to think on your feet, an expertise in collaboration and the desire to survive.

My college aged daughter is a The Walking Dead fan but definitely not a survivor. She never learned good communication or creative thinking skills. I chalk this up to poor parenting and a school system that admires skill in Math and Reading above all else.

The point of this post is that the skills needed to survive the Return of the Zombies are very similar to the 4c’s of 21st Century learning: Communication, Collaboration, Creativity, Critical Thinking. I know, there’s no ‘Communication’ in the Zombie Survival Guide but there’s also know ‘desire to survive’ in the 4 c’s. We’ll just call that a fair trade but 75% of what 21st Century learner’s need to be adept at will help them survive the Zombie Apocalypse.

Being a little older than the Walking Dead crowd, I am more in tune with the Zombieland rules. Although they aren’t all mentioned in the movie, tell me that these rules aren’t relative to 21st Century learning:

Well, maybe that’s a stretch but I hope you see my point, The skills that we need to survive the rebirth of the undead are the skills (or at least related to the skills) that we need to be teaching our students. We are a decade and a half in and we probably shouldn’t be talking about the need to teach these skills. We should be talking about how successful we are being at ingraining this knowledge base in our students. We should be talking about how we are assessing student abilities in the 4 c’s or the Zombie Survival Skills.

Since I’ve broached the idea of assessment, can anyone imagine testing these skills. Quality based assessments that would tell educators where students need to improve to be successful IN THE WORLD. Yes, I yelled that! I’ve mentioned this before and I will debate this forever: The only reason we test what we do (Math and ELA) is because it is easily quantifiable. Unfortunately the skills that students need to be successful are not always quantifiable.

Woody Harrelson would have been terrible at the PSSAs but I would definitely want him as my zombie killing partner. Think about what kind of student you want next to you when the living dead visits your neighborhood. Do you want the kid who knows all the answers on the test or the one who can fold up the test and make a weapon out of it? I know which one I will pick.

In the meantime, remember the first rule of Zombieland: Cardio – the faster you run, the further you are away from a Zombie. Wait, should that be the first rule of the PSSA?

Rich School , Poor School

Is there any question that every child has the right to the same education? I would say that education is a human right. When we talk about human rights we talk in terms of every child having equal access to a quality education. People from all sides of the argument can rally around that last statement. One side of the debate can argue that charter schools are the answer. When families have choices and competition exists, public schools will rise to the occasion. Another side will say that teacher quality is at an all time low and that is especially  relevant in low achieving schools. Obviously there are more than three sides but another legion will claim that a consistent, rigorous set of standards such as CCSS will equalize the education that every student receives.

Just so we’re clear, the people above fall into two categories: either they have have no concept of what education is like for some of our poorer citizens or they are outright liars with some kind of profiteering agenda.

According to Do Something, students who live below the poverty line have higher absentee rates, higher dropout rates and lower rates of post secondary education. In a post I wrote several months ago I compared PSSA scores to school district aid ratios. That research showed that the richer the school district is, the better chance that students will reach proficiency. That doesn’t really sound equal.

I can’t speak of all states but in Pennsylvania the funding inequities are tremendous. I know that I’ll hear that poor schools receive way more state funds than rich schools.No kidding. Spend more than a millisecond trying to figure out why that is. Poor schools, especially poor rural schools, have a very limited tax base. A limited tax base means poor local funding and I can assure you that the state does not make up that difference. That of course leads to districts surviving on a shoestring. Cutting positions that lead to larger class sizes. Cutting positions that make a difference to student achievement: literacy coaches, math coaches, reading specialists, counselors and paraprofessionals. According to a study by the Pennsylvania Education Law Center, the highest poverty school districts spend $75,000 less per classroom than the wealthiest schools. As in many other areas of our country, the privileged rich continue to flourish as the poor continue to languish.

As a human right, education should be of the same quality no matter your demographics. Students should have access to the same resources no matter their economic status. Education should aim to raise the achievement of every child not just the rich, powerful and politically connected.

What we have in Pennsylvania and across the nation is not an achievement gap, what we have is a funding gap. Rather than billionaires spending there money on influencing education policy, what if they used some of that money to equalize the funding in our impoverished urban and rural school districts.

I Was a PSSA Apologist

Back when I first got into administration in 2005, the PSSA debate was beginning to rage. The tests had recently been added to grades 4, 6 and 7 and middle school and intermediate elementary teachers were beginning to lose their autonomy. Since I had recently graduated from graduate school, I believed that the tests were necessary. I would defend the tests by saying that the state just wanted to assure that teachers were teaching what was necessary for students to be successful. They had in effect given us a blueprint of what students should learn and we just needed to follow it. I remember a parent that was making her child cram to do well on the PSSA. The idea made me laugh because I knew that the test was meant to test schools and teachers not students. Even though now that seems very much like using student as pawns, it didn’t occur to me then.

Like the most faithful of religious zealots I drank of the proverbial Kool-Aid.

After eight years of thinking more critically I realize that the PSSA is punishing students in order to determine that public schools are bad. There is way too much more going on here. Companies are getting rich by designing tests and then designing the study guides to help students achieve proficiency. That is not improving education; that is narrowing the curriculum. People with no background in education are influencing not only what students learn but how they are assessed.

I can’t help but believe that the whole convoluted mess is intentionally driving out public education in favor of for profit schools. When you see governments conspiring with lobbyists and billionaires to determine the standards for learning you have to wonder if the standards are set so that students fail. When students fail, schools fail and when public schools fail, charter and for profits are able to flourish.

There is plenty of evidence today that the America that we knew 20 years ago is gone. Everything deemed valuable must be made better through competition and profiteering. The rich will continue to get rich on the backs of the poor. In the case of standardized testing maybe the rich realize the poor have nothing more to give so they are going after their state subsidies. Assure that the poor schools fail – pretty easy because economic background seems to be the most significant indicator of test performance – and then take the money that the state would give to some run down city school and bring the poor kid to a charter.

PSSA is our example here in Pennsylvania but every state has one. Some of them more draconian than others. From the beginning, every state knew that it would not be possible to have 100% of the students be proficient by 2014. Now 2014 is right around the corner and panic has set in. PDE has withdrawn the modified test for special education students assuring that the percentage of students making AYP will decrease. Don’t worry, the charters will take your special education students at a 100% mark up.

I apologize for being a defender of the PSSA. Now people must act.

Trust Me ;)

“Integrity has no need for rules.” -Albert Camus

This week the graduate program led us to the topic of trust in the workplace. In my estimation there probably couldn’t be a timelier subject for educators. Not sure that it is the same everywhere but trust is no where to be found in the Pennsylvania Department of Education. I had an unfortunate conversation last week with a teacher in our building. Noticing that the implementation of the PA Common Core Standards had been pushed back a year, he wondered if it was due to the new teacher evaluation and PDE thinking it may not be fair to evaluate teachers on an assessment that contained new content. I laughed out loud. I wish I would have held on to some of that naivete that allowed me to think that PDE had the best interest of teachers and schools at heart. I say it was unfortunate because I probably should have held back but I didn’t. I assured him that if PCC was pushed back it had nothing to do with teachers, it probably had to do with money. I had lost my trust in my “employer.” Not that I work directly for the PDE but don’t all of us answer to their mandates?

I don’t believe my distrust is misplaced. Recently the Bureau of Assessment  the long arm of the PSSA, determined that beginning this year, all teachers who administer or proctor the standardized assessment will be trained by a computer module that will be completed online. This job was previously completed by the building principal or school assessment coordinator. Apparently there is no trust in the way that was being completed. (Read: we are all cheaters or at best half-assed at our jobs). In addition we received a communique from PDE telling us exactly how we must discipline our students if they are caught with cell phones during the PSSA or the Keystone Exams. You know, because if they don’t tell us, we don’t have the capacity to use our common sense. They don’t trust the administrators who are responsible for the results.

One more, just for good measure. Currently in New York and California administrators must undergo “calibration” training sessions in order to assure that there is interrater reliability when using the Framework for Teachers. Oh, how I wish I was kidding. It’s coming to Pennsylvania too if it is not already here. You should read the article in the link. I don’t think I can explain it any better.

I know what you’re thinking: “What’s so bad about making sure that everyone is seeing the same thing?” Well, the problem is that we do this everyday. We have a vision for our school and believe it or not we work hard to make sure that we have the best schools that we can have. We definitely don’t need a non educator telling us how it should be. Bill Gates is an extremely intelligent guy but he never spent a day with 30 teacher and 500 kids. He is the hero of calibration. And we feel like the trust is gone. 

I could go on. Tom Corbett’s assault on PSERS not to mention education funding in general. Michelle Rhee’s, another non educator, report card for public schools. Jeb Bush’s Cheifs for Change, Arne Duncan’s Race to the Top and his RESPECT Project. Corbett is the only teacher in the group and the knew pretty early that he couldn’t do the job. There’s not even any indication on the PDE website indicating that Secretary of Education Ron Tomalis ever taught. But why does that matter, Arne Duncan never taught.

Trust? Trust who? It does make sense to rebuild education from the outside. I would want a lawyer telling my doctor how to improve my health and the doctor would be a great help in expanding the mechanical capacity of my mechanic. I think the dentist should critique the local cop during a ride along or may he can go with the fire company. 

Like my grandfather used to say, “You can trust a dog to watch your house but you can’t trust him to watch your sandwich.”

Prisoners of Bureaucracy

I started graduate school this week so the posts may get thin over the next several weeks. The advantage is that I’ve found a lot of inspiration from my reading so I’ll have ideas built up when I have time to write.

This week I ran across a quote about being an educational leader today is akin to waking up in a maximum security prison and saying, “What am I going to do today?” The comparison is simple, if you are a prisoner you have two choices: follow the rules or be punished. Similarly it seems that school leaders – teachers, principals, superintendents – have them same choices: follow the mandates or be punished. On a larger scale, schools and entire districts are also prisoners of the test-well system.

I’ve written about it before and I will probably write about it again. In a system where the only thing that matters is how you score on one standardized test is the standard that determines excellence, educators must decide whether they will teach to the test or whether they will choose to expand the knowledge of their students by instilling the desire to learn. These are not the same thing. I’ve told teachers for several years that I could guarantee we could be 100% proficient in two years. I know how to do that. We have all the tools: great teachers, great kids, supportive parents, better than average socioeconomic standing, etc. The trade off that we would have to make is whether we want to solely “teach to the test” or do we want to continue to do the things that have brought us to the level of success that we have already achieved? Our school believes it has the ability to transform from a good school to a great school but we also believe that the measuring stick of greatness is not a percentage of proficiency determined by someone other that us.

One of my large projects for my graduate class is to come up with a plan to address improving student achievement using the Getting Results Template. The Getting Results Template is what schools in school improvement are required to complete as part of their school improvement plan. I think I may blow someone away. I can right an excellent plan for improving but I think at the end I will tell them how I really feel. Like a prisoner of bureaucracy.

Pork Chops, Electric Shock and PSSA

Let’s just say that I am developing a simple experiment. I want to find out which one of my kids that my dog likes best. Here’s the experiment: both of my girls stand 20 feet away from the Fletcher, the dog. They aren’t aloud to call him, they are just aloud to stand there and see which one he comes first. Pretty simple and probably unscientific but it will work to prove my point. Would anyone out there say that my experiment was flawed if I put a pork chop in one of the girl’s pocket? Adding an unrelated incentive would make my entire experiment invalid. Is that what your saying?

OK, then, let me change my experiment. This time, both girls standing 20 feet away only in front of one of the girls is standing outside of my invisible fence – you know, the kind that shocks the dog when he tries to run through it. What? You don’t think I’m validly determining which girl the dog likes best. I can’t believe that!

They do it on the PSSA! Rewarding schools for improving performance as well as punishing school districts who aren’t successful is the same experiment. If the test is to determine what students know and are able to do, don’t positive and negative incentives based on scores invalidate the results? If I’m handing out five dollar bills to every student who scores proficient or if I ‘m closing schools that don’t meet minimum standards am I not putting pork chops in some pockets and using electric shock on the others?

What happens is that the most important thing becomes the test. It doesn’t matter how we got there as long as the scores are there. All actions then are determined and justified by the test. The ends justify the means. And the means usually include cutting time on other academic subjects and can extend all the way to removing administrators.

Not much of a valid test environment.

Keep Your Art Out of My Science

A couple of decades ago while earning my bachelor’s degree in education I recall a professor asking whether we thought that teaching was an art or a science. At that time it was a pretty good debate for a bunch of 19 and 20 year-olds.

Whether we like it or not, there really no longer is a debate about how teachers are expected to teach. Art is no longer appreciated or rewarded. Science – data, pre-made assessments, canned lessons and are I say teaching to the test – is the expectation. There really is no time or necessity to be creative when there a finite number of objectives to accomplish. Sure, you can feel free to address those standards in any way you like! Or can you?The list of expectations for teaching behavior from lesson planning to classroom management to instructional delivery to professional behavior have been spelled out in detail. This is what great teaching looks like!

You understand in order to make the expense of public education justifiable, it has to be boiled down to a number. A number that Joe Average Citizen can comprehend. In order to get to a number you have to have a measurable product. In order to have a measurable product you have to have a concrete tool with which to measure. You can;t have a lot of loose ends that aren’t part of the accepted equation. Too messy.

Teachers in turn feel the pressure to reach some agreed upon number from the ivory tower and do exactly that. Believe me, it is hard to distinguish the standardized testing scores of students taught by teachers who teach straight out of the book and teachers who spend hundreds of hours planning and tweaking lessons. It’s crap.

It’s crap because the test doesn’t measure heart, caring, passion. It doesn’t measure wiped noses and concerned phone calls. There isn’t a tool that can tell Joe Average how many tears are shed over the frustration of language poor and money poor families or the miles of exercise that it takes to relieve the stress of unsupportive parents and less supportive agencies.

That my friends is science. Specific, Measurable, Trackable. Rows of students who might as well be bolting together widgets and sending them down the line.

The problem is that because we don’t reward artistry in our education system, our teachers don’t know how to encourage artistry in their classrooms. When we tell teachers that their jobs depend on making the score, the consciously or subconsciously project those fears onto their students. “No, I can;t let you explore how we came to use standard units instead of metric units, that will take too much time and we have to get to fractions before the PSSA. You just need to know that they are different.”

This is in my estimation the core of the problem in education. The rule followers prevail and the rule challengers fail. From kindergarten through to college, the students who can regurgitate some information in paper and pencil are bound for greatness. The artists will struggle because we can;t quantify what they are capable of. There are many examples of creators who were “poor” students in the eyes of their teachers but went on to do great things. These are the resilient artists. Those that rose above the square peg problem to find a square hole.

Our concern needs to be with the artists who aren’t resilient. The square pegs who, if they are lucky enough, will be able to balance themselves on top of the round hole – stuck in far enough to stay – and hide their artiness in the name of societal norms. And for those who aren’t crafty enough to fake it or resilient enough to overcome, what will become of them? 

Epilogue: Rockin’ the Suburbs

Last week I blogged a little about PSSA scores and the false impression that we are testing children when a great deal of what is attributed to “good teaching” can be equally attributed to demographics.  Remember that the rich, suburban schools near large cities in Pennsylvania do very well on the PSSA and the poor, urban schools do extremely poor.  These results are independent of any connection to the percentage of minorities in the school district.  School districts with a relatively high percentage of minorities do just as well as school districts with a minimal percentage of minorities.

So why do suburban school districts do so well?

My theory:  When school districts began to be rated as poor or low achieving, people of means left the city in droves to schools that were already doing well.  The schools in the suburbs.  The shift in affluence from the cities to the suburbs meant that the city school went from below average to dismal and the schools in the suburbs went from above average to pretty near phenomenal.  The highly educated who worked in the cities felt it oput their children at a disadvantage to have them schooled there.

But why does richer equal smarter?

I don’t necessarily think that it does.  What affluence does provide though is experiences.  Experiences at a young age put beginners at a great advantage over students whose experiences are limited.  Students who have been to the zoo, the museum, even a ball game have more experiences than students that never get off their street. That early advantage builds through the primary grades as students of means continue to have experience rich lives. That’s not even mentioning the next level of students who have been to Disney World, Yellowstone or even Mexico.  Think of the experiences that those students take for granted that a student who lives in a 500 square foot apartment never has.

Another factor, and I think the biggest implement to achievement in the early years, is language poor homes.  Vocabulary is the key to all learning.  People of means go to college.  People of tremendous means go to college even if they aren’t smart enough. Whether you earned it or not you were exposed to an enormous new vocabulary and you use that vocabulary in the home.  Even though developmentally children may not know what those words mean, they have been exposed to them.  Exposure puts them one step in front of the child with uneducated or undereducated parents.

One more because I like things in threes:  If you are affluent and have gone to college chances are you work a 9 to 5 job.  Nine to 5 parents are home.  Parents who are home have the opportunity to spend more time with their children. Exposing them to more experiences, more language and reading.  Reading to your children is important but you have to be home to read.

In this whole post, I’m not saying it’s impossible to be a high achiever if you come from a poor, language poor, experientially vapid home.  What I am saying is that it takes work.  Keep in mind that if you are 6 months behind your peers in kindergarten you will have to make 10 months worth of growth in 9 months every year until the end of fifth grade to catch up.  That is unlikely but not impossible.  Students rise above their circumstances all the time.  Those are the students who should be applauded at graduation.  The students who made a 2.0 under the toughest of conditions not the one’s who made a 4.2 with a silver spoon hanging out of their mouths. (Sorry, lost my focus there)

My point is, it’s a snowball effect.  Your school is deemed low-achieving by a single test, if your school is low achieving the people who can move out will, the people who move out will take with them strong experiences and rich vocabulary, with the loss of your high achieving and average students your schools scores will continue to decline.

Can Money Buy Proficiency?

A week or so ago I published a blog post boldly stating that you could probably sort districts by their aid ratio from high to low and get a pretty accurate projection of how their PSSA reading and Math scores would look.   One of my loyal readers, Rogue Anthropologist, inquired about whether any such research was available.  Being interested in statistics and more so probabilities, I set out to determine how accurate my blurted out hypothesis had been.

What I found was not an exact, one to one correspondence but it is pretty telling. Using 2012 PSSA scores in reading and Math and district aid ratios (AR) for 2012 I was able to get a pretty good picture of district scores in relation to the economic status of the community.  I do want to go on record as saying this isn’t a statistical analysis.  It is a collection of facts based on the data.  I also want to clarify that when I talk about making Adequate Yearly Progress (AYP) I am talking about what we call in education “making the number.”  In other words I did not take into account whether districts made AYP using confidence interval, Safe Harbor, Growth Model or a combination of any of the above.  I simply used 78% for math and 81% in reading – “the numbers.”  Also, I will note that I used only district totals not individual schools.  For example, Central Dauphin School District is lumped together although it is made up of many different schools including two high schools.  As well, the Philadelphia and Pittsburgh school systems were grouped as one district.

I took all of the school districts in the state and order them from lowest AR (.1500) to the highest (.8814).  I then divided the entire lot into quartiles.  There are 500 school districts in the state of Pennsylvania.  I eliminated one, Bryn Athyn, because they don’t actually educate any students in their district.  Look it up!  It’s pretty interesting.  So, of the 499, since I was looking primarily at the top and bottom quartiles, there were 249 in the middle two quartiles and 125 in the top and bottom.

In the area of Math statewide 62% of the school districts made AYP.  That is important to know as a yardstick for the rest of the data.  School districts in the top quartile according to their AR made AYP 90% of the time.  Conversely, schools in the bottom quartile only made AYP 26% of the time.  That means that a rich school district is about three and a half times more likely to make AYP than a poor one.  To take it a step further, the schools in the top two quartiles – I gave them number 250 – made AYP 80% of the time while the schools in the bottom half made AYP only 42% of the time.

On the Reading PSSA only 28% of the school districts statewide made “the number.”  That seems to have really skewed the numbers based on AR.  In reading only 2% of the schools in the bottom quartile made AYP.  Of the top quartile school districts 70% made AYP.  Some of this in my professional opinion can be attributed to poor households being more apt to be language-poor and those students tend to come to school with fewer background experiences.  When you look at this information as a 50/50 split, the bottom half of school districts only made AYP 8% of the time and the top half made AYP 48% of the time.

There are of course exceptions to every rule.  Windber Area School District and Cambria Heights School District made AYP in both subjects despite ARs of .7324 and .7241 respectively.  Inversely, 14 school districts did not make AYP in either subject even though their ARs ranked in the top quartile.  Pequea Valley School District had the lowest AR of any school not to make either number; .2554.

In addition to economic indicators, I was also interested in determining other factors rather than the quality of teaching that may determine performance on the PSSA.  Research has been done about how the education of the mother impacts achievement.  When I look at that statistic I tend to think that it leads back to the affluence of the family.  Students in privileged circumstances would more likely have two highly educated parents than students living in poverty.

One thought that I have heard, and this is probably do to the poor performance of Pennsylvania’s urban areas, is that the percentage of minorities in a district has an impact on achievement and PSSA. The data on the percentage of minorities in a district is interesting but not very conclusive.  In the area of Math school district that have 10% or greater minorities were proficient 50% of the time (remember that the entire state only had an AYP rate of 62%).  On the opposite end, only 57% of the schools with 2.5% or fewer minorities achieved the 78% threshold.  In Reading the discrepancy is greater but weighted towards the districts with a higher number of minorities, with 33% of school districts with 10% or more minorities making the 81% necessary for AYP and the school districts with 2.5% or fewer minorities making AYP only 13% of the time.  Bear in mind that statewide only 28% of school districts made AYP in the area of Reading.

At the behest of my superintendent I also looked at scores based on the size of the school district.  This is a tough measure when used for measuring the entire district.  The reason being is that the statistic does not take into account the size of individual schools.  For instance the Pittsburgh Public School System, the second largest in the state, has nine high schools to serve 6000 students and the School District of Philadelphia, the largest school district in the state, has 55 high schools to serve roughly 38,000 students.  With those kinds of numbers it is possible to have some high school s doing very well and some high schools doing very poorly.  Anyway, here’s what the number say:  When broken down into quartiles, the top quartile – the largest schools – were proficient 45% of the time in Reading and 71% of the time in Math.  Thirteen percent of schools in the fourth quartile were proficient in Reading and 50% in Math; much to the chagrin of my superintendent.  I’ll have some good news though for him as our district broke many of the rules.

At this point it looks like rich, white – but not too white, large schools have a decided advantage in my personal; race to the top.  Let’s look a little closer though.  Where exactly are the schools that are making it and does that have any impact on their goal of Proficiency?  Well, I’m glad you asked.  There might just be a link.

The National Center for Educational Statistics breaks down districts into categories based on where they are located, how close they are located to a city and the size of the city within the nearest proximity.  Following is the data that I collected on those categories:

  Example Number #Proficient-R %Proficient-R #Proficient-M %Proficient-M
Small City Reading 13 2 15 3 23
Mid-sized City Erie 2 0 0 0 0
Large City Pittsburgh 2 0 0 0 0
All City   17 2 12 3 19
             
Suburb of large city McKeesport 165 78 47 107 66
Suburb of mid-size city Harbor Creek 21 8 38 18 86
Suburb of small city Pottstown 19 12 63 7 37
All Suburb   205 98 48 132 64
             
Distant Town Huntingdon 36 0 0 11 42
Fringe Town Brownsville 74 16 22 47 50
Remote Town Dubois Area 10 1 10 6 60
All Towns   120 17 15 64 58
             
Distant Rural Twin Valley 85 9 11 47 55
Fringe Rural Yough 77 19 25 48 62
Remote Rural Galeton 12 0 0 5 42
All Rural   174 28 16 100 57

As you can see from the data, it is definitely a benefit to live in a suburb especially the suburb of a large or mid-size city.  Those two categories along with the All Suburb categories were the only categories to have a higher percentage of district proficient than the state averages listed previously.  The worst place to live and therefore go to school is obviously in the city with the lowest percentages of all groups.For more information on what each of these categories mean see the NCES website.

With a little dime store analysis you can determine why the suburbs do so well.  Or at least generate an additional hypothesis.

For the conclusion of my hypothesis, without formal statistical analyses, I would say that I was pretty close to accurate.  More affluent school districts are almost three and half times more probable to be proficient on the Math PSSA than their poorer counterparts and more than 35 times more probable to be proficient on the Reading PSSA.  Put another way:  if you live in the top quarter of the wealthiest district in the state your child’s school will have a 9 in 10 probability of being proficient in Math and a 7 in 10 probability of being proficient in Reading.  In opposition, districts that comprise the poorest quarter of all Pennsylvania districts will have a 1 in 4 probability of being proficient in Math and a 1 in 50 probability of being proficient in Reading.  As AYP expectations go up in 2013, to 91% in Reading and 89% in Math, look for those numbers to change.

False Proxy + False Proxy = Your Life

Inspiration to write can come from a lot of places. For me it comes quite often from Seth Godin‘s blog and a friend who goads me into connecting his work to education.

Today Mr. Godin blogged about false proxy traps. You can check out his blog for details. In a nutshell a false proxy is when a someone measures a component of something that is difficult to measure in order to justify the entire product. Good example: measuring the quality of a police force by how many people are put in jail. This measure would not take into account that a good police force may limit crime by there mere presence or that they are exemplary at solving problems. Crazy example: measuring the power of the Republican Party by watching Fox News exclusively.

Everyone may not agree but the forced high stakes testing required by NCLB is just such a trap. The idea of the testing program is to determine the quality of a school and its staff. Make no mistake about it. These tests, differently labeled in each state, were never meant to test the knowledge of students. The false proxy comes in when we try to take one test, administer it to thousands of students, and then compare them across a wide breadth of cultures, economies, and immeasurable demographics. My guess is that a district’s aggregate PSSA score can just as accurately determine the median income of the school’s coverage area as it can the success of the school. They could also pretty accurately determine the number of parents who attend parent conferences. The first thought would be easy to prove. Take every school and list them from high to low based on aid ratio (market value/personal income) and then make another list and sort them from low to high on district average PSSA score. I’d be willing to bet there is a high degree of comparability. It’s all public knowledge; give it a whirl!

So, I think we have shown pretty accurately that the PSSA is a false proxy for determining the quality of a school. Don’t get me wrong; some teacher’s should find a new career path. But I can compare scores of teacher’s that I work with who have abilities that are across the board in terms of quality instruction and the one’s that have limited skills have students who do just as well as the distinguished teacher’s students.

Second false proxy: The new Pennsylvania teacher evaluation model. This is even simpler. Charlotte Danielson developed this model to assist in improving the quality of teaching. Never, and the company developing the evaluation tool for Pennsylvania has admitted this, did she intend for the rubric to be diminished to a number. Statistically speaking, you can’t take a measure that is qualitative and quantify it. That is, however, what the Pennsylvania Department of Education intends to do. A tool built to determine the strengths and weaknesses of a teacher and guide him or her to being a distinguished educator will be used to measure his or her effectiveness.

Not only will it water all of this high quality information down to a single number but that number will count as 50% of a teacher’s – and eventually an administrator’s – annual evaluation. Throw in that another 15-30% of the annual evaluation will be determined by PSSA scores and you have a conglomeration of false proxies and statistical fallacies. Goog luck! Two years of low scores and poor observations or probably two years of average observations and average PSSA scores and you may be looking for a job – and me too!