The Limits of Educational Software

So if you control for the variables you know help students achieve, your study of (fill in the blank) shows no significant gain due to (fill in the blank). In this case the blank is filled by the darling of grant funders everywhere, technology, specifically education delivered by computers.

For the second year in a row, a controversial $14.4 million federal study testing the effectiveness of reading and math software programs has found few significant learning differences between students who used the technology and those taught using other methods.
...snip...
“These studies are intended to wash out all the variation in school environments, teacher quality, resources­—all the things that we, in fact, know make a difference when it comes to student learning,” said Margaret A. Honey, a technology expert who is the president of the New York Hall of Science.

In other words, students who do well with the educational software were doing well anyway, probably because of the school environment or teacher quality or other known predictor of student achievement.

Technology is way over-rated. Consider the mathematical concept of place value. Teachers can design an activity that involves students boxing objects into groups of ten, and then packing ten boxes into a case, then stacking ten cases on a crate. I have such an activity with pinto beans. Students keep a columnar tally as they fill each “box” with beans. One rule of the game is that there can be no partially filled boxes, cases, or crates.

Subtraction is modeled with the same manipulatives. Students must often unpack a crate or a case or a box do complete the subtraction. If, for example, students must open a case in order to subtract boxes, they must empty the case entirely and stack all ten boxes with however many full boxes they already have, all the while keeping a columnar tally. If students have 2 crates, 4 cases, 3 boxes and 6 loose beans and want to “fill an order” (subtract) 4 boxes, they must empty a case. Now they have 2 crates, 3 cases, 13 boxes and 6 loose beans. We do not worry about conforming to the standard algorithm when we model on paper the actual mathematics of the task.

I once had a group of education students do the same activity on computer using a Java applet. Among other features, the applet used a rope tool to surround 10 loose objects and a box tool to pack into full boxes. I asked the students to compare the educational soundness of each activity. They quickly observed the “magical” aspect of the computer version. The concrete activity was real. Students could easily see how boxes were filled because they physically filled the boxes. The computer converted a lassoed group of objects to a box by some mystical means. At least, it may seem mystical to a child of the target age group.

Computers compromise sensory experience. No matter how 3D the graphics, the display is essentially two dimensional relying almost exclusively on the visual. Brain scientists might say the concrete activity forms more neural pathways by utilizing more of the five senses.

Paradoxically, some computer animation looks amazingly real. I often wonder how unhealthy a reliance on computers might be. At least in the days of Captain Kangaroo, small children could easily distinguish the real from the unreal. At a age when children are known to confuse reality and fantasy, can it really be a good idea to deliberately smudge the line between the two? Could computer animation undermine the development of analytical ability when the child's own senses cannot be trusted? When painted pictures of squirrels on cardboard placard danced around on Captain Kangaroo, no child was led to conclude that squirrels actually do hip-hop. The cardboard squirrel was obviously unreal. Can the same be said for the squirrel in the famous commercial doing a fist pump after causing a car accident? Will our children think less critically and be more vulnerable to scams?

Charter School Misconceptions

A post about charter schools is sure to scare up the usual litany of misconceptions. As long as ideology drives the debate, then nothing anybody says matters. Each ideologue cherishes their own set of misconceptions.

Charter schools are private schools, or at least, a variation on private schools. Less money goes to public education when charter schools are operating, with the result that public funding can be reduced.

The word “public” in the phrase “public school” means publicly funded. Parents do not pay tuition. In fact, charters schools sponsored by a public entity such as a traditional public school or the county office of education, usually operate on 85% of the per-pupil funding of the traditional public school. The sponsoring entity retains 15% of the funding, ostensibly to pay for stuff charter school parents do not use, such as busing. Some of the 15% also pays for support, such as having the charter school payroll handled along with the payroll for the public entity.

Critics of charter schools recognize the public nature of charter schools when they worry that a churchgoing principal of a charter school is deceptively running a private religious school on the public dime. No one similarly charges the churchgoing principal of a traditional public school. Now I will admit that some founders may have hoped that they could get public funds for their private religious schools by going charter. Even if they successfully secure their charter, the religious aspect immediately goes by the wayside. Typical religious private or parochial schools have weekly chapels; charters cannot.

Charter schools do not have to accept every student. Public schools must take everyone.

The charter for every single charter school by law must contain the standard non-discrimination clause. Many states mandate the exact language of this clause. Charter schools take every student they can on a first-come, first-served basis. Some fortunate charters have waiting lists, but most take all comers. Their funding is based on enrollment numbers just like traditional public schools. Would that our public schools were as desirable as the need for a lottery at some charters indicates.

Charter schools “skim the cream.” Charter schools can expel disruptive students. Public schools cannot.

Public schools routinely kick out extremely disruptive students.  My local school board has expulsion hearings about twice a week.  Because actual expulsion would put the expelled students on the street with way too much free time, such students are not actually expelled in the classic sense, but are sent to alternative education, community schools, the county independent study program or charter schools. Some charter schools specialize in these students.

Charter school are less likely to offer special education services because it costs too much money and the schools are too small.

I do agree that there are fewer special services.  Yet charter schools may have special ed teachers, and if an aide has been assigned to a student, the aide will accompany the student to charter school classes just as readily as to classes in a public school.  Public schools, while providing many more social services than when I was a child, are failing to provide other basic services because of cost.  The most conspicuous example is the school nurse.  In my day, every school had a full-time nurse who had her own office with a couple beds.  Today, one nurse may be responsible for multiple schools.

Charter school teachers are unprepared and unqualified. If qualified, they tend to be inexperienced novices because charter schools pay less than traditional public schools.

What every teacher knows is that public schools tend to hire newer, less experienced teachers over more experienced teachers because of cost. What often happens is that the more experienced teachers will work at a charter school for less pay. Such a situation happens when teachers move their household to a new district. These out-of-district teachers find themselves virtually unemployable in the public schools.

Most credentialed private schools require their teachers to be certified if only to avoid paying the fine for hiring uncertified teachers. I have seen private schools lay off uncertified teachers for the year they are renewing the schools credential. I have also seen private schools pay the fine as the cost of keeping an excellent uncertified teacher.

Half of the teaching staff of many urban or rural traditional public schools may be uncertified. Funny thing is certification is a very poor predictor of teacher quality. Certification only certifies the teacher has completed the state-mandated indoctrination, usually at a college of education. Most colleges of education give short shrift to proven educational philosophies such as Montessori or Waldorf, among others.

Charter schools lack oversight and accountability.

I also agree that sometimes oversight can be a problem. Regardless of the official accountability mechanisms in place, practically speaking, parents handle academic oversight ad hoc. They expect results for their extra effort, or they pull their children. Some charter schools have had their charters pulled for financial hanky-panky.

Charter schools cheat on tests so their scores will look good.

In the beginning charter scores tended to be better than the traditional public schools. Over the years considerable regression toward the mean has occurred so that now there is no significant difference in scores on the aggregate. Teaching to the test plagues charter schools AND traditional public schools.

The existence of charter schools threatens the existence of traditional public schools.

Charter schools are public schools.  If traditional public schools want to diffuse the so-called threat of charter schools, they could do so by providing a superior alternative.  If parents thought they were getting a superior result in the traditional public school, they would not expend the extra time, effort and personal cost to send their children to a charter school. They would happily send their children to the local public schools.

But most parents do not have the luxury of, in their perception, sacrificing their child's short window of academic opportunity to political or ideological considerations.  If motivated parents believe the local traditional public school compares unfavorably to the local charter school, it is quite understandable they would choose the charter school or even other alternatives, such as private schools, or homeschooling.

There are excellent traditional public schools and there are failing traditional public schools. And there are merely satisfactory traditional public schools. There are excellent charter public schools and there are failing charter public schools. And there are merely satisfactory charter public schools. As Dr. P.L. Thomas observed, "Evidence on charter schools, public schools, and private schools all produce a RANGE of quality. There is no evidence that "charterness," "publicness," or "privateness" is the reason for any differences, be it positive or negative." Here is another effort to debunk the persistent myth that from the beginning the entire purpose of charter schools has been to destroy public education.

Charter School Good News, Bad News

A new study of charter schools will vindicate some and disappoint others.

In the last seventeen years since the first charter school opened in 1992, 4000 charter schools educate over one million students. So far most studies have managed to harden preconceived notions.

Supporters argue that charter schools can improve student achievement and attainment, serve as laboratories for innovation, provide choice to families that have few options, and promote healthy competition with traditional public schools (TPSs). Critics worry that charter schools perform no better (and, too often, worse) than TPSs, that they may exacerbate stratification by race and ability, and that they harm the students left in TPSs by skimming away financial resources and motivated families.

The study sought to answer four questions:

(1) What are the characteristics of students transferring to charter schools? (2) What effect do charter schools have on test-score gains for students who transfer between TPSs and charter schools? (3) What is the effect of attending a charter high school on the probability of graduating and of entering college? (4) What effect does the introduction of charter schools have on test scores of students in nearby TPSs?

Characteristics of Charter School Students

Charter schools do NOT skim the cream.

We find no systematic evidence to support the fear that charter schools are skimming off the highest-achieving students. The prior test scores of students transferring into charter schools were near or below local (districtwide or statewide) averages in every geographic location included in the study.

...snip...

...students entering charter schools often have pretransfer achievement levels lower than those of local public school students who have similar demographic characteristics.

My own experience with charter schools supports the study's finding. Many parents pull their children from the traditional public school and enroll them in a charter school precisely because their children are not doing so great. Far from picking and choosing their students, charter schools will accept every child. In fact, the charter school law of most states requires charter schools to include in their charter document language that explicitly forbids exclusion on all the typical grounds.

Effect on Test-Score Gains

Because the study's authors could not locate baseline scores for kindergarten age children, they hesitate to overgeneralize. They have more confidence in data gathered from charter schools that begin accepting students at later ages.

In five out of seven locales, these nonprimary charter schools are producing achievement gains that are, on average, neither substantially better nor substantially worse than those of local TPSs.

Older studies consistently found superior results for charter school students, but those studies may have been flawed, or the exploding growth of charter schools has been accompanied by that bugaboo, regression toward the mean. Poor performance of charter school students has been associated with virtual delivery of education, but the authors have no confidence in forming any generalizations. More work must be done to identify possible idiosyncratic characteristics of students or their parents who choose virtual delivery. The educational implications of the technology itself also merit further research.

Likelihood of Attending College

Charter school students are significantly more likely to attend or graduate from college than students from traditional public schools. Given the flat difference in test scores, perhaps parents of charter school students have higher expectations for college attendance. Certainly, charter school parents are more likely to have invested substantial time and effort in their children's education, if only the daily grind to drive the kids to school every day.

Charter schools do not necessarily have to provide the one-stop comprehensive education experience usually expected of a traditional public school. Parents often make the extra effort and pay the extra expense to supplement the charter school program.

Charter School Effect on Neighboring Traditional Public Schools

None, one way or another.

There is no evidence in any of the locations that charter schools are negatively affecting the achievement of students in nearby TPSs. But there is also little evidence of a positive competitive impact on nearby TPSs.

Charter schools receive money on the same basis as traditional public schools—according to enrollment. What may surprise some people is that charter schools are often required to educate their students on 85% of the public funding allowed per child enrolled. The other 15% goes to the sponsoring school district supposedly for infrastructure costs that do not benefit the charter school. An example of an infrastructure benefit the charter school does receive may be payroll services for its employees. An example of an infrastructure benefit the charter school does not receive may be school bus service. The charter school must pay a share of the transportation costs even though none of its students takes the bus.

I know of situation where, at one time, the sponsoring traditional public school had 150 students while its charter school had 600 students. Thus the traditional public school got funding as if they had 240 students without the costs of the additional 90 students (6.67 charter school students equals 1 traditional public school student). Mountain Oaks Charter School started out as the independent study department of the Calaveras County Office of Education.

The researchers identified possible shortcomings and recommended further research.

Finally, one of the most important implications of our work for future research on charter schools is the need to move beyond test scores and broaden the scope of measures and questions examined. Our estimates of positive charter-school effects on high-school graduation and
college entry are more encouraging than most of the test score–based studies to date (including our own test-score results). Future studies of charter schools should seek to examine a broad and deep range of
student outcome measures and to provide evidence on the mechanisms producing positive long-term impacts.

No Surprise Algebra-For-All Fails

“Algebra-for-All Policy Found to Raise Rates Of Failure in Chicago”

Math educators, with good reasons, have long recommended that students be required to study algebra. Many districts mandate algebra in the ninth grade. California, one-upping everyone else, currently requires eighth graders to take algebra. Japanese children begin studying algebra in the fifth grade. So how's it working out?

Findings from a study involving 160,000 Chicago high school students offer a cautionary tale of what can happen, in practice, when school systems require students to take algebra at a particular grade level.

160,000 is a lot of students, and normally the bigger the sample from the population, the more reliable the conclusions. Researchers studied eleven “waves” of students entering ninth grade from 1994 to 2005.

(Researchers) compared changes within schools from cohort to cohort during a period before the policy took effect with a period several years afterward. They also compared schools that underwent the changes with those that already had an “algebra for all” policy in place.

What did the researchers find?

The policy change may have yielded unintended effects, according to researchers from the Consortium on Chicago School Research, based at the University of Chicago. While algebra enrollment increased across the district, the percentages of students failing math in 9th grade also rose after the new policy took effect.

By the same token, the researchers say, the change did not seem to lead to any significant test-score gains for students in math or in sizeable increases in the percentages of students who went on to take higher-level math courses later on in high school.

Not much upside. More students failed, test scores were flat, and the percentage of students motivated to take advanced math course did not rise, but, gee, “algebra enrollment increased.” The district says more students will fail when required to take harder courses without supports in place. Yet the district made attempts to include supports over the last seven or eight years.

Steps include developing curricular materials introducing students to algebra concepts in grades K-8, requiring struggling 9th graders to take double periods of algebra, and providing more professional development in math to middle and high school teachers..

One of the researchers thinks that test scores did not improve because teachers may have “watered down” the content since “math classes included children with a wider range of ability levels following the change.”

But Japanese elementary schools are not tracked. All children study exactly the same material with such predictability that some observers have quipped that every child in Japan is on the same page of the textbook on any given day. I have successfully taught Algebra 1 to high school special education students, or to give due credit, special education students have successfully learned Algebra 1 under my guidance.

The problem is with issuing mandates without a coherent, integrated societal commitment to the foundations of education, mathematics in particular. I have seen Montessori preschool students exploring algebra with manipulatives. I have often said that lots of profound math can be learned without any resort to pencil and paper. Children do not necessarily need numerals to understand number.

There is one other thing. Japanese children from kindergarten age regularly take abacus lessons the way American children take piano or ballet. Generating a sum with the abacus is different than generating a sum using the written algorithm. The very process of thinking about number and computation in more than one way leads to greater mathematical flexibility. Japanese students can therefore more readily absorb and manifest algebraic thinking. That's my hypothesis anyway and maybe the Gates Foundation or somebody else will provide me a grant to test it.

“The future belongs to the nation that best educates its citizens.”

President Obama gave another stirring speech about education. Is it just a lot of yadayada?

America will not remain true to its highest ideal... unless we give them the knowledge and skills they need in this new and changing world.

For we know that economic progress and educational achievement have always gone hand in hand in America...

The source of America's prosperity has never been merely how ably we accumulate wealth, but how well we educate our people...

So let there be no doubt: The future belongs to the nation that best educates its citizens -- and my fellow Americans, we have everything we need to be that nation...

The relative decline of American education is untenable for our economy, it's unsustainable for our democracy, it's unacceptable for our children -- and we can't afford to let it continue...with the right education, a child of any race, any faith, any station, can overcome whatever barriers stand in their way and fulfill their God-given potential.

(bold added)

But the president is not blinded by his own dazzling rhetoric. He knows what all veteran educators know.

Of course, we've heard all this year after year after year after year -- and far too little has changed.

It is easy to lose optimism and fervor.

Certainly it hasn't changed in too many overcrowded Latino schools; it hasn't changed in too many inner-city schools that are seeing dropout rates of over 50 percent.

Even more maddening, the problem with education in America is not scarcity of ideas and resources.

It's not changing not because we're lacking sound ideas or sensible plans -- in pockets of excellence across this country, we're seeing what children from all walks of life can and will achieve when we set high standards, have high expectations, when we do a good job of preparing them.

So what is our problem?

Instead, it's because politics and ideology have too often trumped our progress that we're in the situation that we're in.

A good example is the kneejerk opposition to charter schools on the left, and the equally kneejerk opposition to teachers unions on the right. While adults engage in turf wars, America falls further and further behind. We must set aside ego and listen to each other with open hearts.

Secretary Duncan will use only one test when deciding what ideas to support with your precious tax dollars: It's not whether an idea is liberal or conservative, but whether it works.

But in the meantime, it would not hurt to unify behind the President's top three priorities for education:

1.Early Education—It is essential that foundations for future academic achievement be solidly laid in early childhood. The attitudes children acquire at a very young age can propel or hinder academic achievement.
2.World Class Standards—American do not give their children enough credit. It is possible to have much higher expectations and standards without destroying childhood. In fact, higher standards, well done, have the potential to enhance childhood.

Several years ago I began facilitating biology and chemistry laboratory experiences for homeschooled junior high and high school students. Moms tried to occupy the younger siblings with other work, but the younger siblings were curious about the fascinating experiments of their older brothers and sisters. Soon I allowed the little kids to participate.

I discovered children as young as eight years old could use the equipment just as capably and responsibly as the older kids. The little kids could record data just as accurately. They could form conclusions and discuss their results as intelligently. What they could not do as well as the older kids was write the lab report. And that was fine, no problem.

A wonderful side effect was the increase in inter-age respect. Multi-age interaction is more like the real world than self-contained groups of same-age peers.

I'm calling on our nation's governors and state education chiefs to develop standards and assessments that don't simply measure whether students can fill in a bubble on a test, but whether they possess 21st century skills like problem-solving and critical thinking and entrepreneurship and creativity.

3. Quality Teachers---Recruiting, preparing, and rewarding outstanding teachers

From the moment students enter a school, the most important factor in their success is not the color of their skin or the income of their parents, it's the person standing at the front of the classroom. That's why our Recovery Act will ensure that hundreds of thousands of teachers and school personnel are not laid off -- because those Americans are not only doing jobs they can't afford to lose, they're rendering a service our nation cannot afford to lose, either...

And if you do your part, then we'll do ours. That's why we're taking steps to prepare teachers for their difficult responsibilities, and encourage them to stay in the profession. That's why we're creating new pathways to teaching and new incentives to bring teachers to schools where they're needed most. That's why we support offering extra pay to Americans who teach math and science to end a teacher shortage in those subjects.

Schools should not only work harder to keep their best teachers, schools should also seek out the veteran non-practicing teachers in their communities. Schools should eliminate the arbitrary obstacles that block out-of-district teachers and offer incentives to attract them back to the classroom.

There are many great teachers in America who moved from one district to another, for whatever reason, to find themselves virtually unemployable. Some of them, like me, are math and/or science teachers. A few of them taught in our Department of Defense Dependent Schools overseas, and now back home, they find, like I did, that they are out-of-district in every single district in America.

Now, here's what that commitment means: It means treating teachers like the professionals they are while also holding them more accountable -– in up to 150 more school districts. New teachers will be mentored by experienced ones. Good teachers will be rewarded with more money for improved student achievement, and asked to accept more responsibilities for lifting up their schools. Teachers throughout a school will benefit from guidance and support to help them improve

Money cannot be allowed to remain an excuse for blocking veteran teachers from returning to the classroom.

We can afford nothing but the best when it comes to our children's teachers and the schools where they teach.

4. Innovation and Excellence—even if innovation and excellence is found in a charter school. Learn from the best charter schools, adopt their best practices in public schools, and follow John Wooden's advice, “Don't whine, don't complain, and don't make excuses. Just get out there and do your best.”


5.Higher education---College is the new high school.
6.The Bottom Line---Personal Accountability

Of course, no matter how innovative our schools or how effective our teachers, America cannot succeed unless our students take responsibility for their own education. That means showing up for school on time, paying attention in class, seeking out extra tutoring if it's needed, staying out of trouble. To any student who's watching, I say this: Don't even think about dropping out of school. Don't even think about it...

No government policy will make any difference unless we also hold ourselves more accountable as parents -- because government, no matter how wise or efficient, cannot turn off the TV or put away the video games. Teachers, no matter how dedicated or effective, cannot make sure your child leaves for school on time and does their homework when they get back at night. These are things only a parent can do. These are things that our parents must do...

So today, I'm issuing a challenge to educators and lawmakers, parents and teachers alike: Let us all make turning around our schools our collective responsibility as Americans. (my bold)

Reactions to the President's Speech.

Quality Professional Development on the Cheap

People who have a lot of money do not have to think too hard about problems.  They can just throw a few dollars at their problems and solve them fairly easily.  They may complain the whole time they are pitching the dollars, but they pay just the same.  People without money have to be a lot more resourceful, creative and innovative.  Maybe I can't afford $300 for a diagnostic on my car when it flunks the smog certification.  So I ask around, pay $8 for a fuel additive, drive my car over the grade, and voila, it passes the certification with flying colors, and I keep most of the $300.

The very act of idea-generation can highlight areas of waste and profligate spending. A good example is professional development.

"Any district hiring a consultant to come in for a one day for $10,000 or $15,000—that's a waste of time and money," says Ed Wilgus, a former district professional development manager who is co-founder of Systemic Human Resource Solutions.

There are lots of options for planning a satisfying DIY professional development program.

Here are some ideas:
1. Veteran teachers share their best practices.
2. A conference format with several options within any particular time frame
3. A longitudinal lesson study Japanese style.
4. A collaborative discussion addressing a specific concern within the district.
5. Teachers design, conduct and share the results of active research within district classrooms.
6. Reflective analysis of the rational behind specific teaching strategies.
7. Reviews of books and journal articles of interest.
8. Demonstrations of math manipulatives and other resources.
9. Presentations by parents.
10. Classroom swapping-teaching for a day in a very different grade or subject area with no more preparation than an average substitute teacher.

One school district had a great idea for using the Internet.

Instead of hiring presenters to come to their schools, they downloaded free archived video presentations from the Web site of the K-12 Online Conference, an annual grassroots gathering of instructional technology aficionados. Then they featured the videos as part of a special series of staff development sessions on technology topics. Members of the district's tech team and Web-savvy teacher leaders facilitated the sessions, leading discussions on the presentations and addressing teachers' practical concerns. In some cases, they even conducted live follow-up interviews with the original presenters via Skype, the free Internet phone service.

P.S. A school can get me for $1000-$1500, (not $10000-$15000), depending on the amount of time, distance, hotel, etc. I do presentations on math, science and foreign language teaching, ESL, art, curriculum and the Japanese education system. I help teachers plan and organize their own self-facilitated professional development. I also write education grants for schools.

Teachers Misbehaving

Purveyors of professional development don't like it much when the teachers they are supposed to be teaching misbehave. I have been on both sides of the podium. Teachers have good reason for regarding professional development sessions as a monumental waste of time. Usually the sessions are mandatory, and the presenter has been commissioned to present specific information whether or not the audience is interested. One school district asked me to present a hands-on literacy session to high school teachers on developing questions that build critical thinking.

It quickly became clear that what these high school teachers really wanted was tips on phonics, and how to integrate phonics into their content lessons. I converted my presentation to phonics on the fly. Because I had not brought any phonics materials with me, I had to abandon the hands-on part. I ended up delivering mostly lecture, but the teachers loved it. Six months later I was commissioned to present an overview of the six traits of good writing to a group of elementary teachers in a completely different geographical area. What the teachers wanted to do was vent their complaints about the district's adoption of the reading curriculum, Success for All. When they were done, I carried on with my presentation. Only later I found out that the administration canceled my future presentations because I did not shut down the criticism.

So you never know.

For every expectation, there are other conflicting expectations. If some teachers expect presenters to model hands-on techniques, other teachers want the presenter to just tell them the info and let them go back to grading papers. The presenter comes prepared with the information commissioned by the administration only to find the audience deems the information irrelevant to their needs. I gained appreciation and sympathy for presenters when I became a presenter.

The worst problems with professional development can be avoided by letting teachers create their own professional development. Administrators are notoriously out of touch with the teaching staff.