Atkinson Town Hall

Atkinson Town Hall
The Norman Rockwellian picture of Atkinson

There is a NEW POLL at Right--------------------->

Don't forget to VOTE!
Make your voice heard!

Welcome Message and Mission Statement

Welcome to the NEW Atkinson Reporter! Under new management, with new resolve.

The purpose of this Blog is to pick up where the Atkinson Reporter has left off. "The King is dead, Long live the King!" This Blog is a forum for the discussion of predominantly Atkinson; Officials, People, Ideas, and Events. You may give opinion, fact, or evaluation, but ad hominem personal attacks will not be tolerated, or published. The conversation begun on the Atkinson Reporter MUST be continued!

This Blog will not fall to outside hacks from anyone, especially insecure public officials afraid of their constituents criticism.

Thursday, August 14, 2008

Few States Set World-Class Standards for educational testing.

From Education Next, by the Hoover Institute.
http://www.hoover.org/publications/ednext/18845034.html

Few States Set World-Class Standards


By Paul E. Peterson and Frederick M. Hess

In fact, most render the notion of proficiency meaningless



--------------------------------------------------------------------------------
As the debate over the reauthorization of No Child Left Behind (NCLB) makes its murky way through the political swamp, one thing has become crystal clear: Though NCLB requires that virtually all children become proficient by the year 2014, states disagree on the level of accomplishment in math and reading a proficient child should possess. A few states have been setting world-class standards, but most are well off that mark—in some cases to a laughable degree.
In this report, we use 2007 test-score information to evaluate the rigor of each state’s proficiency standards against the National Assessment of Educational Progress (NAEP), an achievement measure that is recognized nationally and has international credibility as well. The analysis extends previous work (see “Johnny Can Read...in Some States,” features, Summer 2005, and “Keeping an Eye on State Standards,” features, Summer 2006) that used 2003 and 2005 test-score data and finds in the new data a noticeable decline, especially at the 8th-grade level. In Figure 1, we rank the rigor of state proficiency standards using the same A to F scale teachers use to grade students. Those that receive an A have the toughest definitions of student proficiency, while those with an F have the least rigorous.

Measuring Standards

That states vary widely in their definitions of student proficiency seems little short of bizarre. Agreement on what constitutes “proficiency” would seem the essential starting point: if students are to know what is expected of them, teachers are to know what to teach, and parents are to have a measuring stick for their schools. In the absence of such agreement, it is impossible to determine how student achievement stacks up across states and countries.

One national metric for performance does exist, the National Assessment of Educational Progress. The NAEP is a series of tests administered under the auspices of the U.S. Department of Education’s National Center for Education Statistics. Known as the Nation’s Report Card, the NAEP tests measure proficiency in reading and math among 4th and 8th graders nationwide as well as in every state. The NAEP sets its proficiency standard through a well-established, if complex, technical process. Basically, it asks informed experts to judge the difficulty of each of the items in its test bank. The experts’ handiwork received a pat on the back recently when the American Institutes for Research (AIR) showed that NAEP’s definition of “proficiency” was very similar to the standard used by designers of international tests of student achievement. Proficiency has acquired roughly the same meaning in Europe and Asia, and in the United States—as long as the NAEP standard is employed.

This is not to say students are proficient either in this country or elsewhere. According to NAEP standards, only 31 percent of 8th graders in the United States are proficient in mathematics. Using that same standard, just 73 percent of 8th graders are proficient in math in the highest-achieving country, Singapore, according to the AIR study. In other words, bringing virtually all 8th graders in the United States up to a NAEP-like level of proficiency in mathematics constitutes a challenge no country has ever mastered.

Comparing the States

Three states—Massachusetts, South Carolina, and Missouri—have established world-class standards in math and reading as the goal for all students. Every other state has established a lower proficiency standard, and some states (for example, Georgia and Tennessee) declare most students proficient even when their performance is miles short of the NAEP standard. By setting widely varying standards, states render the very notion of proficiency meaningless. If Billy and Sally cannot read in South Carolina, they should not be able to pass muster simply by crossing the state’s western border.

We gauge the differences among states by comparing how students do on state assessments with how they perform on NAEP tests. By comparing the percentage of students deemed proficient on each, it is possible to determine whether states are setting expectations higher, lower, or equal to the NAEP standard. If the percentages are identical (or roughly so), then state proficiency standards can be fairly labeled as “world-class.” If state assessments identify many more students as proficient than the NAEP, then state proficiency figures should be regarded as inflated. In short, comparing state assessment results to NAEP scores can help reveal whether states are giving parents and voters the real scoop about where the state’s children stack up when measured against world-class benchmarks.

In Figure 1, we give Massachusetts, Missouri, and South Carolina an A for establishing rigorous expectations regarding what proficient students must know and be able to do. Note that a grade of A does not indicate students are performing at the highest level. Rather, the high grade indicates that the three states have set a high bar for students to reach if they are to be deemed proficient. So, for example, only 25 percent of 8th graders in South Carolina were deemed proficient on both the state reading test and on the NAEP reading test—an honest, if embarrassing, reckoning of the education situation in the state.

The remaining 47 states (information is not yet available for the District of Columbia) had distinctly lower standards. Three states—Georgia, Oklahoma, and Tennessee—expected so little of students that they received the grade of F. The state of Georgia, for instance, declared 88 percent of 8th graders proficient in reading, even though just 26 percent scored at or above the proficiency level on the NAEP. According to our calculations, Georgia 8th-grade reading standards are 4.0 standard deviations below those in South Carolina, an extraordinarily large difference. Thus, while students in Georgia and South Carolina perform at similar levels on the NAEP, the casual observer would be misled by Georgia’s reporting that its students achieve proficiency at three times the rate that South Carolina’s students do.

Twelve states—Alabama, Alaska, Idaho, Illinois, Michigan, Mississippi, Nebraska, North Carolina, Texas, Utah, Virginia, and West Virginia—received Ds because they had pitched their expectations far below other states. Illinois set its proficiency bar for 8th-grade reading at a level that is 1.01 standard deviations below the national average. If you believe those who set the Illinois standards, 82 percent of its 8th graders are proficient in reading, even though the NAEP says only 30 percent are.

In general, the states of the Northeast have the highest standards, while the states of the South and Midwest have the lowest. Western states fall in between.

3 comments:

Anonymous said...

I looked at the chart, I see that although NH is better than most states, in making their standards something to achieve, we still inly rate a "C" as the grade increases. And there is no rating for 11th grade standards, because they are too new to be rated

Anonymous said...

So Timberlane is an underachiever in an average state? Another myth (NH ranks high nationally) busted!

Anonymous said...

The state may rank high nationally but that has to be with the total tally of the state reporting the results of all schools. Don't be fooled by that because it is well known in the Timberlane District that we have and are continually failing in the educational arena. Just ask any one you bump into and ask them for their opinion. Better yet ask the parents of the kids in the system and decide for self. The Timberlane District seems to think music and sports are the answer to the educational needs of its students. How many kids can go to college on music and sports scholarships ? Not many when you compare the total of kids wanting to go to any college! I feel music and sports has its place but not when it comes to being well prepared for college studies for the majority of the students. Watch the Peter Bealo Timberlane School site for insight and opinions and you'll get other parental views of this subject.