Testing, testing: Can we measure student learning?
Noting that the most important measure of an education is student learning, the National Center for Public Policy and Higher Education (NCPPHE) spent the last three years putting a measuring stick to college students’ knowledge and skills. NCPPHE’s new report, Measuring Up on College-Level Learning (www.highereducation.org/report/mu_learning/index.shtml), shows detailed results from five pilot states and suggests a model that could become a “nationwide benchmark for learning.”
But defining knowledge and measuring fairly can be a sticky enterprise. The new system of accountability makes union leaders wary of increased government and corporate directives, and the subsequent restrictions on academic freedom.
Measuring Up frames two questions as critical:
What knowledge and skills are available to states for developing the economy and sustaining “vital civic life”?
How do state colleges and universities contribute to the development of those skills and knowledge?
Focusing on five pilot states—Illinois, Kentucky, Oklahoma, Nevada and South Carolina—the study sets out to determine whether measuring knowledge is possible. With existing licensure and graduate admissions tests, national adult literacy surveys, and other specially administered tests, NCPPHE concludes that it is. These tests include WorkKeys, which tests two-year college students for such skills as extracting information from documents and preparing a business-setting essay; and the Collegiate Learning Assessment, which requires four-year students to use raw biological and historical data to draw conclusions and write persuasive and analytical essays.
Leo Welch, legislative chair of the Illinois Federation of Teachers Community College Council, warns that the center’s methods are flawed. Welch points out that testers bribed students to take the tests by offering free pizzas, parking passes and money, conceivably skewing results. Existing accrediting agencies, along with graduate record exams, entry exams and licensures, are already sufficient accountability measures, he adds. And the cost of a new accountability system soars to $17 million nationwide: “With diminishing resources, why add this burden?” asks Welch.
Merit-based funding, which relies on test performance, threatens institutions that may not show the “right” results for years, Welch continues. Even the basic impulse to compare state to state is wrong, says Welch, when states are so disparate. Nevada, for example, has two public universities and four community colleges; Illinois has 12 public universities and 48 community colleges. “How do you compare using a single type of test?”
Besides, says Welch, “before we look at another accountability measure, where is the accountability of the federal government and the state for funding higher education? It appears this is not a priority [in] budget allocations. Let’s look at the support of public higher education."











