Advertisement

Advertisement

News, Views and Careers for All of Higher Education

Getting the Faculty On Board

External demand is building for accountability in higher education. From discussions in state legislatures to the work of the Secretary of Education’s Commission on the Future of Higher Education, policy makers are increasingly asking how we can strengthen effectiveness and productivity in our colleges and universities.

Some skepticism by the academy is understandable. Those on the outside sometimes fail to recognize just how much those of us on many college campuses are already talking seriously about the need to measure what we do and to be constructively critical of ourselves. And some of us may not like the tone of the voices that insist on greater accountability or some of the related ideas, including suggestions to eliminate regional accreditation, dismantle the federal student-aid system, and test college students to determine what they’ve learned.

But as assessment becomes a national imperative, college and university leaders face a major challenge: Many of our faculty colleagues are skeptical about the value of external mandates to measure teaching and learning, especially when those outside the academy propose to define the measures. Many faculty members do not accept the need for accountability, but the assessment movement’s success will depend upon faculty because they are responsible for curriculum, instruction and research. All of us — policy makers, administrators and faculty — must work together to develop language, strategies and practices that help us appreciate one another and understand the compelling need for assessment — and why it is in the best interest of faculty and students.

Why is assessment important? We know from the work of researchers like Richard Hersh, Roger Benjamin, Mark Chun and George Kuh that college enrollment will be increasing by more than 15 percent nationally over the next 15 years (and in some states by as much as 50 percent). We also know that student retention rates are low, especially among students of color and low-income students. Moreover, of every 10 children who start 9th grade, only seven finish high school, five start college, and fewer than three complete postsecondary degrees. And there is a 20 percent gap in graduation rates between African Americans (42 percent) and whites (62 percent). These numbers are of particular concern given the rising higher education costs, the nation’s shifting demographics, and the need to educate more citizens from all groups.

At present, we do not collect data on student learning in a systematic fashion and rankings on colleges and universities focus on input measures, rather than on student learning in the college setting. Many people who have thought about this issue agree: We need to focus on “value added” assessment as an approach to determine the extent to which a university education helps students develop knowledge and skills. This approach entails comparing what students know at the beginning of their education and what they know upon graduating. Such assessment is especially useful when large numbers of students are not doing well — it can and should send a signal to faculty about the need to look carefully at the “big picture” involving coursework, teaching, and the level of support provided to students and faculty.

Many in the academy, however, continue to resist systematic and mandated assessment in large part because of problems they see with K-12 initiatives like No Child Left Behind — e.g., testing that focuses only on what can be conveniently measured, unacceptable coaching by teachers, and limiting what is taught to what is tested. Many academics believe that what is most valuable in the college experience cannot be measured during the college years because some of the most important effects of a college education only become clearer some time after graduation. Nevertheless, more institutions are beginning to understand that value-added assessment can be useful in strengthening teaching and learning, and even student retention and graduation rates.

It is encouraging that a number of institutions are interested in implementing value-added assessment as an approach to evaluate student progress over time and to see how they compare with other institutions. Such strategies are more effective when faculty and staff across the institution are involved. Examples of some best practices include the following:

  1. Constantly talking with colleagues about both the challenges and successful initiatives involving undergraduate education.
  2. Replicating successful initiatives (best practices from within and beyond the campus), in order to benefit as many students as possible.
  3. Working continuously to improve learning based on what is measured — from advising practices and curricular issues to teaching strategies — and making changes based on what we learn from those assessments.
  4. Creating accountability by ensuring that individuals and groups take responsibility for different aspects of student success.
  5. Recruiting and rewarding faculty who are committed to successful student learning (including examining the institutional reward structure).
  6. Taking the long view by focusing on initiatives over extended periods of time — in order to integrate best practices into the campus culture.

We in the academy need to think broadly about assessment. Most important, are we preparing our students to succeed in a world that will be dramatically different from the one we live in today? Will they be able to think critically about the issues they will face, working with people from all over the globe? It is understandable that others, particularly outside the university, are asking how we demonstrate that our students are prepared to handle these issues.

Assessment is becoming a national imperative, and it requires us to listen to external groups and address the issues they are raising. At the same time, we need to encourage and facilitate discussions among our faculty — those most responsible for curriculum, instruction, and research — to grapple with the questions of assessment and accountability. We must work together to minimize the growing tension among groups — both outside and inside the university — so that we appreciate and understand different points of view and the compelling need for assessment.

Freeman A. Hrabowski III is president of the University of Maryland, Baltimore County. This article is adapted from a keynote address he gave at a conference on assessment this month co-sponsored by the Educational Testing Service and the Carnegie Foundation for the Advancement of Teaching.

Got something to say?


Want it on paper? Print this page.
Know someone who’d be interested? Forward this story.
Want to stay informed? Sign up for free daily news e-mail.

Advertisement

Comments

Too Important to be On Second Page

This article is too important to be on the second page. How to measure performance is the key question.

William Sumner Scott, J.D.

Judicial Equality Foundation, Inc.

wss@jefound.org

William Sumner Scott, J.D., at 9:35 am EDT on June 23, 2006

Re: Faculty Distrust of Assessment

Hrabowski’s speech has the paradoxical effect of demonstrating why faculty are so distrustful of assessment. First, it was delivered at a conference co-sponsored by ETS, a company that has a vested interest in promoting assessment, since they will obviously profit from it. Second, Hrabowski begins by reminding everyone of “the work of the Secretary of Education’s Commission on the Future of Higher Education,” but as this site has demonstrated, Spellings’ commission is hardly friendly toward faculty. Remember (sorry, I do not have the link) that one of its position papers blamed the rise of college costs squarely on the faculty, who, the author continues, are much more involved in curriculum decisions than they ought to be. Citing this commission as evidence for the need for assessment is just about guaranteed to alienate faculty from this project. Finally, however, there is the complete absence of any sense that the adults—repeat, ADULTS—that enroll in colleges have a significant role in their success or failure. As I have pointed out before, and as Hrabowski’s speech proves once again, in the rhetoric concerning assessment, there are no bad students, only bad faculty. That, along with the obvious desire to demote the importance of research in hiring and tenure decisions (one of the so-called “best practices” is this proposal: “Recruiting and rewarding faculty who are committed to successful student learning [including examining the institutional reward structure]"), shows why faculty are generally very skeptical of the movement Hrabowski promotes.

Anonymous, Professor at Large 4th Tier Public University, at 11:30 am EDT on June 23, 2006

Good vs. Bad assessment

As with any tool, assessment can be done well, in ways that promote learning and improvement, or done badly in ways that alienate faculty and narrow student achievement. What is needed in higher education is NOT a version of NCLB (which contains most of the elements of bad assessment); rather, higher education needs to get better at good assessment — assessment that shares information about what students are learning, helps faculty improve their teaching, and describes to a concerned public the value of higher education. The challenge in getting faculty support is that too often they’ve been victims of “bad” assessment and don’t believe that “good” assessment exists.

Jeremy, at 12:05 pm EDT on June 23, 2006

ETS is a non-profit organization.

Fred Duke, at 7:20 pm EDT on June 24, 2006

re: Non-Profit?

Perhaps legally ETS is a non-profit organization (their web address ends with “.org” at least), but in fact, they take in millions from testing, and stand to take in even more if Hrawbowski et al. have their way. See, for example, ETS’ 2004 tax form (http://www.guidestar.org/FinDocum...2004/210/634/2004-210634479-1-9.pdf), which includes the salaries of their management and board. Arthur Chisholm, Chief Information and Strategy Officer, according to this document, earned $417,739 in income. ETS also has extensive real estate holdings and stocks. They also spent approximately one million dollars in lobbying fees. A small charity they are not.

Anonymous, Professor at Large 4th Tier Public University, at 9:35 pm EDT on June 25, 2006

Hrabowski Speech

Thanks to Inside Higher Ed for helping disseminate this dose of wisdom from one of the nation’s leading academic thinkers and doers. I hope many take note and act accordingly. (Caveat: He’s a good colleague and friend of mine.)

“Anonymous” helps make Hrabowski’s point in his all-too-typical paranoid and spineless faculty diatribe describing the evil forces who are “out to get us.” He does so anonymously, with a self-deprecatory title, “Professor at Large, Fourth Tier Public University.” Sad, not to mention pitiful!

The fact is, higher education is the only important social enterprise that cannot demonstrate that it actually produces a product (i.e., student learning), and moreover, consistently opposes any efforts to cause it to do so. It’s a complex issue, I admit. But, the faculties of America’s universities include a substantial number of our nation’s most brilliant intellects. Is it not possible that, if we put our minds to it, we could figure out how to demonstrate that we actually do something important? Here, I mean demonstrating that we actually enhance our graduates’ learning and skills, not just trumpeting our own individual and institutional self-importance.

Don Langenberg, Professor of Physics & Electrical Engineering at University of Maryland, College Park, at 8:20 pm EDT on June 26, 2006

Assessment

I assess my students several times during the course of a semester, and I give them a final assessment at the end. It’s called a grade.

Honest retention and graduation statistics, and alumni stats about job placement and grad school admissions should tell us what we want to know. We do not need a huge new bureaucracy or testing industry to assess the value of a college degree. We have too many administrators leeching the life blood out of colleges as it is.

We do need accreditation with teeth that will differentiate between real education and job training, between real colleges and web pages. “Colleges” without faculties and libraries are frauds. Free speech should not include the right to deceive the gullible.

J. Mask, Prof. at small private college, at 10:05 am EDT on June 27, 2006

Dr. Hrabowski offers an overview of issues with “accountability” in higher education. A faculty member at UMBC, I can footnote his remarks with observations on a recent and strenuous exercise in accountability at UMBC which as head of the teacher education unit I led. This was our NCATE accreditation process, which in Maryland is joined with state approval. UMBC was successful with both. I can see both the positives and negatives of such an accountability exercise. I will list them here. Positives: The exercise organized our curriculum around standards and increased communication about our teaching, advising, and relationships with public schools. The exercise allowed us to keep operating as a teacher education unit. [Although Maryland’s chronic shortage of teachers might make one wonder why IHEs teacher education programs aren’t cherished rather than threatened.] Negatives: While organizing around standards has its strengths, as mentioned, standards always are the best thinking of the past. Fresh thinking and creativity are devalued. The need to prove through expansive documentation that standards are being met is extremely time-consuming and again always looking backwards. “Documentarianism” is a pernicious ideology. If a new approach to old or new problems is desirable, the effort to prove its worth through standard-meeting can outweigh its intrinsic value. The constant need to prove standard-meeting diverts and distracts from thinking about other, more important problems. Along with teaching our new teachers to be effective in high-needs schools, faculty and students need time to think and act toward solving the whole problem of the existence of these schools. I think it is the university’s responsibility to work on such problems. The psychological cost of making an entire departmental faculty conform to externally imposed standards is very high. The experience is not one of creative, positive. humane activity, but of oppression. The cost in faculty and staff time is very high. For myself, heading this accountability effort allowed me very little time for research and publishing, not good for a department chair at a research university All our faculty bore the burden. The direct financial cost is very high. Our department has its own three person technology staff in order to develop, maintain, and run the required electronic assessment system. This to produce approximately 100 new teachers each year. In addition, the costs of the accreditation/approval visit itself were substantial.Finally, and perhaps most important, faculty are not convinced that the new teachers are any better prepared than in previous years. To use Dr. Hraboswki’s term, we are skeptical.

Mary Rivkin, Chair of Education Department at UMBC, at 5:35 am EDT on June 28, 2006

can learning be quantified?

As the subject line indicates, that’s what program and institutional assessment is all about. As a teacher, I can’t wholly objectively rate the work of my students. What I ask them to do is subjective based on my best thinking, and my choice of assessment is subjective based on my best thinking. Yes, my department has stated “learning outcomes” but when one of those is critical thinking, how can that be objectively quantified through assessment? For me, this makes much of what we are being asked to measure something of a fraud in the name of buying into neo-liberal business models being foisted off on education.

I say keep assessment in the classroom because it’s dubious enough there as it is. As someone alluded to earlier, as a community college instgructor, my work and the work of my colleagues, can be gauged by how well our students do when they transfer or go to work (and they do just fine—often better— compared to those who start at a four-year school). But why should the quality of education at the four-year level, or any level, be based on the needs and desires of the business community? A BA/BS or whatever is not meant to be job training, or is it? If they want students “trained” like animals, they should pony up beyond their general taxes that get them a student who can, hopefully, think critically.

bradley bleck, instructor at Spokane Falls CC, at 2:30 pm EDT on June 29, 2006

Advertisement

 Jobs Related to Getting the Faculty On Board

or search for jobs directly.

Partnerships & Grants Coordinator
Plymouth State University

Plymouth State University (PSU) invites applications for the position of Partnerships & Grants Coordinator in the Center for ... see job

President
Occidental College

The Board of Trustees of Occidental College is pleased to invite nominations and applications for the position of President ... see job

Associate Professor or Professor of Sociology — Law, Crime and Deviance
University of Minnesota, Twin Cities

The University of Minnesota is a premier employer and a talent magnet attracting leading faculty and staff from around the ... see job

Program Manager, Off Campus Development
Princeton University

Position Summary: Princeton University seeks a Program Manager for Off-Campus Development. As Princeton ... see job

Faculty — Biomedical Engineering Technology
DeVry University

As one of the largest degree-granting higher education systems in North America, DeVry University provides high-quality, ... see job

Executive Director for Front Range Board of Cooperative Educational Services for Teacher Leadership
University of Colorado at Denver and Health Sciences Center-Anschutz Medical Campus in Aurora

Posting Description: The Executive Director is employed by the University of Colorado Denver (UCD) and works ... see job

Assistant Professor of Physical Chemistry
University of Puget Sound

Teaching responsibilities include physical chemistry courses (quantum mechanics and thermodynamics), physical chemistry ... see job

Stone Center Librarian
University of North Carolina, Chapel Hill

The University of North Carolina at Chapel Hill seeks a motivated, innovative, collaborative, service-oriented, and ... see job

Coord Eeo
Maricopa Community College District

Plans, coordinates, and conducts internal discrimination complaint investigations; performs audits to ensure compliance with ... see job

PRA/Hutton Lab
University of Colorado at Denver and Health Sciences Center-Downtown Denver

Posting Description: This is a full-time (40 hours per week) PRA position in the academic biological field ... see job