Although budget cuts have many educators this year worried about the quality of education students receive, an annual survey being released today suggests that institutions -- large and small, public and private -- can achieve significant gains.
The National Survey of Student Engagement -- whose acronym NSSE is pronounced "nessie" -- doesn't measure learning per se, but a series of qualities of student engagement that are widely believed to correlate with learning. Those qualities range from the rigor of assignments to faculty-student interactions to certain "high impact" experiences (such as capstone courses) that are praised as making students more engaged, more likely to stay enrolled and graduate, and more likely to learn more.
While a new research study released Friday criticized NSSE's validity, the survey has grown in popularity over the 10 years of its existence and has considerable clout among college presidents and student affairs experts.
The NSSE questions are grouped under five benchmarks and colleges can compare their performance over time, as well as the performance of their peers. While many NSSE colleges release their full reports (and USA Today last year started to publish those that agreed to have them published), going public is a choice made by individual colleges. (The NSSE data focus on four-year college students; a separate study, the Community College Survey of Student Engagement, will be released next week, and that study does require that all data be made public.)
The theory behind NSSE is that by participating in the surveys of freshmen and seniors, colleges can identify weak points in their practices and construct policies to improve them. Most colleges participate every year or two, with the idea of measuring changes over time to see if those improvements are taking hold. This year, the study found that 41 percent of institutions showed positive gains in at least one measure for first-year students (with the largest gains seen in measures of active and collaborative learning, and of student-faculty interaction), and 28 percent saw gains for seniors. Very few institutions saw decreases.
Alexander C. McCormick, NSSE director and associate professor of education at Indiana University at Bloomington, said he was particularly pleased that the gains were not limited to any one kind of institution, and thus challenged conventional wisdom that many types of engagement are easiest to carry out at smaller, private colleges. This year's findings, he said, provide "compelling evidence" that "positive change is not limited to certain institutional types." Further, he said that the study finds that these institutions are achieving "steady improvement" over a period of years, not "isolated upticks."
NSSE -- founded in part out of concern over the impact of U.S. News & World Report rankings -- has always avoided giving grades or rankings to institutions or higher education as a whole. Rather, it annually notes "promising" and "disappointing" results from the year's data. Beyond the totals noted above, some of the "promising" trends identified were the following:
- Over half of students frequently had serious conversations with students of a different race or ethnicity, while only about one in seven reported that they never had such conversations.
- More than three-quarters of seniors said their senior seminar/capstone course contributed substantially to developing intellectual curiosity, learning independently, thinking critically, and making decisions based on evidence and reasoning.
- Eighty-five percent of faculty members in a companion survey believed it was important for undergraduates to complete a culminating senior experience. Thirty-three percent of seniors have done so, and another 31 percent were planning to.
Among the "disappointing" findings:
- Male students were less likely than female students to participate in a "high impact practices," such as "learning communities" in which students take several courses together in an organized way, study abroad, research with faculty members, or internships. Among first-year students, the male to female participation rates are 45 percent vs. 55 percent. Among seniors, the rates are 43 percent vs. 57 percent.
- About one in five students frequently came to class without completing readings or assignments.
- Forty percent of first-year students never discussed ideas from readings or classes with faculty members outside of class.
Each year, NSSE features some special questions designed to study particular issues. Among this year's issues was a comparison of the experiences of transfer students (of various types) to "native" students who graduate from the institution they enroll in as freshmen. The issue of the experience of transfer students is an increasingly important ones as more students enroll in community colleges or migrate from one four-year institution to another. Further, as the NSSE annual report notes, many transfer students feel "marginalized," and there has been long-standing concern that they may not benefit from key experiences that contribute to student engagement.
The analysis found this to be true, both for "vertical" transfers (those who move from a community college to a four-year institution) and "horizontal" transfers who move from one four-year institution to another. However, the survey found that horizontal transfers are more likely than vertical transfers to have these experiences.
Participation Rates for Seniors in 'High Impact' Practices
|Practice||Never Transferred||Transferred From 4-Year College||Transferred From Community College|
|Culminating senior experience (such as capstone course, senior project or thesis)||40%||30%||25%|
|Research with a professor||24%||17%||13%|
Noting the increased public interest in educating more students in STEM fields (science, technology, engineering and mathematics), NSSE asked a series of questions this year related to types of educational experiences that would apply theories of engaged learning to those disciplines. The findings indicate -- not surprisingly perhaps -- that STEM majors are more likely than non-STEM majors to experience these forms of engagement. But the figures among STEM major show far from uniform adoption, and the figures for non-STEM majors are generally low, even on experiences that might apply not only to those students' knowledge of science but to other fields as well.
Comparing Experiences of STEM and Non-STEM Majors
|Experience||STEM Majors||Non-STEM Majors|
|Worked with other students to solve mathematical or computational problems||55%||25%|
|Worked on a project requiring hands-on physical design or technical modeling||37%||21%|
|Wrote five or more papers in which you discussed methods or findings related to data from lab or field work, a survey project, etc.||44%||31%|
|Wrote five or more papers in which you explained the meaning of numerical or statistical data||34%||18%|
|Wrote five or more papers in which you included graphs, drawings, tables, photos, screen shots, or other visual content||45%||24%|
|Took a computer language or programming course||41%||18%|
|Gains in designing and conducting experiments, surveys, or field research||55%||32%|
|Gains in interpreting results from experiments, surveys, or field research||66%||37%|
Another area on which NSSE focused this year was the impact of learning technologies. The survey found positive impacts on learning both for the use of course management (or learning management) systems and for interactive technologies (such as course blogs, student response systems, etc.). While many colleges have the latter technology as part of the former, NSSE explored them as separate topics.
The use of course management software correlated most strongly, NSSE found, to stronger student-faculty interaction and to gains by students in their personal development. The use of interactive technologies corresponded most strongly with students' self-reported educational gains and with students' view that they had a supportive campus environment.
Following are some of the other results of the 2009 NSSE, organized around the survey benchmark categories (which appear in bold).
NSSE Results 2009
|Level of Academic Challenge|
|Number of assigned textbooks, books, or book-length packs of course readings|
|--Between 1 and 4||21%||27%|
|--Between 5 and 10||40%||37%|
|--Between 11 and 20||24%||20%|
|--More than 20||13%||15%|
|Number of written papers or reports of 20 pages or more|
|--Between 1 and 4||14%||40%|
|--Between 5 and 10||4%||7%|
|--Between 11 and 20||2%||2%|
|--More than 20||1%||1%|
|Number of written papers or reports between 5 and 19 pages|
|--Between 1 and 4||53%||44%|
|--Between 5 and 10||26%||31%|
|--Between 11 and 20||6%||11%|
|--More than 20||2%||4%|
|Number of written papers or reports of fewer than 5 pages|
|--Between 1 and 4||32%||34%|
|--Between 5 and 10||34%||28%|
|--Between 11 and 20||20%||18%|
|--More than 20||11%||14%|
|Hours per 7-day week spent preparing for class|
|--More than 30||5%||7%|
|Active and Collaborative Learning|
|Asked questions in class or contributed to class discussions|
|Made a class presentation|
|Worked with classmates outside of class to prepare class assignments|
|Discussed ideas from your readings or classes with others outside of class|
|Discussed grades or assignments with an instructor|
|Discussed ideas from your readings or classes with faculty members outside of class|
|Received prompt written or oral feedback from faculty on your academic performance|
|Work on a research project with a faculty member outside of course or program requirements|
|Enriching Educational Experiences|
|Had serious conversations with students who are very different from you in terms of their religious beliefs, political opinions, or personal values|
|Had serious conversations with students of a different race or ethnicity than your own|
|Used an electronic medium (listserv, chat group, Internet, instant messaging, etc.) to discuss or complete an assignment|
|Foreign language coursework|
|--Have not decided||19%||9%|
|--Do not plan to do||26%||41%|
|--Plan to do||34%||9%|
|--Have not decided||29%||14%|
|--Do not plan to do||26%||62%|
|--Plan to do||42%||9%|
|Culminating senior experience|
|--Have not decided||38%||11%|
|--Do not plan to do||12%||24%|
|--Plan to do||48%||31%|
|Supportive Campus Environment|
|Institutional emphasis: Providing the support you need to thrive socially|
|--Quite a bit||33%||26%|
|Institutional emphasis: Providing the support you need to help you succeed academically|
|--Quite a bit||44%||43%|
|Institutional emphasis: Helping you cope with your non-academic responsibilities (work, family, etc.)|
|--Quite a bit||26%||18%|