In today’s Academic Minute, Matt Taylor, assistant professor in the School of Electrical Engineering and Computer Science at Washington State University, explains how he is teaching computers how to teach. Learn more about the Academic Minute here.
Nearly 70 institutions are collaborating to better assess learning outcomes as part of a new initiative called the Multi-State Collaborative to Advance Learning Outcomes Assessment. The colleges and universities are a mix of two- and four-year institutions.
The initiative, funded in its initial planning year by the Bill & Melinda Gates Foundation, was announced Monday by the Association of Colleges and Universities and the State Higher Education Executive Officers association.
”The calls are mounting daily for higher education to be able to show what students can successfully do with their learning,” said Carol Geary Schneider, AAC&U president, in an announcement. “The Multi-State Collaborative is a very important step toward focusing assessment on the best evidence of all: the work students produce in the course of their college studies."
The 68 colleges and universities participating in the collaborative are from Connecticut, Indiana, Kentucky, Massachusetts, Minnesota, Missouri, Oregon, Rhode Island and Utah. Faculty at those institutions will sample and assess student work as part of a cross-state effort to document how students are achieving learning outcomes such as quantitative reasoning, written communication, and critical thinking.
All of the assessments will be based on a set of common rubrics. The project will also develop an online data platform for uploading student work samples and assessment data.
In their effort to improve outcomes, colleges and universities are becoming more sophisticated in how they analyze student data – a promising development. But too often they focus their analytics muscle on predicting which students will fail, and then allocate all of their support resources to those students.
That’s a mistake. Colleges should instead broaden their approach to determine which support services will work best with particular groups of students. In other words, they should go beyond predicting failure to predicting which actions are most likely to lead to success.
Higher education institutions are awash in the resources needed for sophisticated analysis of student success issues. They have talented research professionals, mountains of data and robust methodologies and tools. Unfortunately, most resourced-constrained institutional research (IR) departments are focused on supporting accreditation and external reporting requirements.
Some institutions have started turning their analytics resources inward to address operational and student performance issues, but the question remains: Are they asking the right questions?
Colleges spend hundreds of millions of dollars on services designed to enhance student success. When making allocation decisions, the typical approach is to identify the 20 to 30 percent of students who are most “at risk” of dropping out and throw as many support resources at them as possible. This approach involves a number of troubling assumptions:
The most “at risk” students are the most likely to be affected by a particular form of support.
Every form of support has a positive impact on every “at risk” student.
Students outside this group do not require or deserve support.
What we have found over 14 years working with students and institutions across the country is that:
There are students whose success you can positively affect at every point along the risk distribution.
Different forms of support impact different students in different ways.
The ideal allocation of support resources varies by institution (or more to the point, by the students and situations within the institution).
Another problem with a risk-focused approach is that when students are labeled “at risk” and support resources directed to them on that basis, asking for or accepting help becomes seen as a sign of weakness. When tailored support is provided to all students, even the most disadvantaged are better-off. The difference is a mindset of “success creation” versus “failure prevention.” Colleges must provide support without stigma.
To better understand impact analysis, consider Eric Siegel’s book Predictive Analytics. In it, he talks about the Obama 2012 campaign’s use of microtargeting to cost-effectively identify groups of swing voters who could be moved to vote for Obama by a specific outreach technique (or intervention), such as piece of direct mail or a knock on their door -- the “persuadable” voters. The approach involved assessing what proportion of people in a particular group (e.g., high-income suburban moms with certain behavioral characteristics) was most likely to:
vote for Obama if they received the intervention (positive impact subgroup)
vote for Obama or Romney irrespective of the intervention (no impact subgroup)
vote for Romney if they received the intervention (negative impact subgroup)
The campaign then leveraged this analysis to focus that particular intervention on the first subgroup.
This same technique can be applied in higher education by identifying which students are most likely to respond favorably to a particular form of support, which will be unmoved by it and which will be negatively impacted and dropout.
Of course, impact modeling is much more difficult than risk modeling. Nonetheless, if our goal is to get more students to graduate, it’s where we need to focus analytics efforts.
The biggest challenge with this analysis is that it requires large, controlled studies involving multiple forms of intervention. The need for large controlled studies is one of the key reasons why institutional researchers focus on risk modeling. It is easy to track which students completed their programs and which did not. So, as long as the characteristics of incoming students aren’t changing much, risk modeling is rather simple.
However, once you’ve assessed a student’s risk, you’re still left trying to answer the question, “Now what do I do about it?” This is why impact modeling is so essential. It gives researchers and institutions guidance on allocating the resources that are appropriate for each student.
There is tremendous analytical capacity in higher education, but we are currently directing it toward the wrong goal. While it’s wonderful to know which students are most likely to struggle in college, it is more important to know what we can do to help more students succeed.
Dave Jarrat is a member of the leadership team at InsideTrack, where he directs marketing, research and industry relations activities.
Conventional wisdom holds that marginal students may pay more of a price for web surfing during class than top students, who are presumed to be better multitaskers. But a study at Michigan State University challenges that belief. The study tracked 500 students in an introductory psychology course, using ACT scores to measure intellectual ability. And top students as well as others saw their performance lag if they were heavy internet users in class (for non-class reasons).
Some will immediately say this is nothing more than a semantics debate. No different than if we were discussing the contrasting meanings of, say, “soda” and “pop.”
When we use the word “pedagogy” as a catchall for all teaching methods, of course, no one is talking about little children, but we rarely stop and specifically consider what this word means and its relationship with other words.
Pedagogy: the methods and practice of teaching children.
Andragogy: the methods and practice of teaching adults.
So the question becomes: at what point is a student no longer a child, but an adult? There is no hard-and-fast rule, but for our purposes here, any college student is an adult.
Andragogy, a concept dating to the 1960s and Malcolm Knowles, is important because it recognizes that adult learners are different and that these differences are extremely important. And its importance, as a body of knowledge and approach in and of itself, is profound and vastly under-recognized.
Andragogy -- adult learning theory -- stresses that adults:
Are more independent than children when it comes to learning.
Are capable of critical thinking (unlike some children) but are still interested in the “correct answer."
Learn more slowly but just as effectively because they have more life experience and deeply ingrained stereotypes and ideas.
Must be given respect as adults and for their life experience or lack of experience.
Need classrooms that embrace active learning, including hands-on activities.
Learn material that is relevant for their needs.
Are driven less by grades (performance goal orientation) and more by understanding (mastery goal orientation).
Going back to the question of when students become adults, in some ways it does not matter per se. All learners learn best when many of the core elements of andragogy are followed. All students — whether 5, 15 or 55 — deserve respect, need room for their prior experiences, and need lessons to be relevant. That said, the idea of andragogy exists on a sliding spectrum of sorts. Whether a student is 18 or 85, he/she will enter the classroom with experience, for example, but this experience will vary based on age, interests, background, etc.
This is also where some understanding of basic human growth and development theories (e.g., Maslow’s hierarchy of needs, Erikson’s stages of psychosocial development, Piaget’s stages of cognitive development) can help professors build classrooms that are comfortable across the board. Students in their 30s will tend to have very different biologically driven needs, hopes, and fears than students in their 60s.
When students are not allowed opportunities for their feelings, especially about particularly sensitive topics or topics to which they have been vastly miseducated or undereducated, learning stops. (Please see my comments about the trigger warning or objectionable material warning and student feelings here.) Additionally, we know that for learners of any age it is very hard, even physiologically impossible without extreme dedication, to “unlearn” what have been “core truths,” whether the topic is basic physics or the causes of the Civil War.
This said, pedagogy is still important because children do learn differently and have different needs. Most notably, children need some more guidance. Likewise, children — depending on their age and experience (back to the sliding spectrum) — are physiologically not always capable of performing advanced math or demonstrating critical thinking. This is not at all to sanction the “banking method” — where teachers only lecture, metaphorically dumping information into students’ brains and then students regurgitate that information verbatim on assessments — of education that has sometimes been all too common: Active learning and student-centered learning is always best.
One note on learning styles, too: adults do tend to think they have a learning style — visual, kinesthetic, auditory — that enables them to learn more effectively. While I have read much more about andragogy than learning styles, there is some research that suggests learning styles are actually a myth. They have relevance because we give them relevance, but actually it is roughly equally possible for learning to happen visually or kinesthetically, for example, and furthermore, that ALL learners learn best when all learning styles are used. Going back to Bloom’s Taxonomy: learning that involves interactive thinking, hearing, reading, writing, touching, and creating results in the most effective learning, and naturally, much of this will requires independent learning and initiative by an adult student.
Even if we recognize that adults learn differently from children, by using the umbrella term “pedagogy” for both, we unconsciously tend to view adult learners as “children” who need to be taught by the “expert,” and we miss an entire body of knowledge and research about effectively teaching. I know some professors do not like the idea of being taught how to teach — they say it sounds too much like the training required to teach K-12. I too was somewhat like this when I first started teaching college in 2007.
But, as professors in the classroom, our ultimate goal should be for our adult students to learn, and for learning to occur, we should always be aware of how to teach effectively and stay reasonably up-to-date on findings as they develop.
For further information on andragogy check out this website; Malcolm S. Knowles’s The Adult Learner (now in its seventh edition); and Sharan B. Merriam, et al.’s, Learning in Adulthood: A Comprehensive Guide.
Andrew Joseph Pegoda is completing his Ph.D. in history at the University of Houston, where he also teaches. He studies race, culture, human rights, and education. He regularly blogs here.
A panel the Aspen Institute convened on Internet learning released its recommendations Tuesday. The group, which included Jeb Bush, the former Republican governor of Florida, considered ways to ensure that online learning is both innovative and safe, for students of all income levels. The final report calls a focus on all the ways students learn, including from museums, libraries, after-school programs and at home. It also pushes for students to be at the center of new learning networks, and for learners to have the digital literacy to be able to both use online media and to safeguard themselves.
In order for colleges to function as inclusive communities of responsible and respected members, all of their adults must be treated as adults. Yet, many of my faculty colleagues habitually call their undergraduates “kids” by default. They should stop. In addition to usually being false, it is demeaning and it tacitly encourages the immature behaviors we all bemoan.
When undergraduates begin college they immediately receive warnings that high school is over and that they will now be held to adult standards of conduct. Meanwhile, hallways are filled with faculty and students talking about which of their classes have especially “good kids,” “quiet kids” or “lazy kids.” In our speech, undergraduates are demoted back to children — they are infantilized. The resulting mixed messages would confuse anyone. Undergraduates are held to high behavioral standards (“I have zero tolerance for accidental plagiarism. A college student should know better.”). At the same time, they are spoken of as children (“The kid who plagiarized in my class is asking for leniency.”).
In my state and most of the U.S., we formally recognize 18-year-olds’ right to make autonomous choices while also being held accountable for a full set of societal responsibilities. Eighteen-year-old men and women begin college having recently earned the right to sign contracts and take full responsibility for the consequences; those who are U.S. citizens have recently earned the right to vote and the duty to serve as jurors; most of the men have completed their mandatory registration for Selective Service in case a military draft is ever reinstated. These men and women who are undergraduates live with the adult consequences of their adult rights and responsibilities when they get tattoos, decide whether to seek mental health treatment, get married, sign up for credit cards and so on.
What about those still-developing young adult brains? In contrast to the rigid law, developmental psychology research paints a complex picture of how traits gradually develop over time, with features such as “psychosocial maturity” varying substantially from person to person within an age group. Appealing to the developmental psychology literature will not justify the decision to walk into a lecture hall filled with young adults one scarcely knows, each at variable stages of development for a wide array of psychological and behavioral traits, and say, “Quiet down, kids!”
By publicly referring to undergraduates as “kids,” faculty members unwittingly invite childish behaviors. Kids ask their parents to call the instructor about a bad grade. Kids whine that they were not reminded about the homework that was due. Kids giggle when a peer shares an embarrassing personal story during class. Kids make inappropriate jokes to get a laugh from the room. These behaviors then become perceived justifications for continuing to see undergraduates as kids. The vicious cycle perpetuates the behaviors that faculty members wish to prevent. You’ll have to take my word for it, but my undergraduate students do none those childish behaviors. They act like the adults they are. I contend that the key to achieving this is the radically intuitive strategy of treating them like adults.
If there is one thing I have learned from teaching controversial philosophical subjects (e.g., the ethics of health care policy) to undergraduates, it is that a good classroom environment is the product of an explicit and consistently applied ethos. On the first day of class I tell my students that I will treat everyone in the room as adults whose contributions are valued, and that I expect them to do the same. They are not allowed to use the words “kid,” “idiot,” “bleeding heart,” or any other disparaging language to describe each other, as this is incompatible with a classroom that is inclusive of its diverse members. In a recent course evaluation from a senior seminar, a student expressed gratitude that I did not treat the class members as “inferiors.” It upsets me that such a thing bears mentioning. A roughly 22-year-old man or woman was so accustomed to being treated as a child or a second-class citizen that he or she felt obliged to mention it when treated otherwise.
Thinking of and speaking of undergraduates as “kids” can manifest in class policies ill-suited for adults. Perhaps the clearest examples of this are some of the faculty responses to poor undergraduate behavior. There is undeniable appeal in some of my colleagues’ approaches, such as publicly shaming students caught looking at Facebook in class or confiscating any cell phones used for texting during a lecture. However tempting it might be, this is not appropriate behavior between two adults. This is how an adult treats a kid.
If a dean did such things to faculty members during meetings then he or she would rightly be called a tyrant (and would likely have a large collection of cell phones). Strategies responding to an adult’s childish behavior must work within a framework of adult-adult interaction. If students use their cell phones in class then the instructor can easily initiate a brief classwide conversation about the classroom policies and penalties, as well as the reasons for them. An instructor can also speak candidly and politely with an individual student after class ends about any violated policies.
Every adult has moments of childish behavior. It is one thing to criticize an individual adult for a specific childish behavior, but quite another thing to indiscriminately call a whole group of adults “kids.” There are indeed cases where it might be appropriate to refer to an individual student as a “kid” or “child,” much like it occasionally might be appropriate to refer to an individual student as a “jerk.” Faculty members need to privately grumble and blow off steam just like anyone else — call it the Happy Hour Exemption. This does not make it acceptable to use “kid” (or “jerk”) as one’s default term for undergraduates. Even when used as a term of endearment, “kid” still devalues undergraduates as autonomous agents. It is no more appropriate than saying “good boy” to a graduate student who wrote a strong paper, or describing a junior faculty member as a “nice girl.”
Whether they grew up listening to the Everly Brothers or the Jonas Brothers, adults deserve to be spoken of and treated as respected and accountable human beings. Many undergraduates are new adults, and unsurprisingly most are not yet very good at acting like adults. This does not excuse faculty members who casually refer to these men and women as “kids.” In anything, the infantilizing language sends the misleading message that undergraduates are permitted to act like children. Unfortunately, the undergraduate-as-kid mindset is deeply ingrained in campus culture, making change difficult. We even have the audacity to reserve the term “adult learners” for undergraduates over the age of 25. This status quo is unacceptable. The adult men and women in our undergraduate courses deserve better.
Sean A. Valles is assistant professor in the Lyman Briggs College and department of philosophy at Michigan State University.
The Association of American Medical Colleges on Tuesday released new guidelines on the skills and knowledge that medical students should have by the time they graduate and start their residencies. Darrell G. Kirch, president of the association, said in a statement that "these guidelines take medical education from the theoretical to the practical as students think about some of the real-life professional activities they will be performing as physicians."