Advertisement

Advertisement

News, Views and Careers for All of Higher Education

Testing for Technology Literacy

Professors, librarians, and other college officials are increasingly coming to grips with the somewhat confounding reality that despite students’ affinity for IPods and their complete comfort with Google, many of them lack the technological literacy they need to navigate today’s information landscape. But recognizing the problem is not the same as knowing how to measure or fix it — tasks that many colleges are puzzling over.

The California State University system is drawing a bead on a solution, though. Its officials are putting the finishing touches on a test — developed in conjunction with Educational Testing Service — that they believe accurately gauges students’ technological literacy. And they are contemplating making the test a requirement that students would have to pass to move on to higher level courses, much like they do now for writing proficiency.

“People are good at learning technologies, but they are not so good at applying them,” said Barbara O’Connor, a professor of communications at California State University at Sacramento. O’Connor has become a strong advocate for increasing technological literacy.

But as technology evolves so quickly, experts toil to grasp the extent of the problem, said Diana Oblinger, vice president for Educause, a nonprofit group that deals with technology issues in higher education. “We’re now working on our next white paper and we’re struggling to define technology literacy,” she said. “There are more questions than answers because a couple of years ago we didn’t even have podcasts.” Oblinger added that Cal State has been working on improving technology literacy longer than any other system.

Cal State began to focus on information literacy in 1995. Early attempts to improve students’ skills included workshops for instructors and librarians to emphasize the importance of information technology, and grants to allow faculty and librarians to redesign courses, and to help academic departments create curriculums that incorporate information literacy.

The most recent effort is the information and communication technology literacy test created with Educational Testing Service. More than 3,300 students across the Cal State system took the assessment this year. In a follow-up survey, 90 percent of students said that the test was challenging, while three-fourths said that the assessment tested tasks that they perform at school or work.

“We feel that the test is almost in final form,” said Lorie Roth, assistant vice chancellor for academics at CSU. “We look at this as foundation skills that all students should have just like math and writing,” she said. Roth said that about half of the system’s 23 campuses are now using the test in introductory college courses, and some of the system’s business schools are considering implementing the test as well. Roth mentioned several other possible uses of the test, but said that it will require more discussions before a final decision is made.

Currently, Cal State requires students to pass an assessment in writing proficiency before they can enroll in upper division courses. If students fail that test, they can either take a course to brush up on their writing, or study on their own before taking the test again.

O’Connor said that she would like to see the new test become a requirement for students wishing to take upper division courses. “We haven’t voted on that yet, but it’s moving in that direction,” she said.

Paul D. Thacker

Got something to say?


Want it on paper? Print this page.
Know someone who’d be interested? Forward this story.
Want to stay informed? Sign up for free daily news e-mail.

Advertisement

Comments

just toys

To me, these tests seem sort of meaningless. Nobody ever insists upon developing real levels of technical competence: i.e. being able to write programs in real computer languages (HTML doesn’t count). Why can’t schools insist that students demonstrate that they can, say, figure out how to boot Linux on a PS2 or Ipod. Everything else is just playing with toys.

Larry, at 8:55 am EST on January 4, 2007

Larry misses the point

What you suggest is a completely different kind of test that assess a completely different set of skills. What CSU is interested in testing is how well students search for and critically analyze information they find online. This is just as important, if not more important, than writing code, etc. If you can’t tell the difference between peer-reviewed scholarship, a newspaper op-ed piece, and a rant on a blog, then you can’t call yourself technologically literate.

Phil, at 9:45 am EST on January 4, 2007

response to Phil

Phil, If you can’t tell the difference between a rant (anywhere) and a peer-reviewed piece of literature, you don’t belong in college. Colleges should be ashamed to admit these people. But, they sure love to admit them.

Unfortunately, we have given up expecting students to actually understand how technology works, and instead are now blaming “technology” for our failures to actually read on a substantive level and be able to identify and analyze arguments. If colleges would demand and expect that entering students have that level of competence, a knowledge of technology would be something a bit more meaningful than just searching through Google.

Larry, at 10:30 am EST on January 4, 2007

Tech competence in foreign languages

Technological competence is an increasingly important part of preparing for a vast number of jobs, and it’s especially difficult to attain in a foreign language. A student of Chinese who doesn’t know how to write e-mal, browse the Web, chat or IM or whatever the current version of that is, access archives, etc. in Chinese simply doesn’t “know” Chinese from the perspective of an employer.

Nina Garrett, Director of Language Study at Yale University, at 10:50 am EST on January 4, 2007

ICT

I appreciate Larry’s comments, though I really disagree with him. “Information and commmunication technology literacy” is about the application of technology to issues of reseach and the normal academic processes of communication. As an example, part of the ICT deals with use of spreadsheets, including interpretation of information. “Real measures of technical competence” that include computer programming are for a much narrower academic program, such as Computer Science. The dream that someday everyone will be able to program in BASIC, FORTRAN, COBOL, or even C++—let alone “booting Linux on an iPod"—is the dream that everyone will be a computer programmer. Life’s too short: being a “user” is challenging enough, particularly if, as a user, you will actually _do something_ with the tools. One doesn’t have to be a toolmaker to accomplish something useful.

Dean Rich, Bethel University, at 11:05 am EST on January 4, 2007

even spreadsheets have low standards

Dean Rich, Assuming that it is too much for people to learn a computer language, even “reading spreadsheets” proves to be too much for some people. Why? Every time I have suggested that we expect people to understand spreadsheets on a deeper level (e.g. writing macros, VBA code, writing queries, or doing basic some basic statistical analysis, I am told that this is too much for students.

Larry, at 12:30 pm EST on January 4, 2007

Testing Basic Literacy

Did you know that Cal State University doesn’t require students to pass any standardized exams in math and english as a condition to receive any degree? There are exams for english and math placement, but no mandatory exams to demonstrate achievment of these basic skills are enforced. Testing for technical literacy makes no sense without first testing for basic english and math literacy, and conducted in a manner to effectively maintain the integrity of the testing process with photo ID checks, video recorded proctoring, and other prudent security measures. With the majority of students failing the placement exams, it makes no sense whatsoever to expect that students have achieved basic skill competency without standardized testing.

David, Cal State Univ, at 3:15 pm EST on January 4, 2007

Without being too technical to loose some readers since thank god we are not all Programmers, compare this to the Driving Test. By law we should all learn and pass the Driver’s Test given by the DMV to drive on our national roads. The same goes for the internet “Super Highway", learn and pass the test. You don’t need to know how the car engine operates to drive one:)

Margie Kings, Advocate, at 3:30 pm EST on January 4, 2007

Low Standards

I find myself somewhat in agreement with Larry here.

Why? Every time I have suggested that we expect people to understand spreadsheets on a deeper level (e.g. writing macros, VBA code, writing queries, or doing basic some basic statistical analysis, I am told that this is too much for students.

I would expect, even for literacy, that students would at least KNOW these things are programmable. And doing queries and statistical analysis using common tools would seem to fall under the Evaluate criteria. The ICT is actually pretty lightweight.

Rob Rittenhouse, CS Faculty at McMurry University, at 3:31 pm EST on January 4, 2007

Basics first — then technology

As a computer technician with a professional master’s degree — it is utterly ridiculous to have students take an ICT exam without the equivalent an 800 (40th percentile) on the SAT. Heck, an 800 SAT is required for NCAA eligibility.

Are there college students who would score below 800 SAT? That’s like asking if there are too many colleges in the U.S. — of course.

N.R. Jessup, at 5:40 am EST on January 5, 2007

There seems to be some confusion here between Information and Technology literacy. The Association of College and Research Libraries established guidelines for Information Literacy back in 2000. http://www.ala.org/ala/acrl/acrls...ds/informationliteracycompetency.htm

These guidelines have nothing to do with technical proficiency but with discernment, being able to tell what sources are valid etc... Technical literacy is something we are just beginning to see required. It is now common to require freshmen to have a laptop as well as certain skills. These skills change over time. While it is useful for a student to know a how to use a word processing application it is far more important that they know how to write. Technology is merely a tool and while we may require knowledge of it the same way we once required courses in penmanship it is not an end in itself.

Edward Iglesias, Systems Librarian at CCSU, at 10:20 am EST on January 5, 2007

Phil’s response to Larry

Larry, I agree that, in general, most high school students probably should be better prepared in a whole variety of subjects before being admitted into college. For example, basic writing skills, basic mathematical skills, historical knowledge, political knowledge, geographical knowledge, etc. etc. etc. But the kids who have those skills go to the more elite schools, not CSU schools. (No disrespect intended to CSU.) So it makes perfectly good sense that CSU assess its students for the basic abilities one would assume a college student would possess. If these students don’t learn how to tell the difference between scholarship and nonsense in college, when will they? Isn’t that the whole point of education? To improve a person’s thinking and reasoning abilities, no matter where they fall on the continuum? Finally, I don’t think anyone is trying to “blame” technology in this article. Educators just want students to use it more intelligently when searching for information. If anything is to blame it is the poor critical/analytical skills of students, which is just exacerbated by technology.

Phil, at 10:20 am EST on January 5, 2007

It’s not about TECHNOLOGY.

It’s not about Technology; it’s about THINKING. When looking at a list of titles in a database hitlist, it’s being able to read those titles thoughtfully enough to make intelligent choices. When looking at citation/abstract information, it’s about reading thoughtfully. It’s understanding what a citation is (this is NOT a technological skill). “Clicking” is so easy. Thinking (and, for many students, the ability to read; which is not exactly the same skill/talent/art as “thinking") is not so easy.

Priscilla Atkins, at 4:55 pm EST on January 9, 2007

Don’t be so judgemental!

Larry wrote, “If you can’t tell the difference between a rant (anywhere) and a peer-reviewed piece of literature, you don’t belong in college. Colleges should be ashamed to admit these people. But, they sure love to admit them.” I have been teaching at the college level for almost ten years, and ignorant comments such as the quote, above, really get under my skin. What shall we do with the students who you believe “don’t belong in college?” Should we recycle them? Put them on government assistance? Here’s a novel idea — we could try giving them a shot at higher education and actually work to EDUCATE them.

Betsy, at 3:25 pm EST on January 10, 2007

Basics

David wrote, “Did you know that Cal State University doesn’t require students to pass any standardized exams in math and english as a condition to receive any degree?”

I can tell since David didn’t capitalize English.

I agree with Betsy. We must try to educate everyone we can, wherever we find them. Students need the basics as well as instruction in the effective use of technology.

Pam

Pam, Adjunct Professor at Concord Univeristy, at 10:50 am EST on January 13, 2007

Economics

I agree with Betsy. With the No Child Left Behind mandate, we have succeeded in letting no child get ahead. Public schools now teach anything but how to think. To assess, analyze and evaluate information is a basic educational skill that’s been neglected. If we refuse to admit students who lack these skills what will happen to them? As a taxpayer (and a Dem) I want them to become productive citizens.

Catherine Thomas, Associate Professor at Rappahannock Community College, at 4:45 pm EST on January 17, 2007

The Future

In my opinion, computer literacy is a key component in advancement in work and school. Understanding the application of navigation through the web and professional documents makes life, school, and work simpler. Everything is becoming computer base. Equipping the youth for the future is the objective for any school. By implementing the technology literacy test, it would later help future employers and future college student succeed with ease and only worry about on the job/school training techniques.

Dena, Student at VCU, at 11:11 am EST on January 23, 2007

Advertisement

 Jobs Related to Testing for Technology Literacy

or search for jobs directly.

Admissions Advisor
DeVry University

As one of the largest degree-granting higher education systems in North America, DeVry University provides high-quality, ... see job

Department Head for Special Education, Rehabilitation, Counseling/School Psychology
Auburn University

The College of Education (COE) at Auburn University seeks an innovative and experienced leader to lead the newly formed ... see job

Scientific Administrator
Weill Medical College of Cornell University

Founded in 1898, and affiliated with what is now New York-Presbyterian Hospital since 1927, Weill Cornell Medical College ... see job

British Literature: 17th & 18th Centuries
Bard College

Bard is a private liberal arts college with approximately 1,800 students, located 90 miles north of New York City on the ... see job

Coordinator of Learning Enrichment and Student Transitions
University of Montevallo

The University of Montevallo, Alabama’s public liberal arts university, enrolls approximately 3,000 students and emphasizes ... see job

Regional Coordinator — Center for Rural Health — Enid
Oklahoma State University

The OSU College of Osteopathic Medicine has been consistently ranked nationally in rural medicine and primary care by US News ... see job

Medical Billing and Coding Instructor
Apollo College

Opportunity to work with a dynamic and growing company!
see job

Database Administrator
Trinity Washington University

Trinity is a dynamic and vibrant university in the nation’s capitol experiencing growth in enrollment and opportunities. ... see job

Open Rank Position in Curriculum and Instruction, Specialization in Quantitative and/or Mixed Resear
University of Texas, Brownsville

[ Position Number: FY 07-33 ] Reports to: Chairperson of Curriculum & Instruction Department Scope: Teach research courses, ... see job

Supervisor I
Columbus State Community College

Columbus State Community College invests in employee development by providing numerous resources, partnerships, training and ... see job