Blog

Assessing the Impact of Technology on Learning

As I work on an instrument to assess an upcoming pilot’s impact on learning, I’m reminded of my long-held position about this (wish I could find the ol’ post) when I’m asked about technology and learning. Instead of trying to measure the impact of technology on learning, I believe we should measure the impact of technology based upon why we brought it into the learning environment.

For example, wikis are usually brought into the classroom to promote collaboration. Therefore, I wouldn’t try to measure the impact of wikis on learning. I’d attempt to measure the impact of wikis on collaboration. Correlation? Causation?

There are certainly flaws here that those interested in research are quickly able to identify. But I recently read Why Tablets Are Important for Educating Our Children and I’m reminded of another flaw: not valuing the simple yet powerful opinion of the teacher.

“It is not what the technology can do that makes it important, it is the way it has reignited passion and ideas in teachers. If these devices are being championed by teachers, listen to what they are saying. These teachers are not just championing the technology, they are celebrating a new way of teaching and learning. Something about these devices has helped many teachers to see the classroom very differently. That should be encouraged, supported and most thoroughly welcomed” (Dan Donahoo)

And this is an issue.

In our efforts to dismiss the qualitative for the quantitative and label anything not research-journal ready as anecdotal, we lose sight of an important thing we should “see”: the human spirit.

While the buzz of new will fade, I don’t want to ever dismiss the value of teachers becoming energized, rejuvenated, and focused on shifting due to a change they embrace.

So as I sit working on our pilot, I’m constantly reminding myself that our stories and observations help us understand. The human spirit helps us understand. The opinions of teachers and students help us understand. To dismiss these for a purely scientific research study deeply rooted in the quantitative is just as narrow-minded as thinking numbers don’t matter.

  1. Kim Flintoff11-12-2012

    Wow, talk about synchronicity… Not an hour ago I started pondering on moreorless the same things… Was looking at some work being done in the area of assessing public value that seems to offer some hope. Looking forward to following your investigations…

  2. I’ve just launched a personal campaign to expunge the term “data-driven” from popular discourse: there is a meaningful alternative, “data-informed”, which lacks the faux objectivity and scientism of the notion that the conclusions we reach from data are always or mostly clear and obvious. Information cannot be given the authority to make decisions about the destinations we should look towards or the interpretations we put on it–human interpeters of data do that, and are merely attempting to obfuscate their choices by ascribing an impossible level of agency to the information they are arguing supports their perspective.
    http://t.co/DexNTGFD
    It’s not just a matter of trustung the opinion of the teacher–it’s the experience and direct observations of the teacher which are the most important part of any assessment effort. Some of what teachers use to assess can be recorded in ways that are quantifiable, but the most important parts of the process are not convertible into the “data” types which number crunchers crave.
    There’s a post by some one recently decrying the currently fashionable term “rigor” and urging us to look instead for “vigor.” Wish I could find that post….
    ;>}

Leave a Reply