|
Introduction
The following list describes three types of errors that are commonly
made involving research on audience response systems.
1. Research Methodology Errors/Limitations – Made by the Researchers
2. Research Conclusion Errors – Made by the Researchers
3. Research Citation Errors – Made by Those Citing the Research
The first type of error reflects weaknesses in the experimental design
of the studies. The second type of error occurs when authors draw
conclusions from their own studies that are not warranted by the study’s
methodology or data. The third type of error occurs when people cite
other people’s studies in ways that are not warranted by the original
study’s methodology or data.
While the following information—because it focuses on problems—may
appear damning if taken out of context, finding flaws in research
methodology and research conclusions is an inherent part of the
scientific process. Those who do not do science sometimes get the
impression that research reveals its results in one or two perfect
definitive studies. This is rarely the case, especially when the
research focuses on the massive chaos that is human behavior, as is the
case when we examine learning. To verify research conclusions, many
studies are required. It should also be recognized that doing research
on the effects of classroom learning is especially difficult due to the
inherent complexity of equalizing non-treatment variables. For example,
it’s virtually impossible to limit the effect of an instructor’s
enthusiasm for one method versus another.
Research on audience response systems is in the
“baby-is-not-even-crawling-yet” stage of its development. While I will
provide examples of research problems below, please remember that this
should not be taken as an indictment of researchers or those who draw
conclusions from their work. Research is generally done by good people
with the most honorable of intentions. It is researchers, after all, who
work to expand our knowledge and to improve practice. Research only
moves forward after it is burnished in the fiery crucible of criticism.
Researchers understand and value this. Those of you who are not
researchers should avoid any knee-jerk reactions to throw out the
research baby with the research bath water.
Will's Note: This section is not yet complete, but will be available
shortly, so check back soon. To get on the mailing list so that you'll
be reminded, click SUBSCRIBE below.
|
