large scale evaluation of the effectiveness of computer based resources: A research methodology

Abstract

The perceived effectiveness of computer based resources on the learning opportunities of a large group of first year students within the context of a single biology course was investigated. The resources included tutorial and self-assessment modules, on-line materials and communications technologies. The research model considered the views of the students and teaching staff, in order to investigate the alignment/non-alignment of staff-student perceptions of the resources. An action research methodology was adopted to explore stakeholders’ perceptions as they participated in the teaching and learning process from the commencement of the course to its completion. Data of expected and realised use and usefulness of the various resources in student learning were collected using surveys and focus groups. Data show that 75% of students made use of the computer based tutorials provided to support their learning, with the majority (91%) of students who used the materials finding them useful. Student use of email was high, with 97% of all students surveyed indicating some use (mostly non-course related), however approximately 10% of the entire cohort found email useful in supporting student learning in this course. There was a misalignment between staff expectations of use of computer based resources and students’ actual use, which needs to be addressed. The paper presents the research model, discusses why it was chosen and shows some of the current results.