[ Proceedings Contents ] [ Schedule ] [ Abstracts ] [ WAIER Home ]
In search of instructional design principles for online learning in higher educationLou SiragusaCurtin University of Technology |
![]() |
The assimilation of the Internet into higher education for delivering course materials to students has become common place. We have seen how the Internet has been successfully used to deliver courses entirely online as well as supporting traditional face-to-face classes. What is found, however, is that it is often just used as a depositary of information (such as course outlines and tutorial notes) for students to access, download and to print out. Educators are hearing from students dissatisfaction with the use of the Internet for learning as it appears that some costs of the course are being transferred to the students without any apparent benefits. Much of the online course development work being carried out is not informed by the vast body of knowledge of existing instructional design principles. There are ongoing concerns with how online learning can be made more meaningful to students.This paper presents a research study currently in progress that seeks to identify effective instructional design principles for online learning. The initial phase of this research will be presented with focus on how the survey instruments are being developed. The survey instruments are intended to collect students' and lecturers' perceptions of effective instructional design principles.
The vast body of knowledge and research referred to as instructional design has been largely overlooked by designers and developers of online learning environments. The Internet has undoubtedly provided a unique method of communication and delivery for participants in higher education (McBeath & Siragusa, 2000). Although creating Web pages is relatively easy, creating effective and useful Web pages is still difficult (Pan, 1998). It has been argued that existing principles of instructional design has application to this relative new medium in which all designers of educational Web-sites need to be acquainted with.
This paper presents a study in progress that aims to identify effective instructional design principles for online learning environments in higher education. It emphasises the development of survey instruments used to collect students' and lecturers' perceptions of the effectiveness of online learning environments.
Published literature regarding the use of the Internet for learning frequently comment on the need for sound instructional design to create effective online learning environments Chen (1998). The literature also reveals that decisions made at the instructional design phase of course development can influence and encourage different learning strategies that can be used by students (Smith & Ragan, 1999, pp. 138, 233-234; McLoughlin & Oliver, 1998; Bull, Kimball, & Stansberry, 1998, pp. 40-41).
The following will present some of the instructional design principles and learning strategies that were investigated by educators and researchers. These have been categorised as: Structure, Content, Motivation, Feedback/Help, Interaction, and Learning Strategies. The types of questions presented in these investigations have contributed to the design of the survey instruments used in this research.
Figure 1: The Dick and Carey systems approach model for designing instruction
(Dick & Carey, 1996, pp. 3-4)
Figure 2: Summary of the research design
As this research will focus on higher education, the questionnaires and interviews will be aimed at students and lecturers in universities within Western Australia. This will involve examining as many online educational Web sites as possible by finding online lecturers and students willing to participate. By questioning as many students and lecturers as possible, a clearer picture of what they perceived to be effective instructional design principles in online learning can be made.
The task, therefore, was to create questions that solicit students' perception of how well instructional design principles had been applied to their online learning environment. From the instructional design model shown in Figure 1, the questions in Table 1 were developed. These questions assisted with collecting students' perceptions of the effectiveness of each stage of the instructional design process.
| Stages | Questions |
| Assess needs to identify goal(s) | The learning materials were meaningful to me. I clearly understood what was expected of me. I clearly understood what resources (eg., textbooks, software, etc.) I required to assist me with my learning. I clearly understood when I should use these resources throughout the unit. |
| Conduct instructional analysis |
I clearly understood the steps that I needed to follow throughout the unit. I understood how the skills and knowledge that I learned throughout this unit helped to build my overall knowledge of the subject matter in this unit. |
| Analyse learners and contexts |
I felt that I had enough prior knowledge to succeed in this unit. The learning materials in this unit fitted in with my stage of development in this course. |
| Write performance objectives |
The objectives of this unit were clearly described to me. I clearly understood what skills and knowledge I had to learn in this unit. |
| Develop assessment instruments |
I clearly understood whether I had the required prerequisites to succeed in this unit. The test(s) in this unit provided a clear indication of what I had learned in this unit. |
| Develop instructional strategy |
The learning materials for this unit were well organised and followed a logical sequence. This unit was interesting. The online learning materials were appealing. The objectives for each topic were clearly defined. Which of the following activities did you participate in: * Group discussions * Case studies * Simulations * Projects * Other (Please describe) |
| Develop and select instructional materials |
The online component of this unit really helped me with my learning. My lecturer/tutor put careful thought into the development of the online learning materials (topic notes, lecturer notes, lab notes, etc). Please comment on how the online learning materials that you worked with could be improved. |
| Design and conduct formative evaluation of instruction |
I had no difficulties learning new information in this unit. I learned all I needed to know for this unit. I learned information that is relevant to me I can use the information that I learned with other units within my course. The content in this unit held my attention. I felt confident working through the course content. The content was clear and easy to understand. I was satisfied with my progress of learning as I worked through this unit. |
| Revise instruction | Please comment on the strengths of the content in this unit. Please comment on the weaknesses of the content in this unit. Please comment on how the content could be improved. |
| Design and conduct summative evaluation |
My results were better having a unit with an online support than units without online support. I found it easier to study with a unit with online support. It was more enjoyable to study a unit with online support. Please comment on the worst things about studying online. Please comment on the best things about studying online. Please make any other comments you wish to make including suggestions for change. |
As the survey instruments are seeking students' and lecturers' perceptions (affective), the majority of the questions were written in a five-point Likert-scale style format. The questionnaires also contained a combination of factual questions and open ended questions. The wording of the questions that appeared in the final survey were modified so as to relate to online learning environments in higher education. The Background section presented a number of studies that used questions to identify instructional design principles for online learning. These questions were also incorporated into the survey instruments for this research.
Table 2 shows the dimensions used for the questionnaire and interview schedule to be administered to the students. Table 3 shows the dimensions used for the questionnaire and interview schedules to be administered to the lecturers. The questionnaires for both students and lecturers are to be administered online. The user, after completing the questionnaire, will then click on the Submit button that will pass on the responses to the researcher via email. The responses will then be sorted (by the use of a macro) into an Excel worksheet ready for analysis. The interview schedules will be modified according to the responses obtained from the questionnaire and will be administered to either individual participants or in a group interview setting.
| Dimension | Description |
| Structure/ Organisation | This described how the information was displayed to students on the Web. This also described in what order the learning materials were found. |
| Content | This described the content of the learning materials that students worked through. Content included the subject/course content, assignments, activities, case studies, lecturer/tutorial/laboratory notes, reading materials, tests, etc. |
| Motivation | This described how the learning materials and the online learning environment were made appealing and interesting for students to increase their levels of motivation. |
| Feedback/help | This described how students obtained coursework feedback and technical help. |
| Interaction | This described how students communicated with each other and with their instructor. |
| Learning strategies | This described what learning strategies instructors encouraged students to use and what learning strategies students found effective. |
| Dimension | Description |
| Importance of the use of the Internet for teaching | This described lecturers' attitudes towards online learning. This examined how important to the lecturer is the use of the Internet for student learning. |
| Abilities to use the Internet for teaching | This described what skills do lecturers have to be able to create materials for online learning. This also described the time taken for lecturers to learn appropriate skills for online delivery of classes. |
| Internet support and training | This described what sort of technical support for online learning is available to lecturers and where it is utilised. This also described the amount of training available for delivery of classes online. |
| Decision making process | This described the level of inputs lecturers have with the decision making process of online learning development and administration. |
| Development activities | This described the amount of involvement lecturers have with the design and development of online learning environments. This also described what informs lecturers about instructional design principles for online learning including what learning strategies they encourage their students to use. |
| Survey instrument | URL |
| Student questionnaire | http://learnt.smec.curtin.edu.au/Siragusa/students.htm |
| Lecturer questionnaire | http://learnt.smec.curtin.edu.au/Siragusa/lecturers.htm |
A difficulty with piloting a questionnaire in an online format is getting feedback from students and lecturers. With paper-based questionnaires, respondents can just write any comments about the questions (such as "I don't understand what this question means") directly onto the questionnaire. To overcome this difficulty, text boxes (coloured green) were provided on the pilot questionnaires at the end of each section so that the respondents could type in comments about the questions.
Students from the Faculty of Education at Curtin University of Technology were selected for the initial pilot of the student questionnaire. The students who participated attended a face-to-face delivered class that was supported with an online component. Lecturers from the Faculty of Education at Curtin University were also asked to participate in the initial pilot. The results from these pilots are presented in the following section.
Initial reactions from both lecturers and students to the pilot were generally positive. There were minor comments provided by the lecturers and students about some of the questions in the online questionnaires. These comments resulted in modifications of both the student and lecturer online questionnaires.
At the time of writing, two lecturers participated in the initial pilot of the online questionnaire for lecturers. Table 6 shows the brief statistics for the affective questions in the "Importance of the use of the Internet for teaching" section of the lecturer questionnaire. As with Table 5, Table 7 shows examples of item response charts for questions 13 and 14.
| Res = | 0 | 1 | 2 | 3 | 4 | 5 | pol. | mean | s.d. | cor. |
| 20 | 25% | 13% | 63% | + | 4.38 | 0.86 | - 0.02 | |||
| 21 | 38% | 38% | 25% | + | 3.88 | 0.78 | - 0.14 | |||
| 22 | 13% | 88% | + | 4.88 | 0.33 | 0.48 | ||||
| 23 | 13% | 63% | 25% | - | 3.88 | 0.60 | - 0.05 | |||
| 24 | 13% | 50% | 38% | + | 5.25 | 0.66 | 0.29 | |||
| 25 | 13% | 13% | 38% | 38% | + | 3.88 | 1.27 | 0.42 | ||
| 26 | 13% | 63% | 25% | - | 3.88 | 0.60 | 0.48 | |||
| 27 | 13% | 13% | 50% | 13% | 13% | + | 3.00 | 1.12 | 0.55 | |
| 28 | 13% | 50% | 25% | 13% | + | 4.25 | 1.09 | 0.09 | ||
| 29 | 13% | 38% | 50% | + | 4.38 | 0.70 | 0.35 | |||
| 30 | 13% | 88% | + | 2.88 | 0.33 | 0.48 | ||||
| 31 | 50% | 25% | 25% | + | 3.75 | 0.83 | 0.22 | |||
| 32 | 100% | - | 4.00 | 0.00 | 0.00 | |||||
| NR = No response, SD = Strongly disagree, D = Disagree, U = Uncertain, A = Agree, SA = Strongly agree | ||||||||||
| Res = | 0 | 1 | 2 | 3 | 4 | 5 | pol. | mean | s.d. | cor. |
| 13 | 50% | 50% | + | 4.50 | 0.50 | 1.00 | ||||
| 14 | 100% | + | 5.00 | 0.00 | 0.00 | |||||
| 15 | 50% | 50% | + | 3.50 | 0.50 | 1.00 | ||||
| 16 | 50% | 50% | + | 3.50 | 0.50 | - 1.00 | ||||
| 17 | 50% | 50% | + | 4.00 | 1.00 | 1.00 | ||||
| 18 | 100% | + | 4.00 | 0.00 | 0.00 | |||||
| 19 | 50% | 50% | + | 5.00 | 1.00 | 1.00 | ||||
| 20 | 50% | 50% | + | 3.50 | 0.50 | - 1.00 | ||||
| 21 | 50% | 50% | + | 3.50 | 1.50 | 1.00 | ||||
| 22 | 100% | + | 4.00 | 0.00 | 0.00 | |||||
| 23 | 100% | + | 5.00 | 0.00 | 0.00 | |||||
| 24 | 50% | 50% | + | 5.00 | 1.00 | 1.00 |
The results presented in Table 4 indicate an average mean of approximately 4.09. This would normally be considered a favourable result as 4 represents Agree to the positively constructed questions. There are, however, some questions that may give the wrong impression such as question 30 "There was a good mix of media (eg., graphics, sound and animation)." This question may not be relevant to this particular Web-site as sound and animation may not be needed for this Web-site. Question 30 may unnecessarily lower the average mean. The final analysis, therefore, will need to take these factors into account.
The results of the data collected at this stage are inconclusive as the sample presented here is quite small. The purpose of the data collection was to pilot the questionnaires to assess the validity of the questions and to test the response submission process. The results shown in Tables 4, 5, 6 and 7 demonstrate how the data from the actual sample population may be analysed.
At the time of writing this paper, the author is still seeking lecturers and students in higher education who would be interested in participating in this study. Interest can be registered to the author via email at: siragusa@ses.curtin.edu.au. All comments are most welcome.
Bull, K. S., Kimball, S. L., & Stansberry, S. (1998). Instructional Design in Computer Mediated Learning. Paper presented at Coming Together: Preparing for Rural Special Education in the 21st Century. Conference Proceedings of the American Council on Rural Special Education (18th, Charleston, SC, March 25-28, 1998), USA, Oklahoma.
Chandler, B., & Maddux, C. D. (1998). Student Use of Instructors' Web Sites. Paper presented at SITE 98: Society for Information Technology & Teacher Education International Conference (9th, Washington, DC, March 10-14, 1998). Proceedings, USA, Nevada.
Chen, L. L. (1998). Web-Based Distance Instruction: Design and Implications of a Cybercourse Model. Paper presented at the Proceedings of Selected Research and Development Presentations at the National Convention of the Association for Educational Communications and Technology (AECT) Sponsored by the Research and Theory Division (20th, St. Louis, MO, February 18-22, 1998), USA, Michigan.
Cohen, L., & Manion, L. (1994). Research Methods in Education (4th ed). London: Routledge.
Denzin, N. K. (1970). The Research Act in Sociology: A Theoretical Introduction to Sociological Method. London: The Butterworth Group.
Dick, W., & Carey, L. (1996). The Systematic Design of Instruction (4th ed). New York: HarperCollins College Publishers.
Everett, D. R. (1998). Taking Instruction Online: The Art of Delivery. Paper presented at the SITE 98: Society for Information Technology & Teacher Education International Conference (9th, Washington, DC, March 10-14, 1998). Proceedings, USA, Kentucky.
Foley, G., & Schuck, S. (1998). Web-based conferencing: Pedagogical asset or constraint? Australian Journal of Educational Technology, 14(2), 122-140. http://www.ascilite.org.au/ajet/ajet14/foley.html
Forsyth, I. (1996). Teaching and learning materials and the Internet. London: Kogan Page.
Fraser, B. J. (1998). Classroom environment instruments: Development, validity and applications. Learning Environments Research, 1, 7-33.
Graham, M., & Scarborough, H. (1999). Computer mediated communication and collaborative learning in an undergraduate distance education environment. Australian Journal of Educational Technology, 15(1), 20-46. http://www.ascilite.org.au/ajet/ajet15/graham.html
Greening, T. (1998). WWW support of student learning: A case study. Australian Journal of Educational Technology, 14(1), 49-59. http://www.ascilite.org.au/ajet/ajet14/greening.html
Hawkes, M., Cambre, M., & Lewis, M. (1998). The Ohio SchoolNet Telecommunity Evaluation. Paper presented at the North Central Regional Educational Lab., Oak Brook, IL, USA, Illinois.
Jiang, M., & Ting, E. (1998). Course Design, Instruction, and Students' Online Behaviors: A Study of Instructional Variables and Students' Perceptions of Online Learning. Paper presented at the Annual Meeting of the American Educational Research Association (San Diego, CA, April 13-17, 1998), USA, New York.
MacDonald, J., & Mason, R. (1998). Information Skills and Resource-Based Learning in an Open University Course. The Journal of Open and Distance Learning, 13(1), 38-42.
Mathison, S. (1988). Why triangulate? Educational Researcher, 17(2), 13-17.
McBeath, C. and Siragusa, L. (2000). The place of instructional design in higher education in the computer age. In Flexible Learning for a Flexible Society, Proceedings of ASET-HERDSA 2000 Conference. Toowoomba, Qld, 2-5 July. ASET and HERDSA. http://www.ascilite.org.au/aset-archives/confs/aset-herdsa2000/procs/mcbeath.html
McLoughlin, C., & Oliver, R. (1998). Meeting the needs of gifted and talented students through technology supported distance teaching. Australian Journal of Educational Technology, 14(1), 35-48. http://www.ascilite.org.au/ajet/ajet14/mcloughlin.html
Mory, E. H., Gambill, L. E., & Browning, J. B. (1998). Instruction on the Web: The online student's perspective. Paper presented at the SITE 98: Society for Information Technology & Teacher Education International Conference (9th, Washington, DC, March 10-14, 1998). Proceedings." USA, North-Carolina, Washington, DC.
Nelson, L. R. (2000). Lertap. Perth: Curtin University of Technology.
Oliver, R., Herrington, J. and Omari, A. (1996). Creating effective instructional materials for the World Wide Web. Proceedings AusWeb96. http://ausweb.scu.edu.au/aw96/educn/oliver/
Oliver, R., & Omari, A. (1999). Using online technologies to support problem based learning: Learners' responses and perceptions. Australian Journal of Educational Technology, 15(1), 58-79. http://www.ascilite.org.au/ajet/ajet15/oliver.html
Pan, A. C. (1998). Optimize the Web for Better Instruction. Paper presented at SITE 98: Society for Information Technology & Teacher Education International Conference (9th, Washington, DC, March 10-14, 1998). Proceedings. USA, New-Jersey, Washington, DC.
Pujola, J. T. (1998). Ewebuation. Edinburgh-Working-Papers-in-Applied-Linguistics, 9, 104-115.
Ravitz, J. (1998). Conditions that facilitate teachers' Internet use in schools with high Internet connectivity: Preliminary findings. Paper presented at the Proceedings of Selected Research and Development Presentations at the National Convention of the Association for Educational Communications and Technology (AECT) Sponsored by the Research and Theory Division (20th, St. Louis, MO, February 18-22, 1998), USA, Massachusetts.
Schlough, S., & Bhuripanyo, S. (1998). The Development and Evaluation of the Internet Delivery of the Course "Task Analysis". Paper presented at SITE 98: Society for Information Technology & Teacher Education International Conference (9th, Washington, DC, March 10-14, 1998). Proceedings, USA, Wisconsin.
Shih, C. C., Ingebritsen, T., Pleasants, J., Flickinger, K., & Brown, G. (1998). Learning Strategies and Other Factors Influencing Achievement via Web Courses. Paper presented at Distance Learning '98. Proceedings of the Annual Conference on Distance Teaching & Learning (14th, Madison, WI, August 5-7, 1998), USA, Iowa.
Smith, P. L., & Ragan, T. J. (1999). Instructional Design ( 2nd ed.). New York: John Wiley & Sons, Inc.
Summerville, J. B. (1998). The Role of Awareness of Cognitive Style in Hypermedia. Paper presented at the Proceedings of Selected Research and Development Presentations at the National Convention of the Association for Educational Communications and Technology (AECT) Sponsored by the Research and Theory Division (20th, St. Louis, MO, February 18-22, 1998), USA, Kansas.
Swan, K., Bowman, J., Holmes, A., Sylvie, S., & Vargas, J. (1998-99). "Reading" The Web: Making Sense On the Information Superhighway. Journal of Educational Technology Systems, 27(2), 95-104.
Thomas, P., Carswell, L., Price, B., & Petre, M. (1998). A Holistic Approach To Supporting Distance Learning Using the Internet: Transformation, Not Translation. British Journal of Educational Technology, 29(2), 149-161.
Wagner, E. D. (1998). Interaction Strategies for Online Training Designs. Paper presented at Distance Learning '98. Proceedings of the Annual Conference on Distance Teaching & Learning (14th, Madison, WI, August 5-7, 1998), USA, California.
| Author: Lou Siragusa 2 Urbahns Crescent, Bateman WA 6150 Ph: +61 8 9332 1114 Fax: +61 8 9332 1114 Email: siragusa@ses.curtin.edu.au Please cite as: Siragusa, L. (2001). In search of instructional design principles for online learning in higher education. Proceedings Western Australian Institute for Educational Research Forum 2000. http://www.waier.org.au/archives/forums/2001/siragusa.html |