Multi-criteria evaluation of the web-based e-learning system

A methodology based on learner satisfaction and its applications

Daniel Y. Shee, Yi Shun Wang

Research output: Contribution to journalArticle

210 Citations (Scopus)

Abstract

The web-based e-learning system (WELS) has emerged as a new means of skill training and knowledge acquisition, encouraging both academia and industry to invest resources in the adoption of this system. Traditionally, most pre- and post-adoption tasks related to evaluation are carried out from the viewpoints of technology. Since users have been widely recognized as being a key group of stakeholders in influencing the adoption of information systems, their attitudes toward this system are pivotal. Therefore, based on the theory of multi-criteria decision making and the research products of user satisfaction from the fields of human-computer interaction and information systems, this study proposed a multi-criteria methodology from the perspective of learner satisfaction to support those evaluation-based activities taking place at the pre- and post-adoption phases of the WELS life cycle. In addition, by following this methodology, this study empirically investigated learners' perceptions of the relative importance of decision criteria. This investigation carried out a survey of college students, and the data thus obtained was then analyzed by analytic hierarchy process in order to derive an integrated preference structure of learners as a ground for evaluation. We found that learners regarded the learner interface as being the most important dimension of decision criteria. Future applications of these results are recommended and the implications are discussed.

Original languageEnglish
Pages (from-to)894-905
Number of pages12
JournalComputers and Education
Volume50
Issue number3
DOIs
Publication statusPublished - 2008 Apr 1

Fingerprint

electronic learning
Learning systems
Information systems
Knowledge acquisition
Analytic hierarchy process
methodology
Human computer interaction
evaluation
Life cycle
information system
Decision making
Students
decision making criterion
knowledge acquisition
life cycle
Industry
stakeholder
industry
interaction
resources

All Science Journal Classification (ASJC) codes

  • Computer Science(all)
  • Education

Cite this

@article{4669a87896b94033ac069efbefa9277e,
title = "Multi-criteria evaluation of the web-based e-learning system: A methodology based on learner satisfaction and its applications",
abstract = "The web-based e-learning system (WELS) has emerged as a new means of skill training and knowledge acquisition, encouraging both academia and industry to invest resources in the adoption of this system. Traditionally, most pre- and post-adoption tasks related to evaluation are carried out from the viewpoints of technology. Since users have been widely recognized as being a key group of stakeholders in influencing the adoption of information systems, their attitudes toward this system are pivotal. Therefore, based on the theory of multi-criteria decision making and the research products of user satisfaction from the fields of human-computer interaction and information systems, this study proposed a multi-criteria methodology from the perspective of learner satisfaction to support those evaluation-based activities taking place at the pre- and post-adoption phases of the WELS life cycle. In addition, by following this methodology, this study empirically investigated learners' perceptions of the relative importance of decision criteria. This investigation carried out a survey of college students, and the data thus obtained was then analyzed by analytic hierarchy process in order to derive an integrated preference structure of learners as a ground for evaluation. We found that learners regarded the learner interface as being the most important dimension of decision criteria. Future applications of these results are recommended and the implications are discussed.",
author = "Shee, {Daniel Y.} and Wang, {Yi Shun}",
year = "2008",
month = "4",
day = "1",
doi = "10.1016/j.compedu.2006.09.005",
language = "English",
volume = "50",
pages = "894--905",
journal = "Computers and Education",
issn = "0360-1315",
publisher = "Elsevier Limited",
number = "3",

}

Multi-criteria evaluation of the web-based e-learning system : A methodology based on learner satisfaction and its applications. / Shee, Daniel Y.; Wang, Yi Shun.

In: Computers and Education, Vol. 50, No. 3, 01.04.2008, p. 894-905.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Multi-criteria evaluation of the web-based e-learning system

T2 - A methodology based on learner satisfaction and its applications

AU - Shee, Daniel Y.

AU - Wang, Yi Shun

PY - 2008/4/1

Y1 - 2008/4/1

N2 - The web-based e-learning system (WELS) has emerged as a new means of skill training and knowledge acquisition, encouraging both academia and industry to invest resources in the adoption of this system. Traditionally, most pre- and post-adoption tasks related to evaluation are carried out from the viewpoints of technology. Since users have been widely recognized as being a key group of stakeholders in influencing the adoption of information systems, their attitudes toward this system are pivotal. Therefore, based on the theory of multi-criteria decision making and the research products of user satisfaction from the fields of human-computer interaction and information systems, this study proposed a multi-criteria methodology from the perspective of learner satisfaction to support those evaluation-based activities taking place at the pre- and post-adoption phases of the WELS life cycle. In addition, by following this methodology, this study empirically investigated learners' perceptions of the relative importance of decision criteria. This investigation carried out a survey of college students, and the data thus obtained was then analyzed by analytic hierarchy process in order to derive an integrated preference structure of learners as a ground for evaluation. We found that learners regarded the learner interface as being the most important dimension of decision criteria. Future applications of these results are recommended and the implications are discussed.

AB - The web-based e-learning system (WELS) has emerged as a new means of skill training and knowledge acquisition, encouraging both academia and industry to invest resources in the adoption of this system. Traditionally, most pre- and post-adoption tasks related to evaluation are carried out from the viewpoints of technology. Since users have been widely recognized as being a key group of stakeholders in influencing the adoption of information systems, their attitudes toward this system are pivotal. Therefore, based on the theory of multi-criteria decision making and the research products of user satisfaction from the fields of human-computer interaction and information systems, this study proposed a multi-criteria methodology from the perspective of learner satisfaction to support those evaluation-based activities taking place at the pre- and post-adoption phases of the WELS life cycle. In addition, by following this methodology, this study empirically investigated learners' perceptions of the relative importance of decision criteria. This investigation carried out a survey of college students, and the data thus obtained was then analyzed by analytic hierarchy process in order to derive an integrated preference structure of learners as a ground for evaluation. We found that learners regarded the learner interface as being the most important dimension of decision criteria. Future applications of these results are recommended and the implications are discussed.

UR - http://www.scopus.com/inward/record.url?scp=38649100659&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=38649100659&partnerID=8YFLogxK

U2 - 10.1016/j.compedu.2006.09.005

DO - 10.1016/j.compedu.2006.09.005

M3 - Article

VL - 50

SP - 894

EP - 905

JO - Computers and Education

JF - Computers and Education

SN - 0360-1315

IS - 3

ER -