Key words
|
Web evaluation; quality; function; credibility; reliability; attractiveness; systematic structure; navigation |
INTRODUCTION
|
A study found by Kerner (2010), the total number of domain name (Top Level Domain (TLD)) registration was 196.3 million. World Wide Web Size (n.d) released a statistic shows that the indexed Web contains 12.08 billion pages (as of 1st November 2011) and number of Internet users (as of 31st March, 2011) was 2,095,006,005 (Internet World Stats, n.d). The level of interactivity has a positive associate with overall Web site performance (Auger, 2005). Overall, this positive performance has positive influence online consumers’ perception and behaviour (Flavian et. al, 2009). |
There are many sets of criteria available on online and from the researchers’ evaluation criteria Web site (Smith, 1999, 2001) and the effective evaluation of Web sites has therefore become a point of concern for practitioners and researchers (Chiou et al., 2010). Overall, Cunliffe (2000) identified informal Web site development model, which are covers to establish the need before the Web site is adopted as a solution; gather information before any Web site development takes place; develop and evaluate before creating the complete site; implementation should be done once all design decisions have been finalised; and maintain, which is continuously after the site has been launched. |
The objective of this study is to review the current Web site evaluation criteria based on previous theoretical considerations and studies. |
WEB SITE EVALUATION CRITERIA
|
Smith (2001) adapted Eschenfelder et al’s (1997) Criteria for the Evaluation of Government Web sites and applied to sample of five Web sites of New Zealand government entities. The study shows that it is important that Web sites should provide orientation information, conditions for re-use of information be made clear, privacy concerns be addressed, print materials be properly adapted to the web environment, materials be kept current, that contact details to be available, metadata be used effectively, external links be made appropriately, pages be accessible to users with disabilities, and help information on search engines and other facilities be made available to users. |
A literature survey done by Kim et al. (2003), found that six categories of Web site evaluation criteria, which are business function, corporation credibility, content's reliability, Web site attractiveness, systematic structure and navigation. They even have used these criteria to evaluate whether there are differences in Web site design between 12 industries in Korea. Their study found that there are significant differences in the design of Web sites across these different industry groups. |
World Best Enterprises (2004) developed the Quality Criteria for Web site Excellence. To achieve the World Best Web site awards, five criteria at the level 1 are required. The quality for Web site excellence should cover functionality, design, content, originality, and professionalism and effectiveness. |
Au Yeung and Law (2004) focused on usability and functionality in their study on applied the modified heuristic evaluation technique to compute Usability Hazards Indices of hotel Web sites in Hong Kong. Their study found that due to the strong support and wide operation scale, chain hotels received overall Usability Hazards Indices, which were significantly lowered than independent hotels. |
De Wulf et al. (2006) developed and empirically validated a process model of Web site success in an online shopping context by identifying the role of pleasure as a key mediating variable. Web site evaluation includes content, organisation and technology factors were posited as affecting the successes, which are involving satisfaction, commitment and trust of a multi-dimensional Web site. They found that pleasure partially mediated the evaluations–success relationship. Secondly, the analysis also found significant support for direct relationships between Web site evaluations and success. |
Law et al. (2010) reviewed tourism studies that pertain to methodological approaches to Web site evaluation, which were published from 1996 to July 2009. The prior research can be divided into five evaluation approaches, which are counting, automated, numerical computation, user judgment and combined methods. |
Park and Gretzel (2007) suggested 12 unified factors of Web site evaluation, which are ease of use, information quality, responsiveness, visual appearance, security/privacy, interactivity, trust, fulfillment, personalisation, advertising/persuasion, playfulness and technology integration. Woodside et al. (2011) also focused on two mainstreams of Web site quality, which are content richness and ease of use. To increase the applicability of evaluation frameworks, Chiou et al. (2010) condensed each study’s dimensional factors into Park and Gretzel’s (2007) 12 unified factors. Their review showed that most studies conducted user-based surveys to examine a Web site, but that very few addressed strategic issues of Web site evaluation. Thus, they proposed a strategic framework as an internal evaluation to ensure consistency between web strategy and actual Web site presence, which was involved analysis of Web strategy and a hybrid approach that included evaluation during three transaction phases; the framework was designed to be applied by a specific Web site vis-à-vis its goals and objectives through a five-stage evaluation process (see Figure 1). Flavian et al. (2009) mentioned that a Web site design should be addressed to simplicity and freedom of navigation provides clear, timely and accurate information in all its contents and an appearance that calls for the users’ attention. |
A review done by Tsai et al. (2010) on relevant criteria for assessing national park Web sites (see Table 1) showed that Web site Quality Evaluation Criteria should cover navigability, speed, links, relevancy, richness, currency, attractiveness, security, personalisation and responsiveness. |
Ip et al. (2011) proposed a Web site evaluation framework that includes evaluation by phases, evaluation by features and evaluation by features and effectiveness. They analysed prior studies of tourism and hospitality Web site evaluation (see Figure 2). |
Another review done by Dickinger and Stangl (2011) finalised previous 11 research works on Web site evaluation criteria (see Table 2). Dickinger and Stangl (2011) suggested a theory-based alternative, formative measurement approach for Web site performance. The construct comprised eight dimensions. All these dimensions are system availability, ease of use, usefulness, navigational challenge, Web site design, content quality, trust and enjoyment. Their study developed a sound and parsimonious measure allowing the monitoring and benchmarking of traveler perceptions over time. |
Chou and Cheng’s (2011) study aimed to build a hybrid approach that combines the fuzzy analytic network process (FANP) and fuzzy VlseKriterijumska Optimizacija I Kompromisno Resenje (FVIKOR) for evaluating Web site quality of the top-four CPA firms in Taiwan and provide worthwhile recommendations for enhancing Web site design and content. Their finding found that these four CPA firms did not utilise the Internet to its full potential and need to improve their Web sites. Deloitte has the best overall performance, followed by PricewaterhouseCoopers, Ernst & Young and KPMG. Additionally, the top-five evaluation criteria in order of importance are richness, understandability, assurance, relevance and reliability (see Figure 3). |
CONCLUSION
|
This study found that the existing literatures do not have any commonly agreed-upon standards or techniques for Web site evaluation. However, Web site evaluation focuses on 3 main areas, which are Web site attributes, organisation and technology. Even, Wulf et al.’s (2006) study involved three higher-order dimensions, which are Web content, crganisation and technology. The summary of the literatures can be referred to Table 3. |
|
Tables at a glance
|
|
|
Figures at a glance
|
|
|
|
Figure 1 |
Figure 2 |
Figure 3 |
|
|
References
|
- Ahn, T., Ryu, S. and Han, I. (2007). The Impact of Web Quality and Playfulness on User Acceptance of Online Retailing. Information & Management, 44(3), 263-275.
- Barnes, S. and Vidgen, R. (2002). An Integrative Approach to the Assessment of E-Commerce Quality. Journal of Electronic Commerce Research, 3(3), 114-127.
- Bilsel, R.U., Büyüközkan, G. and Ruan, D. (2006). A Fuzzy Preference-Ranking Model for A Quality Evaluation of Hospital Web sites. International Journal of Intelligent Systems, 21(11), 1181-1197.
- Cao, M., Zhang, Q. and Seydel, J. (2005). B2C E-Commerce Web site Quality: An Empirical Examination. Industrial Management & Data Systems, 105(5), 645-661.
- Chiou, W.C., Lin, C.C. and Perng, C. (2010). A Strategic Framework for Website Evaluation Based on A Review of the Literature from 1995-2006. Information & Management, 47(5-6), 282-290.
- Chu, R. (2001). What Online Hong Kong Travelers Look for on Airline/Travel Websites?. International Journal of Hospitality Management, 20(1), 95-100.
- Cunliffe, D. (2000). Developing Usable Web sites – A Review and Model. Internet Research: Electronic Networking Applications and Policy, 10(4), 295-307.
- Dabholkar, P.A. and Bagozzi, R.P. (2002). An Attitudinal Model of Technology-based Self-Service: Moderating Effects of Consumer Traits and Situational Factors. Journal of the Academy of Marketing Science, 30(3), 184-201.
- Davis, F.D., Bagozzi, R.P. and Warshaw, P.R. (1989). User Acceptance of Computer Technology: A Comparison of Two Theoretical Models. Management Science, 35(8), 982-1003.
- De Wulf, K., Schillewaert, N., Muylle, S. and Rangarajan, D. (2006). The Role of Pleasure in Web site Success. Information & Management, 43(4), 434-446.
- Dickinger, A. and Stangl, B. (2011). Website Performance and Behavioral Consequences: A Formative Measurement Approach. Journal of Business Research, In Press, Corrected Proof.
- Eschenfelder, K.R., Beachboard, J.C., McClure, C.R. and Wyman, S.K. (1997). Assessing US Federal Government Websites. Government Information Quarterly, 14(2), 173-189.
- Flavian, C., Gurrea, R. and Orús, C. (2009). Web Design: A Key Factor for the Website Success. Journal of Systems and Information Technology, 11(2), 168-184.
- Ho, C.I. and Lee, Y.L. (2007). The Development of an E-Travel Service Quality Scale. Tourism Management, 28(6), 1434-1449.
- Huizingh, E.K.R.E. (2000). The Content and Design of Web sites: An Empirical Study. Information & Management, 37(3), 123-134.
- Internet World Stats (n.d). Internet Usage Statistics – The Internet Big Picture. Available at: http://www.internetworldstats.com/stats.htm.
- Ip, C., Law, R. and Lee, H. (2011). A Review of Website Evaluation Studies in the Tourism and Hospitality Fields from 1996 to 2009. International Journal of Tourism Research, 13(3), 234-265.
- Lee, Y. and Kozar, K.A. (2006). Investigating the Effect of Website Quality on E-
- Business Success: an Analytic Hierarchy Process (AHP) Approach. Decision Support Systems, 42(3), 1383-1401.
- Kerner, S.M. (2010). 196 Million Domain Names and Counting, Enterprise Networking Planet. Available at: http://www.enterprisenetworkingplanet.com/netsp/article.php/3905286/196-Million-Domain-Names-and-Counting.htm.
- Kim H. and Fesenmaier, D.R. (2008). Persuasive Design of Destination Web sites: An Analysis of First Impression. Journal of Travel Research, 47(1), 3-13.
- Kim, S.E., Shaw, T. and Schneider, H. (2003). Web Site Design Benchmarking Within Industry Groups. Internet Research: Electronic Networking Applications and Policy, 13(1), 17-26.
- DeLone, W.H. and McLean, E.R. (1992). Information Systems Success: The Quest for the Dependent Variable. Information Systems Research, 3(1), 60-95.
- Mathwick, C. and Rigdon, E. (2004). Play, Flow, and the Online Search Experience. The Journal of Consumer Research, 31(2), 324-332.
- Miranda-González, F.J. and Banegil-Palacios, T.M. (2004). Quantitative Evaluation of Commercial Web sites: An Empirical Study of Spanish Firms. International Journal of Information Management, 24(4), 313-328.
- Parasuraman, A., Zeithaml, V.A. and Malhotra, A. (2005). E-S-Qual: A Multiple-Item Scale for Assessing Electronic Service Quality. Journal of Service Research, 7(3), 213-233.
- Park, Y.A. and Gretzel, U. (2007). Success Factors for Destination Marketing Web sites: A Qualitative Meta-Analysis. Journal of Travel Research, 46(1), 46-63.
- Smith, A.G. (1999). Evaluation of Information Sources. Available at: http://www.vuw.ac.nz/&agsmith/evaln/evaln.htm.
- Smith, A.G. (2001). Applying Evaluation Criteria to New Zealand Government Websites. International Journal of Information Management, 21(2), 137-149.
- Van der Heijden, H. (2003). Factors Influencing the Usage of Websites: The Case of a Generic Portal in The Netherlands. Information Management, 40(6), 541-549.
- Venkatesh, V., Morris, M.G., Davis, G.B. and Davis, F.D. (2003). User Acceptance of Information Technology: Toward A Unified View. The Management Information Systems Quarterly, 27(3), 425-478.
- Wolfinbarger, M. and Gilly, M.C. (2001). Shopping Online for Freedom, Control, and Fun. California Management Review, 43(2), 34-55.
- Woodside, A.G., Vicente, R.M. and Duque, M. (2011). Tourism’s Destination Dominance and Marketing Website Usefulness. International Journal of Contemporary Hospitality Management, 23(4), 552-564.
- World Best Enterprises (2004). Quality Criteria for Website Excellence. Available at: http://www.worldbest.com/criteria.htm.
- World Wide Web Size (n.d). The Size of the World Wide Web (The Internet). Available at: http://www.worldwidewebsize.com.
|