Integration of Usability Evaluation Studies via a Novel Meta-Analytic Approach: What are Significant Attributes for Effective Evaluation? | |
Hwang, Wonil ; Salvendy, Gavriel | |
2010-10-12 ; 2010-10-12 | |
关键词 | COGNITIVE WALKTHROUGHS USER PERFORMANCE TOOL Computer Science, Cybernetics Ergonomics |
中文摘要 | The overall discovery rates, which are the ratios of sum of unique usability problems detected by all experiment participants against the number of usability problems existed in the evaluated systems, were investigated to find significant factors of usability evaluation through a meta-analytic approach with the n-corrected effect sizes newly defined in this study. Since many studies of usability evaluation have been conducted under specific contexts showing some mixed findings, usability practitioners need holistic and more generalized conclusions. Due to the limited applicability of the traditional meta-analysis to usability evaluation studies, a new meta-analytic approach was established and applied to 38 experiments that reported overall discovery rates of usability problems as a criterion measure. Through the meta-analytic approach with the n-corrected effect sizes, we successfully combined 38 experiments and found evaluator's expertise, report type, and interaction between usability evaluation method and time constraint as significant factors. We suggest that in order to increase overall discovery rates of usability problems, (a) free-style written reports are better than structured written reports; (b) when heuristic evaluation or cognitive walkthrough is used, the usability evaluation experiments should be conducted without time constraint, but when think-aloud is used, time constraint is not an important experimental condition; (c) usability practitioners do not need to be concerned about unit of evaluation, fidelity of evaluated systems, and task type; and (d) HCI experts are better than novice users or evaluators. Our conclusions can guide usability practitioners when determining evaluation contexts, and the meta-analytic approach of this study provides an alternative way to combine the empirical results of usability evaluation besides the traditional meta-analysis. |
语种 | 英语 ; 英语 |
出版者 | LAWRENCE ERLBAUM ASSOC INC-TAYLOR & FRANCIS ; PHILADELPHIA ; 325 CHESTNUT STREET, STE 800, PHILADELPHIA, PA 19106 USA |
内容类型 | 期刊论文 |
源URL | [http://hdl.handle.net/123456789/78651] |
专题 | 清华大学 |
推荐引用方式 GB/T 7714 | Hwang, Wonil,Salvendy, Gavriel. Integration of Usability Evaluation Studies via a Novel Meta-Analytic Approach: What are Significant Attributes for Effective Evaluation?[J],2010, 2010. |
APA | Hwang, Wonil,&Salvendy, Gavriel.(2010).Integration of Usability Evaluation Studies via a Novel Meta-Analytic Approach: What are Significant Attributes for Effective Evaluation?.. |
MLA | Hwang, Wonil,et al."Integration of Usability Evaluation Studies via a Novel Meta-Analytic Approach: What are Significant Attributes for Effective Evaluation?".(2010). |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论