The IRMA Community
Newsletters
Research IRM
Click a keyword to search titles using our InfoSci-OnDemand powered search:
|
Problems and Pitfalls in the Evaluation of Adaptive Systems
Abstract
Empirical studies with adaptive systems offer many advantages and opportunities. Nevertheless, there is still a lack of evaluation studies. This chapter lists several problems and pitfalls that arise when evaluating an adaptive system, and provides guidelines and recommendations for workarounds or even avoidance of these problems. Among other things the following issues are covered: relating evaluation studies to the development cycle; saving resources; specifying control conditions, sample, and criteria; asking users for adaptivity effects; reporting results. An overview of existing evaluation frameworks shows which of these problems have been addressed and in which way.
Related Content
|
Rod D. Roscoe, Russell J. Branaghan, Nancy J. Cooke, Scotty D. Craig.
© 2018.
34 pages.
|
|
Steve Ritter, R. Charles Murray, Robert G. M. Hausmann.
© 2018.
17 pages.
|
|
Yvonne S. Kao, Bryan J. Matlen, Michelle Tiu, Linlin Li.
© 2018.
24 pages.
|
|
Melissa L. Stone, Kevin M. Kent, Rod D. Roscoe, Kathleen M. Corley, Laura K. Allen, Danielle S. McNamara.
© 2018.
23 pages.
|
|
Elizabeth R. Kazakoff, Melissa Orkin, Kristine Bundschuh, Rachel L. Schechter.
© 2018.
24 pages.
|
|
Irfan Kula, Russell J. Branaghan, Robert K. Atkinson, Rod D. Roscoe.
© 2018.
17 pages.
|
|
Erin Walker, Ruth Wylie, Andreea Danielescu, James P. Rodriguez III, Ed Finn.
© 2018.
19 pages.
|
|
|