Comparative Evaluation? Yes, But With Which Alternative UI?
In proc. of British HCI 2017. pages 32:1-32:7. 2017.
Hayet Hammami, Gaëlle Calvary, Meriem Riahi, Faouzi Moussa, Sarah Bouzit
Résumé
User’s feedback provides valuable information suitable to help designers to improve their work. In this paper, we present a study on user’s feedback when evaluating a User Interface (UI) by comparison. Our aim is to define the properties that the alternative UI must satisfy to maximize the benefits of comparative evaluation.
The UIs considered in the study were designed using the CAMELEON Reference Framework (CRF), covering variations at each level of abstraction. We study the impact of each variation on users’ feedback. We show that when the alternative design refers to the same task model as the original one but using a different abstract UI, the number of negative returns is significantly higher, making the comparative evaluation more productive.