Usability and User Experience Evaluation in Intelligent Environments: A Review and Reappraisal

Intelligent environments are rapidly gaining ground, propelled by a rich sensor infrastructure, the Internet of Things, sophisticated reasoning capabilities, and Artificial Intelligence. In this complex technological landscape, crafting usable intelligent environments and assessing the user experience (UX) demands a thorough understanding of the concepts involved and the parameters that need to be studied. This paper carries out a review of usability and UX evaluation methods and frameworks, elaborating on fundamental concepts and presenting in detail approaches and methods reported in the literature. It additionally examines evaluation approaches in adaptive and ubiquitous computing systems, which are closely associated with intelligent environments, and presents UX challenges and evaluation frameworks in intelligent environments. Finally, the findings are synthesized and consolidated to produce a comprehensive overview of the field and the challenges that lie ahead.