Evaluation of Immersive Project-Based Learning Experiences

Digitalization is transforming the real estate and construction (REC) sector and a key feature of this transformation is Building Information Modelling (BIM) - the virtual representation of all building-related information. By enabling the creation of digital twins of real buildings, BIM generates opportunities to do many things in new and better ways including education and training. Specifically, BIM offers the possibility of data rich virtual environments in which project-based learning experiences can be designed. Researchers at Tallinn University of Technology, Tampere University and the University of Bologna are currently developing a prototype BIM-enabled Learning Environment (BLE) with the intention of providing more realistic, immersive and integrated learning experiences. In addition to the BLE platform itself, pilot learning modules are being created to demonstrate the potential for this approach and, to determine their effectiveness, evaluation tools are being designed. This research investigates existing, applicable evaluation models and derives an evaluation model and tools specifically adapted for the immersive project-based learning experiences provided through the BLE. A literature review was conducted to identify existing evaluation models. A comparative content analysis approach was employed to identify their specific use cases, implementation requirements, advantages and disadvantages for deployment within the BLE context. The BLE pilot learning modules were analysed in terms of their defining characteristics and the key features of evaluation models applicable to them were identified. The identified features were then integrated to derive a new evaluation model and a corresponding set of evaluation tools considering the contemporary principles of Engineering Pedagogy. The research results include: 1) Defining characteristics of the BLE pilot learning modules and the challenges these pose for evaluation. 2) Existing evaluation models and their applicability to the immersive project-based learning experiences of the BLE. 3) An outline of the evaluation model and appropriate evaluation tools for the BLE learning modules. An evaluation model together with supporting evaluation tools are proposed that will assist educators and trainers in evaluating the impact of their activities for effective engineering education. This research also serves as a guide for the development of future BLE learning modules and for evaluating their effectiveness.