Usability Evaluation of a Digital Teleradiology Case Study Using the System Usability Scale in the WFDT Project

Abstract

Background: The global pandemic has significantly increased the use of e-learning. In the project “Knowledge modules and case studies in the digital transformation” (Wissensbausteine und Fallstudien in der digitalen Transformation – WFDT), digital learning content is created in H5P and integrated into the Learning Management System (LMS) to be made available as Open Source Material. The teleradiology content is presented through case studies oriented towards case-based learning. Aim: The objective of usability testing is to identify potential areas for improvement and ensure these are incorporated into subsequent development and quality assurance processes. Methods: The usability test is carried out with the SUS to obtain an overview of usability within 10 items, complemented by questions on font size and qualitative feedback on the presentation. In an asynchronous setting, students work on the case study, model a teleradiology process with software, and answer the SUS and additional questions. Results: A total of 20 students from the Health Care Management and Medical Informatics degree programme participated in the usability test. The case study usability was rated as M = 59.63. Eleven students rated the font size as exactly right. The tasks, examples, and clarity of the presentation were positively rated. Further criticism was made of the task elements and the design of the presentation. Conclusions: The content structure, integration of tasks, and examples will be retained for this and other case studies. The design of the case studies will be fundamentally transformed into an H5P-proprietary format.