Usability study of the ECHO e-skills gap analysis tool
Arokanto, Niko (2022)
2022
All rights reserved. This publication is copyrighted. You may download, display and print it for Your own personal use. Commercial use is prohibited.
Julkaisun pysyvä osoite on
https://urn.fi/URN:NBN:fi:amk-2022120125729
https://urn.fi/URN:NBN:fi:amk-2022120125729
Tiivistelmä
This thesis report presents a usability study for a gap analysis application used to identify e-skill levels and skill gaps in a working community. The application was created by another bachelor student as a part of Laurea UAS’s participation in the ECHO project, which aims to increase knowledge about cybersecurity around Europe. The aim of this thesis project was to find out for Laurea UAS if the application is useful, usable, and how to develop it. The objectives of this study were to conduct a usability test for a team in a work community, analyze the data for assessment, and formulate development suggestions to increase usability.
The theoretical framework addresses user experience design, usability quality components, and usability heuristics. Both qualitative and quantitative data were gathered, with a focus on summative evaluation overall. The data was gathered with an unmoderated remote testing session and a heuristic evaluation performed by the author. The author gained video recordings from sixteen participants and nine responses to the customized System Usability Scale (SUS) questionnaire.
The analyzed results indicated only one critical issue in the application. Several serious, medium, and low-level issues were found. The SUS score was at an acceptable level. A development suggestion for the issues was offered in writing and wireframe models. The list of issues was not exhaustive because of the scope of the test. The main conclusion was that the application is usable and useful in its current state. Further development and formative evaluations could increase the usability and reliability of the results.
The theoretical framework addresses user experience design, usability quality components, and usability heuristics. Both qualitative and quantitative data were gathered, with a focus on summative evaluation overall. The data was gathered with an unmoderated remote testing session and a heuristic evaluation performed by the author. The author gained video recordings from sixteen participants and nine responses to the customized System Usability Scale (SUS) questionnaire.
The analyzed results indicated only one critical issue in the application. Several serious, medium, and low-level issues were found. The SUS score was at an acceptable level. A development suggestion for the issues was offered in writing and wireframe models. The list of issues was not exhaustive because of the scope of the test. The main conclusion was that the application is usable and useful in its current state. Further development and formative evaluations could increase the usability and reliability of the results.