Developing and implementing a usability evaluation framework for Lioncrypt 1.0 software
Kantina, Elizaveta (2016)
Haaga-Helia ammattikorkeakoulu
2016
All rights reserved
Julkaisun pysyvä osoite on
https://urn.fi/URN:NBN:fi:amk-201605249381
https://urn.fi/URN:NBN:fi:amk-201605249381
Tiivistelmä
This thesis presents a framework for usability evaluation of Lioncrypt 1.0 software, developed by Ferus Bestia Oy. Two main objectives are formulated for this thesis: the first objective is to design a framework and the second objective is to use the framework to assess the usability of Lioncrypt 1.0.
Firstly, literature research enabled to study the main usability concepts and investigate the existing trends in usability evaluation. Traditional in-lab usability testing has been found the most suitable in terms of cost and resources. This approach was complemented by the combination of methods and techniques, such as concurrent thinking aloud (CTA), post-task Single Ease Question (SEQ) and post-test System Usability Scale (SUS) questionnaire.
Secondly, scenario-based usability testing was performed during the period from 25.03.2015 to 02.04.2015 in a conference room of Ferus Bestia Oy set up as an informal lab. Usability testing process consisted of 5 independent test sessions, individual for each participant. Screen capture, logging, note taking and audio recording allowed to preserve the raw data. Both quantitative and qualitative data were collected in order to provide a deeper insight and the better coverage of usability issues.
The investigation exposed 12 usability problems across two user interfaces of Lioncrypt 1.0.
Potential solutions to fix the identified issues were also provided. The study findings revealed that the usability of Lioncrypt 1.0 is slightly below the industry average level. Among positive findings, it is worth mentioning that learnability achieved a good level. Also, the majority of the participants managed to complete the most of the scenarios without assistance.
The research findings demonstrate that the developed framework successfully serve the purpose of usability evaluation. Therefore, it should be incorporated into the iterative design process. Moreover, it can be adapted to evaluate the usability of software, regardless of technology.
Firstly, literature research enabled to study the main usability concepts and investigate the existing trends in usability evaluation. Traditional in-lab usability testing has been found the most suitable in terms of cost and resources. This approach was complemented by the combination of methods and techniques, such as concurrent thinking aloud (CTA), post-task Single Ease Question (SEQ) and post-test System Usability Scale (SUS) questionnaire.
Secondly, scenario-based usability testing was performed during the period from 25.03.2015 to 02.04.2015 in a conference room of Ferus Bestia Oy set up as an informal lab. Usability testing process consisted of 5 independent test sessions, individual for each participant. Screen capture, logging, note taking and audio recording allowed to preserve the raw data. Both quantitative and qualitative data were collected in order to provide a deeper insight and the better coverage of usability issues.
The investigation exposed 12 usability problems across two user interfaces of Lioncrypt 1.0.
Potential solutions to fix the identified issues were also provided. The study findings revealed that the usability of Lioncrypt 1.0 is slightly below the industry average level. Among positive findings, it is worth mentioning that learnability achieved a good level. Also, the majority of the participants managed to complete the most of the scenarios without assistance.
The research findings demonstrate that the developed framework successfully serve the purpose of usability evaluation. Therefore, it should be incorporated into the iterative design process. Moreover, it can be adapted to evaluate the usability of software, regardless of technology.