Choosing The Right Test Automation Tool for Company A
Adedeji, Emmanuel (2025)
2025
All rights reserved. This publication is copyrighted. You may download, display and print it for Your own personal use. Commercial use is prohibited.
Julkaisun pysyvä osoite on
https://urn.fi/URN:NBN:fi:amk-2025121938515
https://urn.fi/URN:NBN:fi:amk-2025121938515
Tiivistelmä
Test automation has become an essential part of software development especially due to the advancement of software technology, there is now a high standard of expectations in enhancing software quality. With sophisticated software testing practices such as Agile and DevOps pipelines, Continuous Integration/ Continuous Delivery (CI/CD) practices, test automation continues to help organizations’ software meet users’ needs by lessening manual testing processes and improves delivery routine.
While test automation has a lot of benefits in modern software development, selecting the ideal automation framework is very crucial yet it remains a complexity that many organizations have been encountering as these tools must be effective, scalable, easy to maintain and fit right into the organization’s technical demands.
This research addresses these complexities by analyzing and pinpointing the most appropriate test automation tool for an organization using a real-world company known as Company A.
The study's main aim was to evaluate the most used test automation frameworks in the software development industry and academia and recommend the ideal framework for Company A based on its technical and organizational needs. The research utilizes a mixed method methodology that comprises qualitative data accumulated from stakeholders’ interviews using the MoSCoW approach; and a quantitative analysis that uses a weighted comparison of selected automatic frameworks which are Playwright, TestNG and Robot Framework. Each of these tools were analysed based on criteria which includes API support, parallel execution, capacity, CI/CD compatibility, maintainability and scalability and adoption.
The finding reveals TestNG has the highest performance with accuracy. However, Playwright is revealed to be the most ideal tool for company A based on its scalability and how it meets the technical and operational needs of the company. These findings were also validated through a Proof of Concept that illustrated Playwright's efficacy.
The study concludes that Playwright exemplifies the balance between ease of adoption, functionality and meeting organizational needs for Company A. Ultimately, the study contributes immensely to the ongoing research on automation tools and how essential selecting the ideal tool based on companies’ needs.
While test automation has a lot of benefits in modern software development, selecting the ideal automation framework is very crucial yet it remains a complexity that many organizations have been encountering as these tools must be effective, scalable, easy to maintain and fit right into the organization’s technical demands.
This research addresses these complexities by analyzing and pinpointing the most appropriate test automation tool for an organization using a real-world company known as Company A.
The study's main aim was to evaluate the most used test automation frameworks in the software development industry and academia and recommend the ideal framework for Company A based on its technical and organizational needs. The research utilizes a mixed method methodology that comprises qualitative data accumulated from stakeholders’ interviews using the MoSCoW approach; and a quantitative analysis that uses a weighted comparison of selected automatic frameworks which are Playwright, TestNG and Robot Framework. Each of these tools were analysed based on criteria which includes API support, parallel execution, capacity, CI/CD compatibility, maintainability and scalability and adoption.
The finding reveals TestNG has the highest performance with accuracy. However, Playwright is revealed to be the most ideal tool for company A based on its scalability and how it meets the technical and operational needs of the company. These findings were also validated through a Proof of Concept that illustrated Playwright's efficacy.
The study concludes that Playwright exemplifies the balance between ease of adoption, functionality and meeting organizational needs for Company A. Ultimately, the study contributes immensely to the ongoing research on automation tools and how essential selecting the ideal tool based on companies’ needs.