Refactoring test automation framework using optical character recognition
Namaz, Isabela (2024)
2024
All rights reserved. This publication is copyrighted. You may download, display and print it for Your own personal use. Commercial use is prohibited.
Julkaisun pysyvä osoite on
https://urn.fi/URN:NBN:fi:amk-2024052214440
https://urn.fi/URN:NBN:fi:amk-2024052214440
Tiivistelmä
This thesis gives a solution to a major challenge that the author and their team encountered while scripting automated tests for mobile native application UI testing on iOS and Android devices for a work project.
The tool that is being used for test automation in this project is Appium. It performs actions on the screen by interacting with elements. These elements are grouped in a layered hierarchy and if the element that Appium needs to interact with is nested too deep in the element hierarchy, it will not be able to find it. This is a common road blocker for iOS applications that have been developed using React Native.
The proposed fix will set the foundation by building a robust cross-platform test automation framework that can be enhanced by adding optical character recognition. Information can be validated on the screen, find cartesian coordinates of sections that need to be interacted with or see reference points that can be shifted using geometry to guide the robot to other interactable areas.
The results are a working test automation solution that overcomes platform limitations and can continue to add value to the team.
The tool that is being used for test automation in this project is Appium. It performs actions on the screen by interacting with elements. These elements are grouped in a layered hierarchy and if the element that Appium needs to interact with is nested too deep in the element hierarchy, it will not be able to find it. This is a common road blocker for iOS applications that have been developed using React Native.
The proposed fix will set the foundation by building a robust cross-platform test automation framework that can be enhanced by adding optical character recognition. Information can be validated on the screen, find cartesian coordinates of sections that need to be interacted with or see reference points that can be shifted using geometry to guide the robot to other interactable areas.
The results are a working test automation solution that overcomes platform limitations and can continue to add value to the team.