Augmented Reality Client-Server Application for Schneider Electrics’ Protection Relay

Abstract

In marker based Augmented Reality (AR) applications any known target is recognized within the received data from the camera and the application adds the predefined computer made data (which can be text, 3D object, video, image, animation, etc.) into the live video according to the position and orientation of the target and displays on the head-mounted screens or mobile apps. The aim of this thesis was to develop a Client-Server application for Schneider Electrics’ protection relay’s AR application, which makes it possible to maintain the augmented data through a web application and save the data into a remote database. The AR application can then always receive updated data from the web application for the device which has a unique serial number and is being videoed live by an AR camera. The web application also provides the possibility for the client application to update the configuration of a relay. The significant improvements of the current application over the earlier implementation is that data is not saved into runtime variables but permanently in the database and the size of the application is much smaller. The web application was implemented by using Java (Servlets and JSP pages), HTML, CSS and jQuery, but the client application was implemented by using C# in Unity 3D engine. The client and the server applications exchange data in JSON format using HTTPS protocol. The data is stored in MySQL database, but the client application also has a local SQLite database for offline use. The whole application consists of many modules. In this project work the web application, communication between the client and the web application, JSON data handling and synchronization of the MySQL and SQLite databases were implemented.