Using a web scraper tool to extract data from on-line job advertisements to determine demand for e-skills in the EU labour market

Abstract

Since developing a long-term e-skills plan, the European Commission has prioritized closing the skills gap for the digital transformation of the economy. While the number of ICT students is rising and Member States are stepping up their efforts, shifting e-skills needs have left their imprint. Under H2020, the European Commission developed four pilot projects to integrate and share information across disciplines to create a coherent cybersecurity strategy for Europe. ECHO is one of these four efforts. ECHO, the client of the research, aims to promote multi-sector and multi-domain cyber defense and technical sovereignty in the EU. The initiative employed many strategies. This research showed how to identify, retrieve, and evaluate data from a website to determine which e-skilled workers are in demand in the European job market. The theoretical section of this paper will concentrate on the primary subjects that are associated with the purpose of the research. Include web scraper tools, data of inherent significance, online safety, and job postings.

A quantitative method was employed. With the use of automated technology, data was gathered and analyzed. Recruiters in Finland and the rest of the EU are looking for software engineers, developers, accountants with management experience, data scientists, and security analysts, according to Monster's (JoBLy) job ads. This analysis won't give you a final answer, but it will show you which industries are having trouble finding people with e-skills. The data came from a single website, so it can't be the only answer to the research question. You should look for more information from other sources.