Leveraging Web Scraping to Identify Opportunities for Young Talent to UK Digital Manufacturing

The rapid evolution of digital manufacturing presents significant opportunities for economic growth and technological advancement in the United Kingdom (UK). However, the sector faces a critical shortage of skilled professionals, particularly among the younger generation. This paper explores the potential of leveraging state-of-the-art web scraping technologies to identify opportunities for attracting young talent to careers in UK digital manufacturing. By employing web scraping tools such as Scrapy, Selenium, and Magical, the study gathered and analysed data from online platforms like LinkedIn to assess the opportunities for the young talent in the UK digital manufacturing industry. The findings reveal key trends in job attractiveness, salary scales, and skill requirements, with a focus on how small and large companies differ in their approach to talent acquisition. The analysis raised some interesting questions which are worth exploring. In addition to, the insights gained provide actionable recommendations for educators, policymakers, and industry leaders to enhance the alignment between educational offerings and industry needs, thereby fostering a robust talent pipeline for the future of UK manufacturing.