Intermediary topic modelling analysis results: Mapping the tech world using text mining methods

This study presents an innovative methodology for analysing technology news using various text mining methods. News articles provide a rich source of information to track promising emerging technologies, relevant social challenges or policy issues. Our goal is to support the Next Generation Internet initiative by providing data-science tools to map and analyse the developments of the tech word.

Based on more than 200 000 articles from major media outlets, we are going to identify widely discussed topics, focusing on emerging technologies and policy issues and dive deeper in selected areas and highlight key focal points of recent developments.

To meet these goals, a number of machine learning techniques are combined. The major steps can be summarised as follows:

● 17 general umbrella topics are explored

● 5 topics are selected for further analysis

● Deep dives are presented with 2D interactive maps

More specifically, the topics selected for the deep dives are:

1. AI and Robots

2. Policy (sums up 3 relevant areas)

3. Media

4. Business

5. Cybersecurity

With the Policy topic grouping together 3 areas: Social media crisis, Privacy and 5G.