July 9, 2020 Dataset Open Access

Reference datasets for in-flight emergency situations

Xavier Olive; Axel Tanner; Martin Strohmeier; Matthias Schäfer; Metin Feridun; Allan Tart; Ivan Martinovic; Vincent Lenders

Motivation

The data in this dataset is derived and cleaned from the full OpenSky dataset in order to illustrate in-flight emergency situations triggering the 7700 transponder code. It spans flights seen by the network's more than 2500 members between 1 January 2018 and 29 January 2020.

The dataset complements the following publication:

Xavier Olive, Axel Tanner, Martin Strohmeier, Matthias Schäfer, Metin Feridun, Allan Tart, Ivan Martinovic and Vincent Lenders.
"OpenSky Report 2020: Analysing in-flight emergencies using big data".
In 2020 IEEE/AIAA 39th Digital Avionics Systems Conference (DASC), October 2020

License

See LICENSE.txt

Disclaimer

The data provided in the files is provided as is. Despite our best efforts at filtering out potential issues, some information could be erroneous.

Most aircraft information come from the OpenSky aircraft database and have been filled with manual research from various sources on the Internet. Most information about flight plans has been automatically fetched and processed using open APIs; some manual processing was required to cross-check, correct erroneous and fill missing information.

Description of the dataset

Two files are provided in the dataset:

• one compressed parquet file with trajectory information;
• one metadata CSV file with the following features:
  • flight_id: a unique identifier for each trajectory;
  • callsign: ICAO flight callsign information;
  • number: IATA flight number, when available;
  • icao24, registration, typecode: information about the aircraft;
  • origin: the origin airport for the aircraft, when available;
  • landing: the airport where the aircraft actually landed, when available;
  • destination: the intended destination airport, when available;
  • diverted: the diversion airport, if applicable, when available;
  • tweet_problem, tweet_result, tweet_fueldump: information extracted from Twitter accounts, about the nature of the issue, the consequence of the emergency and whether the aircraft is known to have dumped fuel;
  • avh_id, avh_problem, avh_result, avh_fueldump: information extracted from The Aviation Herald, about the nature of the issue, the consequence of the emergency and whether the aircraft is known to have dumped fuel.
    The complete URL for each event is https://avherald.com/h?article={avh_id}&opt=1 (replace avh_id by the actual value)

Examples

Additional analyses and visualisations of the data are available at the following page:
<https://traffic-viz.github.io/paper/squawk7700.html>

Credit

If you use this dataset, please cite the original OpenSky paper:

Xavier Olive, Axel Tanner, Martin Strohmeier, Matthias Schäfer, Metin Feridun, Allan Tart, Ivan Martinovic and Vincent Lenders.
"OpenSky Report 2020: Analysing in-flight emergencies using big data".
In 2020 IEEE/AIAA 39th Digital Avionics Systems Conference (DASC), October 2020

Matthias Schäfer, Martin Strohmeier, Vincent Lenders, Ivan Martinovic and Matthias Wilhelm.
"Bringing Up OpenSky: A Large-scale ADS-B Sensor Network for Research".
In Proceedings of the 13th IEEE/ACM International Symposium on Information Processing in Sensor Networks (IPSN), pages 83-94, April 2014.

and the traffic library used to derive the data:

Xavier Olive.
"traffic, a toolbox for processing and analysing air traffic data."
Journal of Open Source Software 4(39), July 2019.