Data for the MLCS 2020 paper "A Year of Automated Anomaly Detection in a Datacenter"

This contains the data used for the paper by Ahmed et. al in the MLCS 2020 paper "A Year of Automated Anomaly Detection in a Datacenter". Each of the four CSV files corresponds to one of the quarters discussed in the paper, and each has a metadata file containing information about the query that produced them. The CSV files contain the 'raw' log messages, and an eventID that identifies which pattern the log entry matched; the eventID is used to group together log messages of the same type. These logfiles were collected on the CloudLab facility (https://cloudlab.us/) from Jan 1 - Dec 30, 2019.

The violated_unviolated_sessions_*.txt files each contain 20 randomly-selected sessions: half of the sessions were labeled by the invariant miner as being 'normal', and the other half 'anomalous'. CloudLab developers and system administrators were asked to label these sessions manually (and were not given the invariant miner's labels). The corresponding *_manual_labels.txt contain the labels that the administrators assigned, and in some cases additional correspondence with the administrators and information about which manual labels matched the invariant miner and which did not.