LogPMDataset

Log PM is a log parser benchmark emphasizing precise in-message parameter detection rather than template-based message clustering. This dataset is a combination of smaller datasets used for this benchmark. Datasets are collected from LogHub, parsed using handcrafted regexes, and stored in CSV files. Each CSV file contains no header and three columns. The first one is the message, the second is the parameter mask, and the third one is the index of the matching regex. The necessary dataset parts are downloaded automatically in the LogPM benchmark, so no direct download is required for benchmarking.

The benchmark includes the following datasets:

• Android
• Apache
• Hadoop
• HDFS
• HPC
• Linux
• OpenStack
• Proxifier
• SSH
• ZooKeeper