Jeřábek, Kamil
Hynek, Karel
Čejka, Tomáš
Ryšavý, Ondřej
2022-02-03
<p><strong>Please refer to the original data article for further data description:</strong> <a href="https://doi.org/10.1016/j.dib.2022.108310">Jeřábek & Hynek et al., Collection of datasets with DNS over HTTPS traffic In: Data in Brief Journal</a> ,DOI:<a href="https://doi.org/10.1016/j.dib.2022.108310">10.1016/j.dib.2022.108310</a></p>
<p><strong>Dataset of DNS over HTTPS traffic from Firefox </strong><em>(FFMuc, Google, Hostux, OpenDNS Quad9, Switch)</em><br>
The dataset contains DoH and HTTPS traffic that was captured in a virtualized environment (Docker) and generated automatically by Firefox browser with enabled DoH towards 6 different DoH servers (FFMuc, Google, Hostux, OpenDNS Quad9, Switch) and a web page loads towards a sample of web pages taken from Majestic Million dataset. The data are provided in the form of PCAP files. However, we also provided TLS enriched flow data that are generated with opensource <a href="https://github.com/CESNET/ipfixprobe">ipfixprobe</a> flow exporter. Other than TLS related information is not relevant since the dataset comprises only encrypted TLS traffic. The TLS enriched flow data are provided in the form of CSV files with the following columns:</p>
<table>
<thead>
<tr>
<th>Column Name</th>
<th>Column Description</th>
</tr>
</thead>
<tbody>
<tr>
<td>DST_IP</td>
<td>Destination IP address</td>
</tr>
<tr>
<td>SRC_IP</td>
<td>Source IP address</td>
</tr>
<tr>
<td>BYTES</td>
<td>The number of transmitted bytes from Source to Destination</td>
</tr>
<tr>
<td>BYTES_REV</td>
<td>The number of transmitted bytes from Destination to Source</td>
</tr>
<tr>
<td>TIME_FIRST</td>
<td>Timestamp of the first packet in the flow in format YYYY-MM-DDTHH-MM-SS</td>
</tr>
<tr>
<td>TIME_LAST</td>
<td>Timestamp of the last packet in the flow in format YYYY-MM-DDTHH-MM-SS</td>
</tr>
<tr>
<td>PACKETS</td>
<td>The number of packets transmitted from Source to Destination</td>
</tr>
<tr>
<td>PACKETS_REV</td>
<td>The number of packets transmitted from Destination to Source</td>
</tr>
<tr>
<td>DST_PORT</td>
<td>Destination port</td>
</tr>
<tr>
<td>SRC_PORT</td>
<td>Source port</td>
</tr>
<tr>
<td>PROTOCOL</td>
<td>The number of transport protocol</td>
</tr>
<tr>
<td>TCP_FLAGS</td>
<td>Logic OR across all TCP flags in the packets transmitted from Source to Destination</td>
</tr>
<tr>
<td>TCP_FLAGS_REV</td>
<td>Logic OR across all TCP flags in the packets transmitted from Destination to Source</td>
</tr>
<tr>
<td>TLS_ALPN</td>
<td>The Value of Application Protocol Negotiation Extension sent from Server</td>
</tr>
<tr>
<td>TLS_JA3</td>
<td>The JA3 fingerprint</td>
</tr>
<tr>
<td>TLS_SNI</td>
<td>The value of Server Name Indication Extension sent by Client</td>
</tr>
</tbody>
</table>
<p>The DoH resolvers in the dataset can be identified by IP addresses written in <strong><em>doh_resolver_ip.csv </em></strong>file.</p>
<p>The main part of the dataset is located in <strong><em>DoH-Gen-F-FGHOQS.tar.gz </em></strong>and has the following structure:</p>
<p> </p>
<pre><code>.
└─── data | - Main directory with data
└── generated | - Directory with generated captures
├── pcap | - Generated PCAPs
│ └── firefox
└── tls-flow-csv | - Generated CSV flow data
└── firefox</code></pre>
<p> </p>
<p><strong>Total stats of generated data:</strong></p>
<table>
<thead>
<tr>
<th>Name</th>
<th>Value</th>
</tr>
</thead>
<tbody>
<tr>
<td>Total Data Size</td>
<td>46.7 GB</td>
</tr>
<tr>
<td>Total files</td>
<td>12</td>
</tr>
<tr>
<td>DoH extracted tls flows</td>
<td>~98 K</td>
</tr>
<tr>
<td>Non-DoH extracted tls flows</td>
<td>~353 K</td>
</tr>
</tbody>
</table>
<p><strong>DoH Server information</strong></p>
<table>
<thead>
<tr>
<th>Name</th>
<th>Provider</th>
<th>DoH query url</th>
</tr>
</thead>
<tbody>
<tr>
<td>FFMuc</td>
<td><a href="https://ffmuc.net">https://ffmuc.net</a></td>
<td><a href="https://doh.ffmuc.net/dns-query">https://doh.ffmuc.net/dns-query</a></td>
</tr>
<tr>
<td>Google</td>
<td><a href="https://google.com">https://google.com</a></td>
<td><a href="https://dns.google/dns-query">https://dns.google/dns-query</a></td>
</tr>
<tr>
<td>Hostux</td>
<td><a href="https://dns.hostux.net/en/">https://dns.hostux.net/en/</a></td>
<td><a href="https://dns.hostux.net/dns-query">https://dns.hostux.net/dns-query</a></td>
</tr>
<tr>
<td>OpenDNS</td>
<td><a href="https://www.opendns.com">https://www.opendns.com</a></td>
<td><a href="https://doh.opendns.com/dns-query">https://doh.opendns.com/dns-query</a></td>
</tr>
<tr>
<td>Quad9</td>
<td><a href="https://www.quad9.net">https://www.quad9.net</a></td>
<td><a href="https://dns.quad9.net/dns-query">https://dns.quad9.net/dns-query</a></td>
</tr>
<tr>
<td>Switch</td>
<td><a href="https://www.switch.ch">https://www.switch.ch</a></td>
<td><a href="https://dns.switch.ch/dns-query">https://dns.switch.ch/dns-query</a></td>
</tr>
</tbody>
</table>
<p> </p>
<p>Please cite the original article:</p>
<pre><code>@article{Jerabek2022,
title = {Collection of datasets with DNS over HTTPS traffic},
journal = {Data in Brief},
volume = {42},
pages = {108310},
year = {2022},
issn = {2352-3409},
doi = {https://doi.org/10.1016/j.dib.2022.108310},
url = {https://www.sciencedirect.com/science/article/pii/S2352340922005121},
author = {Kamil Jeřábek and Karel Hynek and Tomáš Čejka and Ondřej Ryšavý}
}</code></pre>
This research was funded by the Ministry of Interior of the Czech Republic, grant No. VJ02010024: Flow-Based Encrypted Traffic Analysis and also by the Grant Agency of the CTU in Prague, grant No. SGS20/210/OHK3/3T/18 funded by the MEYS of the Czech Republic, and also by Brno University of Technology, Faculty of
Information Technology internal grant FIT-S-20-6293, and also by Technology Agency of the Czech Republic, grant No. FW03010099: Context-based Encrypted Traffic Analysis Using Flow Data.
https://doi.org/10.5281/zenodo.5957122
oai:zenodo.org:5957122
eng
Zenodo
https://doi.org/10.5281/zenodo.5957121
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
DNS over HTTPS
DNS
HTTPS
Encrypted
Network traffic
PCAP
TLS
Flows
DoH-Gen-F-FGHOQS
info:eu-repo/semantics/other