The GeoRDFBench Framework: Geospatial Semantic Benchmarking Simplified

We present the GeoRDFBench Framework, whose purpose is to assist and streamline the researcher's work in the field of benchmarking geospatial semantic stores. The runtime API models all identified benchmark components, groups them, forms specialization hierarchies of classes and interfaces for them, and supports serialization to and deserialization from external JSON specification files. The increased reusability of these JSON benchmark specifications, allows focus to stay on the research task ahead while minimizing the time from idea conception to benchmark results and useful conclusions. Geospatial RDF store architecture and behavior is unified by generalizing the repository and connection functionalities of the three most common RDF framework APIs used by RDF stores: OpenRDF Sesame, Eclipse RDF4J and Apache Jena. GeoRDFBench goes even further and models the application and database server modules present in some stores and automates their lifecycle management during experiment execution. The framework comes with several geospatial RDF Stores, implemented as separate runtime-dependent modules. Each module contains scripts for repository generation and experiment execution, which allows for a quick start on using the platform. RDF modules include: RDF4J, GraphDB, Stardog, Strabon, OpenLink Virtuoso and Jena GeoSPARQL.