Testing Gremlin-Based Graph Database Systems via Query Disassembling

Query disassembling (QuDi) is an effective testing technique to automatically detect logic bugs in individual graph database systems (GDBs). By disassembling a complex graph query into an equivalent atomic graph traversal sequence, we can reveal logic bugs related to incorrect implementations and optimizations of Gremlin queries in GDBs. 

We evaluate QuDi on six widely-used Gremlin-based GDBs, i.e., Neo4j, OrientDB, JanusGraph, HugeGraph, TinkerGraph, and ArcadeDB. In total, we have found 25 logic bugs in these six GDBs, and 10 of them have been confirmed as previously-unknown bugs by GDB developers.