Journal article Open Access

Elastic-PPQ: a Two-level Autonomic System for Spatial Preference Query Processing over Dynamic Data Streams

Mencagli Gabriele; Torquati Massimo; Danelutto Marco

Paradigms like Internet of Things and the most recent Internet of Everything are shifting the attention towards systems able to process unbounded sequences of items in the form of data streams. In the real world, data streams may be highly variable, exhibiting burstiness in the arrival rate and non-stationarities such as trends and cyclic behaviors. Furthermore, input items may be not ordered according to timestamps. This raises the complexity of stream processing systems, which must support elastic resource management and autonomic QoS control through sophisticated strategies and run-time mechanisms. In this paper we present Elastic-PPQ, a system for processing spatial preference queries over dynamic data streams. The key aspect of the system design is the existence of two adaptation levels handling workload variations at different time-scales. To address fast time-scale variations we design a fine regulatory mechanism of load balancing supported by a control-theoretic approach. The logic of the second adaptation level, targeting slower time-scale variations, is incorporated in a Fuzzy Logic Controller that makes scale in/out decisions of the system parallelism degree. The approach has been successfully evaluated under synthetic and real-world datasets.

Files (13.6 MB)
Name Size
code.zip
md5:7a24645863593806627c80f8a0dc4731
897.7 kB Download
Exp.zip
md5:1977b651956adc80c585081e3a5aa055
12.7 MB Download
1
0
views
downloads
All versions This version
Views 11
Downloads 00
Data volume 0 Bytes0 Bytes
Unique views 11
Unique downloads 00

Share

Cite as