Technical note Open Access

Recursive Mean and Stdev formulas of O(1) and one-step-back storage requirements for Normal distributions

Harris Georgiou

Abstract: Updating basic running statistics often requires keeping track of cumulants as the data set grows or evolves through time. Common approaches that are based on running cumulants are inefficient for intensive-processing or Big data contexts, since they introduce running windows to the original data set, in order to avoid arithmetic overflows. This work formulates recursive estimators for arithmetic mean and (sample) standard deviation of Normal distributions, which are of minimum storage complexity (one-step-back), arithmetically robust for error resiliency and inherently parallelizable at the lowest possible level (arithmetic operators).

Keywords: online statistics, parallel processing, Big data

Licenced under Creative Commons (CC-BY) v4.0/i, 2017 (c) Harris Georgiou
Files (271.1 kB)
Name Size
recursive-stats.pdf
md5:346a2e66522f279c5565007354ffa03d
271.1 kB Download
1
3
views
downloads
All versions This version
Views 11
Downloads 33
Data volume 813.3 kB813.3 kB
Unique views 11
Unique downloads 22

Share

Cite as