Working paper Open Access

An explanatory rationale for priors sharpened into Occam's razors

Bickel, David R.

In Bayesian statistics, if the distribution of the data is unknown, then each plausible distribution of the data is indexed by a parameter value, and the prior distribution of the parameter is specified. To the extent that more complicated data distributions tend to require more coincidences for their construction than simpler data distributions, default prior distributions should be transformed to assign additional prior probability or probability density to the parameter values that refer to simpler data distributions. The proposed transformation of the prior distribution relies on the entropy of each data distribution as the relevant measure of complexity. The transformation is derived from a few first principles and extended to stochastic processes. 

Files (180.5 kB)
Name Size
mean-preprint180910.pdf
md5:ad7ccd7b9227917ac73b69f8a364c32f
180.5 kB Download
19
8
views
downloads
All versions This version
Views 1919
Downloads 88
Data volume 1.4 MB1.4 MB
Unique views 1717
Unique downloads 66

Share

Cite as