Working paper Open Access

An explanatory rationale for priors sharpened into Occam's razors

Bickel, David R.

In Bayesian statistics, if the distribution of the data is unknown, then each plausible distribution of the data is indexed by a parameter value, and the prior distribution of the parameter is specified. To the extent that more complicated data distributions tend to require more coincidences for their construction than simpler data distributions, default prior distributions should be transformed to assign additional prior probability or probability density to the parameter values that refer to simpler data distributions. The proposed transformation of the prior distribution relies on the entropy of each data distribution as the relevant measure of complexity. The transformation is derived from a few first principles and extended to stochastic processes. 

Files (180.5 kB)
Name Size
mean-preprint180910.pdf
md5:ad7ccd7b9227917ac73b69f8a364c32f
180.5 kB Download
51
24
views
downloads
All versions This version
Views 5151
Downloads 2424
Data volume 4.3 MB4.3 MB
Unique views 4646
Unique downloads 2222

Share

Cite as