Working paper Open Access

An explanatory rationale for priors sharpened into Occam's razors

Bickel, David R.

In Bayesian statistics, if the distribution of the data is unknown, then each plausible distribution of the data is indexed by a parameter value, and the prior distribution of the parameter is specified. To the extent that more complicated data distributions tend to require more coincidences for their construction than simpler data distributions, default prior distributions should be transformed to assign additional prior probability or probability density to the parameter values that refer to simpler data distributions. The proposed transformation of the prior distribution relies on the entropy of each data distribution as the relevant measure of complexity. The transformation is derived from a few first principles and extended to stochastic processes. 

Files (180.5 kB)
Name Size
180.5 kB Download
All versions This version
Views 7070
Downloads 3535
Data volume 6.3 MB6.3 MB
Unique views 6565
Unique downloads 3333


Cite as