Some Entropy Based on Measurement Distribution and Not Physical System?
Authors/Creators
Description
Shannon’s entropy is calculated using probabilities P(i) i.e. S= - Sum over i P(i) ln(P(i)). A probability is related to an uncertainty associated with event i, but this event may not be a physical event, but rather a measurement. In other words, measurements in a system may be made according to one distribution or another. This distribution may be converted into something which looks like a probability even though the system is completely deterministic. The entropy then calculated is based on the measurement distribution and not the physical system.
As a first example, consider the completely deterministic motion of a bound classical system between two turning points. Person A may send values of x (one dimensional space) to person B, based on a certain distribution instead of sending the values based on time i.e. x(t1),x(t2) etc. One distribution which may be used is the uniform one i.e. P(x)= dx/L. Another distribution, used in the literature (1), is based on the time spent in each constant dx i.e. P(x) = Cdx/v(x) where v(x) is velocity. These two distributions lead to different Shannon’s entropies, but the underlying system is completely deterministic which begs the question: Why does one associate an entropy with it? The entropy seems to be associated with the sending of information.
We try to apply these ideas to a quantum bound state. In the literature (2), one sometimes sees a Shannon’s entropy based on W(x)W(x) = P(x), where W(x) is the single particle bound wavefunction. This is a distribution, but is it based on uncertainty in the system? W(x)W(x) often consists of a set of crests of different heights and widths. We argue that the inherent uncertainty in x is due to the width of a crest. In other words each crest may be normalized to 1 and a Shannon’s entropy for each crest calculated. One must then weight the different crests. If one calculates the classical time associated with the base length of crest, this could be used as a weight which in the high energy level limit is associated with P(x)=Cdx/v(x) from (1), but it seems there is no reason to base the weight on time. The uncertainty in x is due to a superposition of exp(ipx)s which are not linked to time. Alternatively, one may use an unnormalized weight of the length of the base as uncertainty is only in x. One may then add a Shannon’s momentum entropy using a(p)a(p)=P(p) where W(x)=Sum over p a(p)exp(ipx).