Curved exponential families generalize exponential families while preserving some of the magic, I guess?
Credited to (Efron 2004) and used in Efron (1978) to show some nice behaviour for degrees of freedom-based penalties. Will read soon.
There are some important examples in which the density (pmf) has the basic Exponential family form
, but the assumption that the dimensions of , and that of the range space of are the same is violated. More precisely, the dimension of is some positive integer strictly less than . Let us start with an example.[…] Suppose
. Writing , the density of is Writing
, and , this is in the form , with , although , which is only one dimensional. The two functions and are related to each other by the identity , so that a plot of in the plane would be a curve, not a straight line. Distributions of this kind go by the name of curved Exponential family. The dimension of the natural sufficient statistic is more than the dimension of for such distributions.
Examples?