Divisible, decomposable and stable distributions

Ways of slicing randomness



There are various closely related notions of how to construct random variables as sums of other random variables. I write them out here so that I might finally remember which is which.

by ori2uru, CC BY 2.0, via flickr

Infinitely divisible

The Lévy process quality.

A probability distribution is infinitely divisible if it can be expressed as the probability distribution of the sum of any arbitrary natural number of independent and identically distributed random variables. i.e. The distribution \(F\) is infinitely divisible if, for every positive integer \(n\), there exist \(n\) i.i.d. RVs whose sum

\[X_1 + \dots + X_n = S_n \sim F.\]

In addition to the classics (Gaussian, Poisson, stable and Gamma processes), Kyprianou (2014) lists various other infinitely divisible ones:

There are many more known examples of infinitely divisible distributions (and hence Lévy processes). Of the many known proofs of infinitely divisibility for specific distributions, most of them are non-trivial, often requiring intimate knowledge of special functions. A brief list of such distributions might include generalised inverse Gaussian (see Good (1953) and Jorgensen (1982)), truncated stable (see Tweedie (1984), Hougaard (1986), Koponen (1995), Boyarchenko and Levendorskii (2002a) and Carr et al. (2003)), generalised hyperbolic (see Halgreen (1979)), Meixner (see Schoutens and Teugels (1998)), Pareto (see Fred W. Steutel (1970), Thorin (1977a)), F-distributions (see Ismail (1979)), Gumbel [see Johnson and Kotz (1970);F. W. Steutel (1973)), Weibull [see Johnson and Kotz (1970);Fred W. Steutel (1970)), lognormal (see Thorin 1977b) and Student t-distribution (see Grosswald 1976; Ismail 1977).

I think the references to Fred W. Steutel (1970), which is an unavailable tech report, can be replaced with refs to Keilson and Steutel (1972) or Fred W. Steutel and van Harn (2003). Most of these are interesting but not actually useful to me since the proofs are often of existence type byt do not give us an easy closed form representation for the component distributions.

Note that infinite divisibility for a given distribution does not necessarily imply that the distribution is divisible in the family we might have assumed — e.g. lognormal RVs are, it turns out, divisible in the family of generalized Γ-convolutions, according to Thorin (1977b), and these generalized Γ-convolutions are closed under addition, although they are not necessarily actual lognormals. Pareto distributions are also included in this class. This large family does sound interesting — see James, Roynette, and Yor (2008). This distinction is made in self decomposability.

Natural exponential families with quadratic variance function have infinite divisibility in all cases except binomial (Morris 1982).

Decomposable

The distribution of \(X\) is decomposable if there are 2 or more non-constant RVs, not necessarily in the same family, whose sum is equal in distribution. Not a strong property, but the cases where an RV fails to possess even this are curious. 🏗

Self-decomposable

**NB*: This has been updated. AFAICT, decomposable, but the components must be in the same family. Carr et al. (2007) define it this

The distribution of a random variable \(X\) is said to be self decomposable (Sato 1999 Definition 15.1) if for any constant \(c, 0<c<1\) there exists an independent random variable say, \(X^{(c)}\) such that \[ X \stackrel{\text { law }}{=} c X+X^{(c)} \]

While this looks more general than divisible distributions, they note that it self-decomposable distributions form sub-class of infinitely divisible distributions.

Stable

A distribution or a random variable is said to be stable if a linear combination of two independent copies of a random sample has the same distribution, up to location and scale parameters. (i.e. a stronger property than the infinitely divisible property, which allows other parameters than location and scale.)

This induces (at least?) 2 families of distributions, the discrete and continuous stable families, depending on whether they are supported on the reals or the integers. Presumably other fields get other families. See (van Harn and Steutel 1993).

For continuous-valued continuous/discrete indexed stochastic process, \(X(t)\), \(\alpha\)-stability implies that the marginal law of the value of the process at certain times satisfies a stability equation: \[X(a) \simeq W^{1/\alpha}X(b),\] for \(0 < a < b\), \(\alpha> 0\) and \(W\sim \operatorname{Unif}([0,1])\perp X\).

The marginal distributions of such processes are those of the \(\alpha\)-stable processes. For \(\alpha=2\) we have Gaussians and for \(\alpha=1\), the Cauchy law.

Induced processes

Lévy

All the divisible distributions induce an obvious process - the decomposition of the process into independent increment Markov variates; which is to say, each divisible family induces an associated Lévy process. Classic example: the Gaussian distribution induces a Gauss Markov (i.e. Wiener) process, and the Gamma distribution a Gamma-Lévy process etc.

Ornstein–Uhlenbeck

This needs a notebook.

Linear differential

See Lévy SDEs.

Non-additive

🏗 Everything so far has been about sums of RVs; but presumably we could construct similar analyses of other algebraic structures of distributions, e.g. maximum processes. TBD.

Generalized Gamma Convolutions

The Generalized Gamma Convolutions (GGC) is a construction Barndorff-Nielsen, Maejima, and Sato (2006) that represents some startling (to me) processes using generalized Gamma distributions, including Pareto (Thorin 1977a) and Lognormal (Thorin 1977b) ones.

This is related to the idea of subordinator convolutions, which convolve a subordinator process with some kernel. The GGC convolves a Gamma distribution with some measure and makes a new divisible distribution.

James, Roynette, and Yor (2008):

we say that a positive r.v. \(\Gamma\) is a generalized gamma convolution \((\mathrm{GGC})\) - without translation term - if there exists a positive Radon measure \(\mu\) on \(] 0, \infty[\) such that: \[ \begin{aligned} E\left[e^{-\lambda \Gamma}\right]=& \exp \left\{-\int_{0}^{\infty}\left(1-e^{-\lambda x}\right) \frac{d x}{x} \int_{0}^{\infty} e^{-x z} \mu(d z)\right\} \\ =& \exp \left\{-\int_{0}^{\infty} \log \left(1+\frac{\lambda}{z}\right) \mu(d z)\right\} \\ \text { with: } & \int_{] 0,1]}|\log x| \mu(d x)<\infty \text { and } \int_{[1, \infty[} \frac{\mu(d x)}{x}<\infty \end{aligned} \]

Pérez-Abreu and Stelzer (2014) generalizes the GGC to vector- and matrix-valued distributions.

References

Applebaum, David. 2009. Lévy Processes and Stochastic Calculus. 2nd ed. Cambridge Studies in Advanced Mathematics 116. Cambridge ; New York: Cambridge University Press.
Arras, Benjamin, and Christian Houdré. 2019. On Stein’s Method for Infinitely Divisible Laws with Finite First Moment. Edited by Benjamin Arras and Christian Houdré. SpringerBriefs in Probability and Mathematical Statistics. Cham: Springer International Publishing.
Barndorff-Nielsen, Ole E., Makoto Maejima, and Ken-Iti Sato. 2006. Some Classes of Multivariate Infinitely Divisible Distributions Admitting Stochastic Integral Representations.” Bernoulli 12 (1): 1–33.
Bertoin, Jean. 1996. Lévy Processes. Cambridge Tracts in Mathematics 121. Cambridge ; New York: Cambridge University Press.
———. 2000. Subordinators, Lévy Processes with No Negative Jumps, and Branching Processes. University of Aarhus. Centre for Mathematical Physics and Stochastics ….
Bondesson, Lennart. 2012. Generalized Gamma Convolutions and Related Classes of Distributions and Densities. Lecture Notes in Statistics 76. New York: Springer Science & Business Media.
Cahoy, Dexter O., Vladimir V. Uchaikin, and Wojbor A. Woyczynski. 2010. Parameter Estimation for Fractional Poisson Processes.” Journal of Statistical Planning and Inference 140 (11): 3106–20.
Carr, Peter, Hélyette Geman, Dilip B. Madan, and Marc Yor. 2007. Self-Decomposability and Option Pricing.” Mathematical Finance 17 (1): 31–57.
Ernst, Philip A., Abram M. Kagan, and L. C. G. Rogers. 2021. The Least Favorable Noise.” arXiv:2103.09794 [Math, Stat], March.
Grigelionis, Bronius. 2013. Student’s t-Distribution and Related Stochastic Processes. SpringerBriefs in Statistics. Berlin, Heidelberg: Springer Berlin Heidelberg.
Grosswald, E. 1976. The Student t-Distribution of Any Degree of Freedom Is Infinitely Divisible.” Zeitschrift Für Wahrscheinlichkeitstheorie Und Verwandte Gebiete 36 (2): 103–9.
Harn, K. van, and F. W. Steutel. 1993. Stability Equations for Processes with Stationary Independent Increments Using Branching Processes and Poisson Mixtures.” Stochastic Processes and Their Applications 45 (2): 209–30.
Harn, K. van, F. W. Steutel, and W. Vervaat. 1982. Self-Decomposable Discrete Distributions and Branching Processes.” Zeitschrift Für Wahrscheinlichkeitstheorie Und Verwandte Gebiete 61 (1): 97–118.
Hasebe, Takahiro. 2014. Free Infinite Divisibility for Beta Distributions and Related Ones.” Electronic Journal of Probability 19 (none).
Houdré, Christian. 2002. Remarks on Deviation Inequalities for Functions of Infinitely Divisible Random Vectors.” The Annals of Probability 30 (3): 1223–37.
Ismail, Mourad E. H. 1977. Bessel Functions and the Infinite Divisibility of the Student \(t\)- Distribution.” The Annals of Probability 5 (4): 582–85.
James, Lancelot F., Bernard Roynette, and Marc Yor. 2008. Generalized Gamma Convolutions, Dirichlet Means, Thorin Measures, with Explicit Examples.” Probability Surveys 5: 346–415.
Janson, Svante. 2011. Stable Distributions.” Eprint arXiv:1112.0220, December.
Johnson, N. L., and S. Kotz. 1970. Distributions in Statistics. Vol. 1 : Continuous Univariate Distribution. New York.
Keilson, J., and F. W. Steutel. 1972. Families of Infinitely Divisible Distributions Closed Under Mixing and Convolution.” The Annals of Mathematical Statistics 43 (1): 242–50.
Kyprianou, Andreas E. 2014. Fluctuations of Lévy Processes with Applications: Introductory Lectures. Second edition. Universitext. Heidelberg: Springer.
Morris, Carl N. 1982. Natural Exponential Families with Quadratic Variance Functions.” The Annals of Statistics 10 (1): 65–80.
———. 1983. Natural Exponential Families with Quadratic Variance Functions: Statistical Theory.” The Annals of Statistics 11 (2): 515–29.
Morris, Carl N., and Kari F. Lock. 2009. Unifying the Named Natural Exponential Families and Their Relatives.” The American Statistician 63 (3): 247–53.
Nishiyama, Yu, and Kenji Fukumizu. 2016. Characteristic Kernels and Infinitely Divisible Distributions.” The Journal of Machine Learning Research 17 (1): 6240–67.
Pérez-Abreu, Victor, and Robert Stelzer. 2014. Infinitely Divisible Multivariate and Matrix Gamma Distributions.” Journal of Multivariate Analysis 130 (September): 155–75.
Sato, Ken-iti. 1999. Lévy Processes and Infinitely Divisible Distributions. Cambridge University Press.
Steutel, F. W. 1973. Some Recent Results in Infinite Divisibility.” Stochastic Processes and Their Applications 1 (2): 125–43.
Steutel, F. W., and K. van Harn. 1979. Discrete Analogues of Self-Decomposability and Stability.” The Annals of Probability 7 (5): 893–99.
Steutel, F. W., John T. Kent, Lennart Bondesson, and Ole Barndorff-Nielsen. 1979. Infinite Divisibility in Theory and Practice [with Discussion and Reply].” Scandinavian Journal of Statistics 6 (2): 57–64.
Steutel, Fred W. 1970. “Preservation of Infinite Divisibility Under Mixing and Related Topics.” Math. Centre Tracts 33.
Steutel, Fred W., and Klaas van Harn. 2003. Infinite Divisibility of Probability Distributions on the Real Line. Boca Raton: CRC Press.
Thorin, Olof. 1977a. On the Infinite Divisbility of the Pareto Distribution.” Scandinavian Actuarial Journal 1977 (1): 31–40.
———. 1977b. On the Infinite Divisibility of the Lognormal Distribution.” Scandinavian Actuarial Journal 1977 (3): 121–48.
Unser, Michael A., and Pouya Tafti. 2014. An Introduction to Sparse Stochastic Processes. New York: Cambridge University Press.
Wolpert, Robert L. 2021. Lecture Notes on Stationary Gamma Processes.” arXiv:2106.00087 [Math], May.

No comments yet. Why not leave one?

GitHub-flavored Markdown & a sane subset of HTML is supported.