Hostname: page-component-cd9895bd7-jn8rn Total loading time: 0 Render date: 2024-12-27T08:04:46.546Z Has data issue: false hasContentIssue false

On identifiability of mixtures of independent distributionlaws∗∗∗∗∗

Published online by Cambridge University Press:  01 July 2014

Mikhail Kovtun
Affiliation:
Duke University, Dept. of Biology, Benfey Lab Durham, 27708 NC, USA. mikhail.kovtun@duke.edu
Igor Akushevich
Affiliation:
Center for Population Health and Aging Durham, 27708 NC, USA; igor.akushevich@duke.edu; anatoly.yashin@duke.edu
Anatoliy Yashin
Affiliation:
Center for Population Health and Aging Durham, 27708 NC, USA; igor.akushevich@duke.edu; anatoly.yashin@duke.edu
Get access

Abstract

We consider representations of a joint distribution law of a family of categorical randomvariables (i.e., a multivariate categorical variable) as a mixture ofindependent distribution laws (i.e. distribution laws according to whichrandom variables are mutually independent). For infinite families of random variables, wedescribe a class of mixtures with identifiable mixing measure. This class is interestingfrom a practical point of view as well, as its structure clarifies principles of selectinga “good” finite family of random variables to be used in applied research. For finitefamilies of random variables, the mixing measure is never identifiable; however, it alwayspossesses a number of identifiable invariants, which provide substantial informationregarding the distribution under consideration.

Type
Research Article
Copyright
© EDP Sciences, SMAI 2014

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Akushevich, I., Kovtun, M., Manton, K.G. and Yashin, A.I., Linear latent structure analysis and modeling of multiple categorical variables. Comput. Math. Methods Medicine 10 (2009) 203218. Google Scholar
Barndorff-Nielsen, O., Identifiability of mixtures of exponential families. J. Math. Anal. Appl. 12 (1965) 115121. Google Scholar
C. Dellacherie and P.-A. Meyer, Probabilities and Potential, vol. I. North-Holland Publishing Co., Amsterdam (1978).
N. Dunford, and J.T. Schwartz, Linear Operators, vol. I. Interscience Publishers, Inc., New York (1958).
B.S. Everitt, and D.J. Hand, Finite Mixture Distributions. Monographs on Applied Probability and Statistics. Chapman and Hall, London (1981).
O. Knill, Probability Theory and Stochastic Processes with Applications. Overseas Press (2009). ISBN 81-89938-40-1.
A.N. Kolmogorov and S.V. Fomin, Elements of the theory of functions and functional analysis. Moscow, Russia, Science, 3rd edition (1972). In Russian.
Kovtun, M., Akushevich, I., Manton, K.G. and Tolley, H.D., Linear latent structure analysis: Mixture distribution models with linear constraints. Statist. Methodology 4 (2007) 90110. Google Scholar
J.C. Oxtoby, Measure and Category. Number 2 in Graduate Texts in Mathematics. Springer-Verlag, New York, 2nd edition (1980). ISBN 0-378-90508-1.
A.N. Shiryaev, Probability. Moscow, Russia: MCCSE, 3rd edition (2004). In Russian.
Tallisand, G.M. Chesson, P., Identifiability of mixtures. J. Austral. Math. Soc. Ser. A 32 (1982) 339348. ISSN 0263-6115. Google Scholar
Teicher, H., On the mixture of distributions. Ann. Math. Stat. 31 (1960) 5573. Google Scholar
Teicher, H., Identifiability of mixtures. Ann. Math. Stat. 32 (1961) 244248. Google Scholar
Teicher, H., Identifiability of finite mixtures. Ann. Math. Stat. 34 (1963) 12651269. Google Scholar