Hostname: page-component-5f745c7db-2kk5n Total loading time: 0 Render date: 2025-01-06T07:08:19.706Z Has data issue: true hasContentIssue false
  • English
  • Français

As Good as GOLD: Gram–Schmidt Orthogonalization by Another Name

Published online by Cambridge University Press:  01 January 2025

Michael D. Hunter
Michael D. Hunter*
Affiliation:
University of Oklahoma Health Sciences Center
*
Correspondence should be made to Michael D. Hunter, Department of Pediatrics, University of Oklahoma Health Sciences Center, Oklahoma City, OK 73104 USA. Email: mhunter1@ouhsc.edu
Get access Rights & Permissions [Opens in a new window]

Abstract

Generalized orthogonal linear derivative (GOLD) estimates were proposed to correct a problem of correlated estimation errors in generalized local linear approximation (GLLA). This paper shows that GOLD estimates are related to GLLA estimates by the Gram–Schmidt orthogonalization process. Analytical work suggests that GLLA estimates are derivatives of an approximating polynomial and GOLD estimates are linear combinations of these derivatives. A series of simulation studies then further investigates and tests the analytical properties derived. The first study shows that when approximating or smoothing noisy data, GLLA outperforms GOLD, but when interpolating noisy data GOLD outperforms GLLA. The second study shows that when data are not noisy, GLLA always outperforms GOLD in terms of derivative estimation. Thus, when data can be smoothed or are not noisy, GLLA is preferred whereas when they cannot then GOLD is preferred. The last studies show situations where GOLD can produce biased estimates. In spite of these possible shortcomings of GOLD to produce accurate and unbiased estimates, GOLD may still provide adequate or improved model estimation because of its orthogonal error structure. However, GOLD should not be used purely for derivative estimation because the error covariance structure is irrelevant in this case. Future research should attempt to find orthogonal polynomial derivative estimators that produce accurate and unbiased derivatives with an orthogonal error structure.

Keywords

derivative estimationorthogonalizationpolynomial approximationlatent differential equationsdynamical systems
Type
Article
Information
Psychometrika , Volume 81 , Issue 4 , December 2016 , pp. 969 - 991
Copyright
Copyright © 2016 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Abarbanel, HDI Analysis of observed chaotic data, New York: Springer.CrossRefGoogle Scholar
Abarbanel, HDI, Brown, R., Sidorowich, J. J., Tsimring, L. S. (1993). The analysis of observed chaotic data in physical systems. Reviews of Modern Physics, 65 (4), 1331–1392.CrossRefGoogle Scholar
Bisconti, T. L., Bergeman, C. S., Boker, S. M. (2004). Emotional well-being in recently bereaved widows: A dynamical systems approach. Journal of Gerontology, 59B, 158–167.CrossRefGoogle Scholar
Bisconti, T. L., Bergeman, C. S., Boker, S. M. (2006). Social support as a predictor of variability: An examination of the adjustment trajectories of recent widows. Psychology and Aging, 21, 590–599.CrossRefGoogle ScholarPubMed
Björck, Å (1967). Solving linear least squares problems by Gram–Schmidt othogonalization. BIT, 7, 1–21.CrossRefGoogle Scholar
Boker, S. M., Deboeck, P. R., Edler, C., Keel, P. K., Chow, S.- M., Ferrer, E., Hsieh, F. (2009). Generalized local linear approximation of derivatives from time series. Statistical methods for modeling human dynamics: An interdisciplinary dialogue, Boca Raton, FL: Taylor and Francis.Google Scholar
Boker, S. M., Graham, J. (1998). A dynamical systems analysis of adolescent substance abuse. Multivariate Behavioral Research, 33, 479–507.CrossRefGoogle ScholarPubMed
Boker, S. M., Leibenluft, E., Deboeck, P. R., Virk, G., Postolache, T. T. (2008). Mood oscillations and coupling between mood and weather in patients with rapid cycling bipolar disorder. International Journal of Child Health and Human Development, 1 (2), 181–203.Google ScholarPubMed
Boker, S. M., Montpetit, M. A., Hunter, M. D., Bergeman, C. S., Molenaar, PCM, Newell, K. (2010). Modeling resilience with diffrential equations. Individual pathways of change: Statistical models for analyzing learning and development, Washington, DC: American Psychological Association. 183–206.CrossRefGoogle Scholar
Boker, S. M., Neale, M. C., Rausch, J., van Montfort, K., Oud, H., Satorra, A. (2004). Latent differential equation modeling with multivariate multi-occassion indicators. Recent developments on structural equation models: Theory and applications, Dordrecht: Kluwer Academic Publishers. 151–174.CrossRefGoogle Scholar
Boker, S. M., Nesselroade, J. R. (2002). A method for modeling the intrinsic dynamics of intraindividual variability: Recovering the parameters of simulated oscillators in multi-wave panel data. Multivariate Behavioral Research, 37, 127–160.CrossRefGoogle ScholarPubMed
Casdagli, M., Eubank, S., Farmer, J. D., Gibson, J. (1991). State space reconstruction in the presence of noise. Physica D, 51, 52–98.CrossRefGoogle Scholar
Chow, S., Ram, N., Boker, S. M., Fujita, F., Clore, G. (2005). Emotion as a thermostat: Representing emotion regulation using a damped oscillator model. Emotion, 5, 208–225.CrossRefGoogle ScholarPubMed
Deboeck, P. R. (2010). Estimating dynamical systems: Derivative estimation hints from Sir Ronald A Fisher. Multivariate Behavioral Research, 45, 725–745.CrossRefGoogle Scholar
Estabrook, R. (2015). Evaluating measurement of dynamic constructs: Defining a measurement model of derivatives. Psychological Methods, 20 (1), 117–141.CrossRefGoogle ScholarPubMed
Fisher, R. A. (1925). The influence of rainfall on the yield of wheat at Rothamsted. Philosophical Transactions of the Royal Society of London, Series B, Containing Papers of a Biological Character, 213, 89–142.Google Scholar
Giona, M., Lentini, F., Cimagalli, V. (1991). Functional reconstruction and local prediction of chaotic time series. Physical Review A, 44 (6), 3496CrossRefGoogle ScholarPubMed
Hamaker, E. L., Nesselroade, J. R., Molenaar, PCM (2007). (2007). (2003). (2006). The integrated trait-state model. Journal of Research in Personality, 41, 295–315.CrossRefGoogle Scholar
Landau, R. H., Páez, M. J., Bordeianu, C. C. Computational physics: Problem solving with computers, 2Weinheim: Wiley-VCH.CrossRefGoogle Scholar
Lay, D. C. Linear algebra and its applications, 3Boston, MA: Addison Wesley.Google Scholar
Leon, S. J. Linear algebra with applications, 7Upper Saddle River, NJ: Prentice Hall.Google Scholar
McArdle, J. J., Epstein, D. (1987). Latent growth curves within developmental structural equation models. Child Development, 58, 110–133.CrossRefGoogle ScholarPubMed
Molenaar, PCM, Newell, K. M. (2003). Direct fit of theoretical model of phase transition in oscillatory finger motions. British Journal of Mathematical and Statistical Psychology, 56, 199–214.CrossRefGoogle ScholarPubMed
Narula, S. C. (1979). Orthogonal polynomial regression. International Statistical Review, 47 (1), 31–36.CrossRefGoogle Scholar
Oud, JHL, Folmer, H. (2011). Reply to Steele & Ferrer: Modeling oscillation, approximately or exactly?. Multivariate Behavioral Research, 46 (6), 985–993.CrossRefGoogle ScholarPubMed
Savitzky, A., Golay, MJE (1964). Smoothing and differentiation of data by simplified least squares procedures. Analytical Chemistry, 36 (9), 1627–1639.CrossRefGoogle Scholar
Song, H., Ferrer, E. (2009). State-space modeling of dynamic psychological processes via the Kalman smoother algorithm: Rationale, finite sample properties, and applications. Structural Equation Modeling, 16, 338–363.CrossRefGoogle Scholar
Steele, J. S., Ferrer, E. (2011). Latent differential equation modeling of self-regulatory and coregulatory affective processes. Multivariate Behavioral Research, 46 (6), 956–984.CrossRefGoogle ScholarPubMed
Trail, J. B., Collins, L. M., Rivera, D. E., Li, R., Piper, M. E., Baker, T. B. (2014). unctional data analysis for dynamical system identification of behavioral processes. Psychological Methods, 19, 175–187.CrossRefGoogle Scholar
Whitney, H. (1936). Differentiable manifolds. The Annals of Mathematics, 37(3), 645–680. Retrieved from http://www.jstor.org/stable/1968482.CrossRefGoogle Scholar
Whittaker, E. T., & Robinson, G. (1924). The calculus of observations: A treatise on numerical mathematics (vol. 36) (No. 9). London.Google Scholar
Yang, M., Chow, S. (2010). Using state-space model with regime switching to represent the dynamics of facial electromyography (EMG) data. Psychometrika, 75, 744–771.CrossRefGoogle Scholar
Zentall, S. R., Boker, S. M., & Braungart-Rieker, J. M. (2006, June). Mother-infant synchrony: A dynamical systems approach. In Proceedings of the Fifth International Conference on Development and Learning.Google Scholar
Zheng, Y., Wiebe, R. P., Cleveland, H. H., Molenaar, P. C., Harris, K. S. (2013). An idiographic examination of day-to-day patterns of substance use craving, negative affect, and tobacco use among young adults in recovery. Multivariate Behavioral Research, 48 (2), 241–266.CrossRefGoogle ScholarPubMed