An interdependent multivariate linear relations model based on manifest, measured variables as well as unmeasured and unmeasurable latent variables is developed. The latent variables include primary or residual common factors of any order as well as unique factors. The model has a simpler parametric structure than previous models, but it is designed to accommodate a wider range of applications via its structural equations, mean structure, covariance structure, and constraints on parameters. The parameters of the model may be estimated by gradient and quasi-Newton methods, or a Gauss-Newton algorithm that obtains least-squares, generalized least-squares, or maximum likelihood estimates. Large sample standard errors and goodness of fit tests are provided. The approach is illustrated by a test theory model and a longitudinal study of intelligence.