The Survey of Consumer Finances (SCF) indicates that, unlike subprime borrowers, prime borrowers are more likely to own investment homes during recessions than during recoveries. Drawing on this empirical fact, we present and estimate a dynamic stochastic general equilibrium (DSGE) model that distinguishes between borrowers through their credit access. We find that the relative ease of credit access among borrowers explains the divergence in investment homeownership seen in the data. This divergence is amplified when subprime borrowers are subject to lax credit conditions prior to a financial shock or when the nominal interest rate is constrained at the zero lower bound (ZLB). An expansionary monetary policy helps bridge this gap across borrowers.