Raw mortality data often exhibit irregular patterns due to randomness. Graduation refers to the act of smoothing crude mortality rates. In this paper, we propose a flexible and robust methodology for graduating mortality rates using adaptive P-splines. Since the observed data at high ages are often sparse and unreliable, we use an exponentially increasing penalty. We use mortality data of England and Wales and model male and female mortality rates jointly by means of penalties, achieving borrowing of information between the two sexes.

Continuing increases in life expectancy beyond previously-held limits have brought to the fore the critical importance of mortality forecasting. Significant developments in mortality forecasting since 1980 are reviewed under three broad approaches: expectation, extrapolation and explanation. Expectation is not generally a good basis for mortality forecasting, as it is subjective; expert expectations are invariably conservative. Explanation is restricted to certain causes of death with known determinants. Decomposition by cause of death poses problems associated with the lack of independence among causes and data difficulties. Most developments have been in extrapolative forecasting, and make use of statistical methods rather than models developed primarily for age-specific graduation. Methods using two-factor models (age-period or age-cohort) have been most successful. The two-factor Lee–Carter method, and, in particular, its variants, have been successful in terms of accuracy, while recent advances have improved the estimation of forecast uncertainty. Regression-based (GLM) methods have been less successful, due to nonlinearities in time. Three-factor methods are more recent; the Lee–Carter age-period-cohort model appears promising. Specialised software has been developed and made available. Research needs include further comparative evaluations of methods in terms of the accuracy of the point forecast and its uncertainty, encompassing a wide range of mortality situations.

Mortality data are often classified by age at death and year of death. This classification results in a heterogeneous risk set and this can cause problems for the estimation and forecasting of mortality. In the modelling of such data, we replace the classical assumption that the numbers of claims follow the Poisson distribution with the weaker assumption that the numbers of claims have a variance proportional to the mean. The constant of proportionality is known as the dispersion parameter and it enables us to allow for heterogeneity; in the case of insurance data the dispersion parameter also allows for the presence of duplicates in a portfolio. We use both the quasi-likelihood and the extended quasi-likelihood to estimate models for the smoothing and forecasting of mortality tables jointly with smooth estimates of the dispersion parameters. We present three main applications of our method: first, we show how taking account of dispersion reduces the volatility of a forecast of a mortality table; second, we smooth mortality data by amounts, ie, when deaths are amounts claimed and exposed-to-risk are sums assured; third, we present a joint model for mortality by lives and by amounts with the property that forecasts by lives and by amounts are consistent. Our methods are illustrated with data from the Continuous Mortality Investigation.