The authors review their own empirical work inspired by the adaptive toolbox metaphor. The review examines factors influencing strategy selection and execution in multi-attribute inference tasks (e.g., information costs, time pressure, memory retrieval, dynamic environments, stimulus formats, intelligence). An emergent theme is the re-evaluation of contingency model claims about the elevated cognitive costs of compensatory in comparison with non-compensatory strategies. Contrary to common assertions about the impact of cognitive complexity, the empirical data suggest that manipulated variables exert their influence at the meta-level of deciding how to decide (i.e., which strategy to select) rather than at the level of strategy execution. An alternative conceptualisation of strategy selection, namely threshold adjustment in an evidence accumulation model, is also discussed and the difficulty in distinguishing empirically between these metaphors is acknowledged.