This paper deals with the problem of discrete and distributed time-delay exponential stability for deterministic and uncertain stochastic high-order neural networks. The concept of a parameter weak coupling linear matrix inequality set (PWCLMIS) is developed. New results are derived in terms of PWCLMIS. Large mixed time delays can be obtained by using this approach. Furthermore, these results are more general than some previous existence results. Two numerical examples are given to show the merit of the approach.