In this paper, we consider two innovative structured matrices, CUPL-Toeplitz matrix and CUPL-Hankel matrix. The inverses of CUPL-Toeplitz and CUPL-Hankel matrices can be expressed by the Gohberg-Heinig type formulas, and the stability of the inverse matrices is verified in terms of 1-, ∞- and 2-norms, respectively. In addition, two algorithms for the inverses of CUPL-Toeplitz and CUPL-Hankel matrices are given and examples are provided to verify the feasibility of these algorithms.