It is common practice to approximate the cell loss probability (CLP) of cells entering a finite buffer by the overflow probability (OVFL) of a corresponding infinite buffer queue, since the CLP is typically harder to estimate. We obtain exact asymptotic results for CLP and OVFL for time-slotted queues where block arrivals in different time slots are i.i.d. and one cell is served per time slot. In this case the ratio of CLP to OVFL is asymptotically (1-ρ)/ρ, where ρ is the use or, equivalently, the mean arrival rate per time slot. Analogous asymptotic results are obtained for continuous time M/G/1 queues. In this case the ratio of CLP to OVFL is asymptotically 1-ρ.