In part due to simple demographics?
If most prisoners are younger, starting their incarceration incidents in their teens or twenties, then basically the fewer young people you have, the less people in prison:
https://populationeducation.org/u-s-population-pyramids-over...
Compare 1960 to 2020.