That's unfortunately not universally true. This is most obvious when considering the death penalty.
Norway exemplifies a rehabilitative justice model and it is effective, evidenced by low recidivism rates.
It can be about removing the threat that a person poses from society permanently.
It can be about making the victims feel a sense of relief and justice.