There were also major gains in things like access to clean water, general safety from the perils of war (which often drives famines, etc), and so on. If one only looked at e.g. Roman aristocracy (which essentially controls for these sort of variables) then their life expectancy would likely be similar to our own. This exact study was carried out on the Ancient Greeks [1], even prior to the Romans, and found a life expectancy of 72 years. [1]
And while I know some will contest the source, while intentionally conflating the mystical with the historical, even the Bible hits on the average age of man: "The days of our lives are seventy years; And if by reason of strength they are eighty years, Yet their boast is only labor and sorrow; For it is soon cut off, and we fly away."
Notably that is in Psalms, Old Testament, and so it was like written over the time frame of 400-1400BC. And I think it's fairly self evident that that segment was written in the context of plain historical observation with no mysticism implied or stated. Basically life expectancy once you leave childhood, let alone peak longevity, hasn't changed all that much over thousands of years.
[1] - https://pubmed.ncbi.nlm.nih.gov/18359748/