You are talking about the conceptual notion of a "fact", which is out of human reach. Outside of mathematics, labelling anything as a fact is an opinion, and the label is considered okay as long as everyone involved has a high confidence about this opinion.
For example, if you let an apple fall down to the ground and you say "The apple fell to the ground", then you can't really know whether it's a fact or not, because you don't have access to the official logs of the Universe where it would be recorded that "An apple fell to the ground". So you have to trust your senses (and for example the fact that you're not under hallucination or visualizing an illusion) to put some confidence into this belief. If you know you're not under drug usage and if there are other witnesses of the event, then you'll have a very high degree of confidence into the idea that the apple indeed fell on the ground, so much confidence that you would consider it a fact.
When it comes to complex questions about society and everything that we can read on the news, such degree of confidence is very rare. In the end, the threshold at which you consider something to be "a fact" is subjective and for this reason I think all this "facts aren't opinions" thing is dangerous, because it gives the illusion that what we call "facts" are absolute and binary, whereas it's often things we just have a high confidence about, and so it opens the door to slide our standard of what a fact is.
What matters is that our view of the world shouldn't be shaped by what we hope or believe the world _should_ be, but by what it really _seems_ to be. And that is sufficient enough without having to get on one's high horse with "facts".
I don't question the casual usefulness of the word "fact" in appropriate contexts, but when the discussion at hand precisely handles the very nature of what is a fact and what isn't, we need to dig down the true implications of the word.