With respect, that is a red flag for me and would indicate a bit of an "attitude problem" if I was interviewing or reviewing applications and this was mentioned. If going to the office - something absolutely normal and expected of any desk worker - is a "red line" for you and you let potential employers know that, then frankly I am not surprised people are not biting. Yes we all had a good ride over COVID but the trend (whether people like it or not) is for the bosses to want everyone back in the office.
I would respectfully suggest you suck it up, don't make a deal of it in your resume/CV or interview, and accept that you'll be badging through the turn-style 5 days a week along with everyone else and don't expect special treatment.
Good luck.